Skip to content

Instantly share code, notes, and snippets.

@makispl

makispl/lemmatization.py

Created April 11, 2020 22:05
Show Gist options
  • Save makispl/f82b181b3ee0791dbd57a568ca28e5d2 to your computer and use it in GitHub Desktop.
Save makispl/f82b181b3ee0791dbd57a568ca28e5d2 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
lemmatization.py
lemmatizer = nltk.stem.WordNetLemmatizer()
training_set['SMS'] = training_set['SMS'].apply(lambda x: ' '.join(
lemmatizer.lemmatize(term, pos='v') for term in x.split())
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment