Skip to content

Instantly share code, notes, and snippets.

@lisanka93

lisanka93/stopword_removal.py

Created July 13, 2020 15:37
Show Gist options
  • Save lisanka93/be8157dc1ecb499d90c7b1050d2c16b8 to your computer and use it in GitHub Desktop.
Save lisanka93/be8157dc1ecb499d90c7b1050d2c16b8 to your computer and use it in GitHub Desktop.
Download ZIP
removing stopwords with NLTK
Raw
stopword_removal.py
from nltk.corpus import stopwords
from nltk.tokenize import word_tokenize
example_sent = "This is a sample sentence, showing off the stop words filtration."
stop_words = set(stopwords.words('english'))
word_tokens = word_tokenize(example_sent)
filtered_sentence = [w for w in word_tokens if not w in stop_words]
print(filtered_sentence)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment