Skip to content

Instantly share code, notes, and snippets.

@megha444

megha444/nltk.py

Created Oct 13, 2020
Embed
What would you like to do?
import nltk
from nltk.tokenize import word_tokenize
nltk.download ('punkt')
text = "This is a sample text to show word tokenization"
print(word_tokenize(text))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.