JeremiahKamama/tokenizer.py

Last active July 9, 2021 12:11

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/JeremiahKamama/6bb285f8c9c03a9675467e25add02bb3.js"></script>
Save JeremiahKamama/6bb285f8c9c03a9675467e25add02bb3 to your computer and use it in GitHub Desktop.

Download ZIP

Raw

tokenizer.py

	tokenizer = Tokenizer(num_words= 15000)
	tokenizer.fit_on_texts(review)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment