Skip to content

Instantly share code, notes, and snippets.

@omchaithanyav

omchaithanyav/gist:c5b648c057208e45e75639bbf4b20115

Created July 11, 2021 16:52
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save omchaithanyav/c5b648c057208e45e75639bbf4b20115 to your computer and use it in GitHub Desktop.
Save omchaithanyav/c5b648c057208e45e75639bbf4b20115 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
text = X_train
# text preprocessing
Tokenizer = Tokenizer()
Tokenizer.fit_on_texts(text)
Tokenizer_vocab_size = len(Tokenizer.word_index) + 1
Tokenizer_vocab_size, X_train.shape, y_train.shape
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment