Skip to content

Instantly share code, notes, and snippets.

@alinazhanguwo

alinazhanguwo/kerasTokenizer.py

Created April 24, 2019 20:25
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save alinazhanguwo/75f7d8097db4c2d07293331122a62962 to your computer and use it in GitHub Desktop.
Save alinazhanguwo/75f7d8097db4c2d07293331122a62962 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
kerasTokenizer.py
max_fatures = 2000
tokenizer = Tokenizer(num_words=max_fatures, split=' ')
tokenizer.fit_on_texts(X)
X = tokenizer.texts_to_sequences(X)
X = pad_sequences(X)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment