Skip to content

Instantly share code, notes, and snippets.

@aravindpai

aravindpai/10_2.py

Created March 12, 2020 09:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save aravindpai/95f42e1e61d387e55b57c7d405e1a5c8 to your computer and use it in GitHub Desktop.
Save aravindpai/95f42e1e61d387e55b57c7d405e1a5c8 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
10_2.py
from keras.preprocessing.text import Tokenizer
from keras.preprocessing.sequence import pad_sequences
#Tokenize the sentences
tokenizer = Tokenizer()
#preparing vocabulary
tokenizer.fit_on_texts(list(x_tr))
#converting text into integer sequences
x_tr_seq = tokenizer.texts_to_sequences(x_tr)
x_val_seq = tokenizer.texts_to_sequences(x_val)
#padding to prepare sequences of same length
x_tr_seq = pad_sequences(x_tr_seq, maxlen=100)
x_val_seq = pad_sequences(x_val_seq, maxlen=100)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment