Skip to content

Instantly share code, notes, and snippets.

@prateekjoshi565

prateekjoshi565/data_prep.py

Last active February 6, 2019 09:50
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save prateekjoshi565/2640c799ea255505be35af2c16db72e3 to your computer and use it in GitHub Desktop.
Save prateekjoshi565/2640c799ea255505be35af2c16db72e3 to your computer and use it in GitHub Desktop.
Download ZIP
Data preparation
Raw
data_prep.py
# prepare training data
trainX = encode_sequences(deu_tokenizer, deu_length, train[:, 1])
trainY = encode_sequences(eng_tokenizer, eng_length, train[:, 0])
# prepare validation data
testX = encode_sequences(deu_tokenizer, deu_length, test[:, 1])
testY = encode_sequences(eng_tokenizer, eng_length, test[:, 0])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment