Skip to content

Instantly share code, notes, and snippets.

@prateekjoshi565

prateekjoshi565/seq_len_bert.py

Created July 17, 2020 14:56
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save prateekjoshi565/b1e8894f881a4db7acee4434c0b3712a to your computer and use it in GitHub Desktop.
Save prateekjoshi565/b1e8894f881a4db7acee4434c0b3712a to your computer and use it in GitHub Desktop.
Download ZIP
Raw
seq_len_bert.py
# get length of all the messages in the train set
seq_len = [len(i.split()) for i in train_text]
pd.Series(seq_len).hist(bins = 30)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment