Skip to content

Instantly share code, notes, and snippets.

@neuromaancer

neuromaancer/genereate_vocabs_from_list.py

Last active April 30, 2022 13:50
Show Gist options
  • Save neuromaancer/0a6ade406317de4eecfb89eecf9746f1 to your computer and use it in GitHub Desktop.
Save neuromaancer/0a6ade406317de4eecfb89eecf9746f1 to your computer and use it in GitHub Desktop.
Download ZIP
genereate vocabs from list
Raw
genereate_vocabs_from_list.py
# docs is 2 dims
vocabs = set(itertools.chain.from_iterable(docs))
return vocabs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment