Skip to content

Instantly share code, notes, and snippets.

@kylepjohnson

kylepjohnson/non-lazy cltkv1 example

Last active March 14, 2020 17:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kylepjohnson/f88190973fb4b485eba8b111669aae9b to your computer and use it in GitHub Desktop.
Save kylepjohnson/f88190973fb4b485eba8b111669aae9b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
non-lazy cltkv1 example
(cltk) AMAC02Z92FELVCG:cltkv1 kyle.p.johnson$ mv ~/cltk_data ~/cltk_data_bak
(cltk) AMAC02Z92FELVCG:cltkv1 kyle.p.johnson$ poetry run python src/cltkv1/nlp.py
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.ar.vec' to '/Users/kyle.p.johnson/cltk_data/arb/embeddings/fasttext/wiki.ar.vec'? [y/n] y
100%|█████████████████████████████████████| 1.61G/1.61G [02:39<00:00, 10.1MiB/s]
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.arc.vec' to '/Users/kyle.p.johnson/cltk_data/arc/embeddings/fasttext/wiki.arc.vec'? [y/n] y
100%|█████████████████████████████████████| 8.66M/8.66M [00:00<00:00, 10.9MiB/s]
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.got.vec' to '/Users/kyle.p.johnson/cltk_data/got/embeddings/fasttext/wiki.got.vec'? [y/n] y
100%|█████████████████████████████████████| 6.94M/6.94M [00:00<00:00, 10.3MiB/s]
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.la.vec' to '/Users/kyle.p.johnson/cltk_data/lat/embeddings/fasttext/wiki.la.vec'? [y/n] y
100%|███████████████████████████████████████| 364M/364M [00:37<00:00, 9.71MiB/s]
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.ang.vec' to '/Users/kyle.p.johnson/cltk_data/ang/embeddings/fasttext/wiki.ang.vec'? [y/n] y
100%|█████████████████████████████████████| 34.0M/34.0M [00:03<00:00, 10.7MiB/s]
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.pi.vec' to '/Users/kyle.p.johnson/cltk_data/pli/embeddings/fasttext/wiki.pi.vec'? [y/n] y
100%|█████████████████████████████████████| 5.02M/5.02M [00:00<00:00, 10.5MiB/s]
Do you want to download file 'https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.sa.vec' to '/Users/kyle.p.johnson/cltk_data/san/embeddings/fasttext/wiki.sa.vec'? [y/n] y
100%|███████████████████████████████████████| 129M/129M [00:12<00:00, 10.2MiB/s]
lat
Gallia est omnis divisa in partes tres, quarum una
../aten/src/ATen/native/LegacyDefinitions.cpp:19: UserWarning: masked_fill_ received a mask with dtype torch.uint8, this behavior is now deprecated,please use a mask with dtype torch.bool instead.
partes 6 [-0.10447 -0.092736 0.26113 -0.19752 0.028025]
got
swa liuhtjai liuhaþ izwar in andwairþja manne, ei
../aten/src/ATen/native/LegacyDefinitions.cpp:19: UserWarning: masked_fill_ received a mask with dtype torch.uint8, this behavior is now deprecated,please use a mask with dtype torch.bool instead.
andwairþja 6 [0. 0. 0. 0. 0.]
arb
كهيعص ﴿١﴾ ذِكْرُ رَحْمَتِ رَبِّكَ عَبْدَهُ زَكَرِي
رَحْمَتِ 5 [0. 0. 0. 0. 0.]
arc
ܒ݁ܪܺܫܺܝܬ݂ ܐܺܝܬ݂ܰܘܗ݈ܝ ܗ݈ܘܳܐ ܡܶܠܬ݂ܳܐ ܘܗܽܘ ܡܶܠܬ݂ܳܐ ܐܺ
ܺ 5 [0. 0. 0. 0. 0.]
pli
Raajaa aaha 'ki.mlakkha.no, bhante naagasena, mana
naagasena 5 [0. 0. 0. 0. 0.]
san
ईशा वास्यम् इदं सर्वं यत् किञ्च जगत्यां जगत् ।
तेन
किञ्च 5 [-0.28932 0.011622 0.28246 0.14547 -0.6019 ]
ang
Hwæt. We Gardena in geardagum,
þeodcyninga, þrym g
, 5 [ 0.069126 -0.068524 -0.21202 0.10003 0.0069209]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment