Skip to content

Instantly share code, notes, and snippets.

View piegu's full-sized avatar

Pierre Guillou piegu

149 followers · 140 following
View GitHub Profile
@piegu
piegu / Byte-Level-BPE_universal_tokenizer_but_en_vs_pt_tokenizer.ipynb
Last active July 3, 2020 07:47
English vs Portuguese tokenizer on Portuguese Wikipedia of Byte-Level-BPE_universal_tokenizer_but_en_tokenizer.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@piegu
piegu / Byte-Level-BPE_universal_tokenizer_but_en_tokenizer_3_languages.ipynb
Created July 2, 2020 20:59
en tokenizer on a text in 3 languages of Byte-Level-BPE_universal_tokenizer_but.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@piegu
piegu / Byte-Level-BPE_universal_tokenizer_but_en_pt_tonenizers.ipynb
Created July 2, 2020 20:52
en and pt BBPE tokenizers from Byte-Level-BPE_universal_tokenizer_but.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@piegu
piegu / Byte-Level-BPE_universal_tokenizer_but_get_txt_csv_files.ipynb
Created July 2, 2020 20:44
get txt and csv files of articles of Byte-Level-BPE_universal_tokenizer_but.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@piegu
piegu / Byte-Level-BPE_universal_tokenizer_but_download.ipynb
Created July 2, 2020 20:01
download of Byte-Level-BPE_universal_tokenizer_but.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@piegu
piegu / Byte-Level-BPE_universal_tokenizer_but_initialization.ipynb
Created July 2, 2020 19:54
initialization of Byte-Level-BPE_universal_tokenizer_but.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@piegu
piegu / Acesso_gcp_jupyter_pela_rede_ISC.md
Created March 16, 2019 12:39 — forked from EMFS/Acesso_gcp_jupyter_pela_rede_ISC.md

Acesso ao GCP e servidor Jupyter pela rede ISC

Solução para contornar o problema de tunelamento usando ssh para acessar o Jupyter notebook que é bloqueado pelo firewall da rede wifi do ISC, onde ocorrem os encontros presenciais do grupo de estudo em Deep Learning de Brasília.

A ideia é tornar o servidor jupyter executando no Google Cloud Platform (GCP) acessível para rede externa, diretamente por seu IP, sem a necessidade de tunelamento via ssh.

Alterando as configurações da instância na console GCP

https://console.cloud.google.com/networking/addresses/

Logado na console GCP, acessar o endereço acima e reservar um endereço IP estático: "Reserve Static Address".

@piegu
piegu / classifying_works_of_fiction.ipynb
Created February 16, 2019 11:37 — forked from andrewreece/classifying_works_of_fiction.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.