Skip to content

Instantly share code, notes, and snippets.

@ultrons
Created December 4, 2020 13:44
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ultrons/098736dcc3e97c294dee02b4961510e4 to your computer and use it in GitHub Desktop.
Save ultrons/098736dcc3e97c294dee02b4961510e4 to your computer and use it in GitHub Desktop.
pytorch.org https://pytorch.org/xla/release/1.6/index.html
Cloud TPU Tools https://cloud.google.com/tpu/docs/cloud-tpu-tools
PyTorch / XLA GitHub https://github.com/pytorch/xla
Official Tutorials Fairseq Transformer: Fairseq RoBERTa: ResNet-50: PyTorch on Cloud TPU Pods:
Kaggle Kernels Super Clean PyTorch TPU Training Kernel Accelerator Power Hour (PyTorch + TPU) The Ultimate PyTorch+TPU Tutorial (Jigsaw XLM-R) Pytorch TPU improvements
Huggingface https://huggingface.co/transformers/examples.html#running-on-tpus
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment