Skip to content

Instantly share code, notes, and snippets.

@hjm-aws

hjm-aws/embedding-output-is-fp32-even-after-the-embedding-weight-is-casted-to-bf16.ipynb

Last active August 16, 2022 19:40
Show Gist options
  • Save hjm-aws/6faf373a6cafac00439815983af9f0a1 to your computer and use it in GitHub Desktop.
Save hjm-aws/6faf373a6cafac00439815983af9f0a1 to your computer and use it in GitHub Desktop.
Download ZIP
Getting Started with PyTorch on Cloud TPUs
Display the source blob
Display the rendered blob
Raw
embedding-output-is-fp32-even-after-the-embedding-weight-is-casted-to-bf16.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment