Skip to content

Instantly share code, notes, and snippets.

@iamaziz
Last active April 16, 2024 16:59
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save iamaziz/1f14dc9263ec96de7c0b7c6de3d38185 to your computer and use it in GitHub Desktop.
Save iamaziz/1f14dc9263ec96de7c0b7c6de3d38185 to your computer and use it in GitHub Desktop.
Running Jais LLM on M3 Max chip with 64GB - using `torch_dtype=torch.float16`. Now much faster but way off
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment