Skip to content

Instantly share code, notes, and snippets.

@lewtun

lewtun/hf-endpoints-inference.ipynb

Created June 10, 2023 07:53
Show Gist options
  • Save lewtun/8664759c3aed30fe669cc9b469714b7c to your computer and use it in GitHub Desktop.
Save lewtun/8664759c3aed30fe669cc9b469714b7c to your computer and use it in GitHub Desktop.
Download ZIP
Demo of synchronous and token streaming text generation
Display the source blob
Display the rendered blob
Raw
hf-endpoints-inference.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment