Skip to content

Instantly share code, notes, and snippets.

@gsans
Created May 14, 2024 07:49
Show Gist options
  • Save gsans/fd05656a28cc4ee913de2d95a75c96d5 to your computer and use it in GitHub Desktop.
Save gsans/fd05656a28cc4ee913de2d95a75c96d5 to your computer and use it in GitHub Desktop.
Tokens
https://tiktokenizer.vercel.app/?model=text-embedding-ada-002
This is love.
Love is not what you think.
love.
LoVe.
LOvE.
Loving it.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment