gsans/tokens.txt

Created May 14, 2024 07:49

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/gsans/fd05656a28cc4ee913de2d95a75c96d5.js"></script>
Save gsans/fd05656a28cc4ee913de2d95a75c96d5 to your computer and use it in GitHub Desktop.

Download ZIP

Tokens

Raw

	https://tiktokenizer.vercel.app/?model=text-embedding-ada-002

	This is love.
	Love is not what you think.
	love.
	LoVe.
	LOvE.
	Loving it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment