| Tier | Model | Use Cases | Cost (per 1K tokens) | % of Queries |
|---|---|---|---|---|
| Simple | Phi-2 (2.7B) | Definitions, facts | $0.0001 / 1K | 60% |
| Medium | Mistral-7B | Summaries, comparisons | $0.0002 / 1K | 30% |
| Complex | Llama-3-8B | Analysis, reasoning | $0.0003 / 1K | 10% |
-
-
Save bhatti/c2f7f3ee33537c7a9c1b7f8f578f86b5 to your computer and use it in GitHub Desktop.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment