Skip to content

Instantly share code, notes, and snippets.

@ravenscroftj
Created April 28, 2024 08:46
Show Gist options
  • Save ravenscroftj/b6490708ae6f18bdf73a5b18945069b7 to your computer and use it in GitHub Desktop.
Save ravenscroftj/b6490708ae6f18bdf73a5b18945069b7 to your computer and use it in GitHub Desktop.
Minimal Groq + Continue.Dev Recipe

Minimal continue.dev Groq Config

{
  "models": [
    {
      "title":"Groq Llama 8b",
      "provider":"openai",
      "model": "llama3-8b-8192",
      "apiBase": "https://api.groq.com/openai/v1",
      "apiKey": "<APIKEY>",
      "completionOptions": {
        "stop": ["<|eot_id|>"]
      }
    },
    {
      "title":"Groq Llama 70b",
      "provider":"openai",
      "model": "llama3-70b-8192",
      "apiBase": "https://api.groq.com/openai/v1",
      "apiKey": "<APIKEY>",
      "completionOptions": {
        "stop": ["<|eot_id|>"]
      }
    }
  ],
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment