Skip to content

Instantly share code, notes, and snippets.

@jischein

jischein/openai_example_batch_api.jsonl Secret

Created July 20, 2024 20:20
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save jischein/ac2965b2e35b97998cfa6ca828539184 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save jischein/ac2965b2e35b97998cfa6ca828539184 to your computer and use it in GitHub Desktop.
Download ZIP
Example Batch Request
Raw
openai_example_batch_api.jsonl
{"custom_id": "request-1", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "meta-llama/Meta-Llama-3-8B-Instruct", "messages": [{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Hello world!"}],"max_tokens": 1000}}
{"custom_id": "request-2", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "meta-llama/Meta-Llama-3-8B-Instruct", "messages": [{"role": "system", "content": "You are an unhelpful assistant."},{"role": "user", "content": "Hello world!"}],"max_tokens": 1000}}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment