Skip to content

Instantly share code, notes, and snippets.

View pyc96's full-sized avatar

Charles Chen pyc96

View GitHub Profile
import asyncio
import time
import httpx
import json
# Configuration
URL = "http://localhost:8000/v1/chat/completions"
CONCURRENT_REQUESTS = 5