| Prompt Length Classification | Prompt Type | Input Tokens | Max Output Tokens | Actual Output Tokens | tok/s | Average resp time (ms) | 95% resp time (ms) | Using system prompt? | Temperature | Num Concurrent Users | AI Model ID | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| classification | classify | 155 | 1 | 1 | 5.54 | 181 | 180 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| classification | classify-hard | 155 | 1 | 1 | 5.54 | 181 | 180 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| short writing | short-haiku | 7 | 50 | 14 | 15.95 | 880 | 880 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| paragraph writing | happy-dog-simple | 17 | 100 | 100 | 17.8 | 5629 | 5600 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| paragraph writing | happy-dog-complex | 17 | 100 | 100 | 17.8 | 5626 | 5600 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| rag | rag-recommendation | 292 | 200 | 200 | 17.71 | 11354 | 11000 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| page writing | thousand-word-essay | 7 | 1000 | 1000 | 18 | 55602 | 56000 | Y | 0 | 1 | meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 | |
| long doc summary | summarize-doc | 126087 | 500 | 500 | 2.57 | 191377 | 195000 | Y | 0 | 1 | meta-llama/Meta-L |
| ⚙️ Running code: ```python | |
| from collections import defaultdict | |
| # Define the flight information | |
| flights = [ | |
| ("A", "F"), | |
| ("N", "B"), | |
| ("L", "K"), | |
| ("N", "M"), | |
| ("J", "C"), |
| Current flight information (the following flights are one-way only, and all the flights available are included below): | |
| There is a flight from city A to city F | |
| There is a flight from city N to city B | |
| There is a flight from city L to city K | |
| There is a flight from city N to city M | |
| There is a flight from city J to city C | |
| There is a flight from city D to city N | |
| There is a flight from city A to city I | |
| There is a flight from city K to city G | |
| There is a flight from city J to city E |
| { | |
| "openapi": "3.0.0", | |
| "info": { | |
| "title": "Zinc API", | |
| "version": "1.0.0", | |
| "contact": { | |
| "name": "Zinc API Support", | |
| "url": "https://docs.zincapi.com", | |
| "email": "support@zinc.io" | |
| }, |
I kept getting this annoying warning when running graphical apps from the command line in Ubuntu 12.04, using Unity 3D under X-Windows
Gtk-WARNING **: Unable to locate theme engine in module_path: "pixmap",
when launching apps from the terminal in Ubuntu 12.04 Unity 3D
So I found this solution sudo apt-get install gtk2-engines-pixbuf