Skip to content

Instantly share code, notes, and snippets.

@JoaoVictorVP
Created April 27, 2024 14:31
Show Gist options
  • Save JoaoVictorVP/92f6f30ad9d3c3dc343fdf0d7685685f to your computer and use it in GitHub Desktop.
Save JoaoVictorVP/92f6f30ad9d3c3dc343fdf0d7685685f to your computer and use it in GitHub Desktop.
### MambaHermes 3B Q6 ###
> Hi! I need you to transform this data into JSON: [A man named John with 300 dollars, a woman named Charly with 100 dollars, and another man called Max with 70 dollars]
{
"persons": [
{
"name": "John",
"amount": "$300"
},
{
"name": "Charly",
"amount": "$100"
},
{
"name": "Max",
"amount": "$70"
}
]
} <|end|>
--- PERFORMANCE STATS ---
Total execution time: 00:00:14.1458202
Time to first token: 00:00:02.3044179
Average token time: 00:00:00.1326407
Tokens Per Second: 7,539164072565962
> Yay! Now include the gender as well
{
"persons": [
{
"name": "John",
"amount": "$300",
"gender": "male"
},
{
"name": "Charly",
"amount": "$100",
"gender": "female"
},
{
"name": "Max",
"amount": "$70",
"gender": "male"
}
]
} <|end|>
--- PERFORMANCE STATS ---
Total execution time: 00:00:23.7654320
Time to first token: 00:00:08.3644267
Average token time: 00:00:00.1362655
Tokens Per Second: 7,3386146897050235
> Yay! Now also invent a role for them in a medieval fantasy world and add it
{
"persons": [
{
"name": "John",
"amount": "$300",
"gender": "male",
"role": "knight"
},
{
"name": "Charly",
"amount": "$100",
"gender": "female",
"role": "priestess"
},
{
"name": "Max",
"amount": "$70",
"gender": "male",
"role": "warrior"
}
]
}Ĩ<|end|>
--- PERFORMANCE STATS ---
Total execution time: 00:00:34.8454544
Time to first token: 00:00:15.2842991
Average token time: 00:00:00.1321373
Tokens Per Second: 7,567885827847246
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment