Skip to content

Instantly share code, notes, and snippets.

@mrkstu
mrkstu / gist:147ce2d91d6a79e0fb561888b243d032
Created January 29, 2024 04:26 — forked from ivanfioravanti/gist:bcacc48ef68b02e9b7a4034161824287
Fine tuning dataset generation wiht Ollama python library
import json
import os
import ollama
def query_ollama(prompt, model='openhermes:7b-mistral-v2.5-q6_K', context=''):
response = ollama.generate(
model=model,
prompt=context + prompt)
return response['response'].strip()