I hereby claim:
- I am jwalker on github.
- I am stellersjay (https://keybase.io/stellersjay) on keybase.
- I have a public key ASC_dURwpuhc1l2-1a6LtgupYRL-eW_y0pcYDHwJTRK9ego
To claim this, I am signing this object:
import streamlit as st | |
from llama_cpp import Llama | |
import json | |
# Initialize the Llama model | |
llm = Llama( | |
model_path="../llama.cpp/models/mistral-7B-v0.1/ggml-model-Q4_K_M.gguf", | |
n_ctx=4096, | |
n_gpu_layers=-1, | |
chat_format="chatml" |
I hereby claim:
To claim this, I am signing this object: