Skip to content

Instantly share code, notes, and snippets.

@jwalker
jwalker / app.py
Created March 19, 2024 08:03
LLM Security Chatbot
import streamlit as st
from llama_cpp import Llama
import json
# Initialize the Llama model
llm = Llama(
model_path="../llama.cpp/models/mistral-7B-v0.1/ggml-model-Q4_K_M.gguf",
n_ctx=4096,
n_gpu_layers=-1,
chat_format="chatml"

Keybase proof

I hereby claim:

  • I am jwalker on github.
  • I am stellersjay (https://keybase.io/stellersjay) on keybase.
  • I have a public key ASC_dURwpuhc1l2-1a6LtgupYRL-eW_y0pcYDHwJTRK9ego

To claim this, I am signing this object: