Skip to content

Instantly share code, notes, and snippets.

@jkeam
Created January 23, 2024 18:43
Show Gist options
  • Save jkeam/9e6c49140dcb9eb606c5a4a767d3cdf0 to your computer and use it in GitHub Desktop.
Save jkeam/9e6c49140dcb9eb606c5a4a767d3cdf0 to your computer and use it in GitHub Desktop.
Running Local Llama

Running Local Llama

Installation

I'm using a Mac, sooooooooooo these instructions are Apple-esque.

brew install ollama

Running

  1. Start the server

    ollama serve
  2. Run model

    ollama run llama2
  3. Profit! Start talking to the bot!

@jkeam
Copy link
Author

jkeam commented Jan 29, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment