jonahgeorge

4 Steps in Running LLaMA-7B on a M1 MacBook

The large language models usability

The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.

Running LLaMA

There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.

jonahgeorge

Semantic Commit Messages

See how a minor change to your commit message style can make you a better programmer.

Format: <type>(<scope>): <subject>

<scope> is optional

Example

jonahgeorge

use std::collections::HashMap;
use std::fmt::Debug;

pub trait StaticBuilder {
    fn build(&self) -> Box<HasName>;
}

struct UserBuilder;

impl StaticBuilder for UserBuilder {

jonahgeorge

{
  "firstNames": [
    "Crimson",
    "Cinnamon",
    "Silent",
    "Sheik",
    "Dreamy",
    "Wondering",
    "Spicy",
    "Catchy",

jonahgeorge

__pycache__