Josef Polach josefpolach

## llama-7b-m1.md

      
        
          
            
              
              1 file
            
          
          
            
              
              20 forks
            
          
          
            
              
              16 comments
            
          
          
            
              
              127 stars
            
          
        
        
          
              
          
          
            
                cedrickchee
                / llama-7b-m1.md
            
            
              Last active
              September 22, 2024 10:33
            
              
                4 Steps in Running LLaMA-7B on a M1 MacBook with `llama.cpp`
              
          
        
      
        
  
      
    4 Steps in Running LLaMA-7B on a M1 MacBook

The large language models usability

The problem with large language models is that you can’t run these locally on your laptop. Thanks to Georgi Gerganov and his llama.cpp project, it is now possible to run Meta’s LLaMA on a single computer without a dedicated GPU.
Running LLaMA

There are multiple steps involved in running LLaMA locally on a M1 Mac after downloading the model weights.