Johannisbaer

## LLama3_AMD.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                Johannisbaer
                / LLama3_AMD.md
            
            
              Last active
              April 24, 2024 07:08
            
              
                Running LLama 3 on Consumer Hardware: AMD 6900 XT on Ubuntu 22.04
              
          
    Running LLama 3 8B Instruct on a single consumer grade AMD graphics card


LLama 3 8B is one of the newest models released by Meta. It punches above its weight class, offering high performance with lower resource consumption than some 22B or 70B models. Its size and output quality makes it interesting for me for systems handeling sensitive data when run locally/offline.

Prerequisites
This guide uses AMD GPUs, with Nvidia you can skip the ROCm install and dependencies to run the script.
Operating System: Ubuntu 22.04

  
## Ubuntu 22.04_ROCm_install_guide.md

      
              1 file
            
          
              0 forks
            
          
              0 comments
            
          
              1 star
            
          
                Johannisbaer
                / Ubuntu 22.04_ROCm_install_guide.md
            
            
              Last active
              February 16, 2024 08:50
            
              
                My ROCm install on Ubuntu 22.04 LTS
              
          
    Title: Step-by-Step Guide to Install ROCm on Ubuntu 22.04 LTS
June 8th 2023

Introduction
In this post, I will provide the solution that worked on my system on how to install Radeon Open Compute (ROCm) on Ubuntu 22.04 for 6000 series AMD GPU's.
ROCm is an open-source software platform that allows GPU-accelerated computation. It's a valuable tool for those needing to perform complex computations and data-intensive tasks (e.g., machine learning / AI models).