Michael Yuan juntao

## cuda.md

      
        
          
            
              
              3 files
            
          
          
            
              
              0 forks
            
          
          
            
              
              0 comments
            
          
          
            
              
              0 stars
            
          
        
        
          
              
          
          
            
                juntao
                / cuda.md
            
            
              Last active
              October 17, 2023 09:19
                — forked from dm4/cuda.md
            
              
                Run WasmEdge WASI-NN plugin on AWS EC2 Instance 
              
          
        
      
        
  
      
    Setup CUDA on AWS EC2 Instance

This tutorial is based on this AWS tutorial.
In this tutorial, we will install Nvidia driver on AWS EC2 instance and compile and run llama.cpp on it.
Create an AWS EC2 instance

Here we use g5.4xlarge instance with Ubuntu 22.04 AMI, which use Nvidia A10G GPU.
Install Nvidia driver