Skip to content

Instantly share code, notes, and snippets.

@denguir
Last active June 12, 2024 14:25
Show Gist options
  • Save denguir/b21aa66ae7fb1089655dd9de8351a202 to your computer and use it in GitHub Desktop.
Save denguir/b21aa66ae7fb1089655dd9de8351a202 to your computer and use it in GitHub Desktop.
Installation procedure for CUDA & cuDNN

How to install CUDA & cuDNN on Ubuntu 22.04

Install NVIDIA drivers

Update & upgrade

sudo apt update && sudo apt upgrade

Remove previous NVIDIA installation

sudo apt autoremove nvidia* --purge

Check Ubuntu devices

ubuntu-drivers devices

You will install the NVIDIA driver whose version is tagged with recommended

Install Ubuntu drivers

sudo ubuntu-drivers autoinstall

Install NVIDIA drivers

My recommended version is 525, adapt to yours

sudo apt install nvidia-driver-525

Reboot & Check

reboot

after restart verify that the following command works

nvidia-smi

Install CUDA drivers

Update & upgrade

sudo apt update && sudo apt upgrade

Install CUDA toolkit

sudo apt install nvidia-cuda-toolkit

Check CUDA install

nvcc --version

Install cuDNN

Download cuDNN .deb file

You can download cuDNN file here. You will need an Nvidia account. Select the cuDNN version for the appropriate CUDA version, which is the version that appears when you run:

nvcc --version

Install cuDNN

sudo apt install ./<filename.deb>
sudo cp /var/cudnn-<something>.gpg /usr/share/keyrings/

My cuDNN version is 8, adapt the following to your version:

sudo apt update
sudo apt install libcudnn8
sudo apt install libcudnn8-dev
sudo apt install libcudnn8-samples

Test CUDA on Pytorch

Create a virtualenv and activate it

sudo apt-get install python3-pip
sudo pip3 install virtualenv 
virtualenv -p py3.10 venv
source venv/bin/activate

Install pytorch

pip3 install torch torchvision torchaudio

Open Python and execute a test

import torch
print(torch.cuda.is_available()) # should be True

t = torch.rand(10, 10).cuda()
print(t.device) # should be CUDA
@shravanvallaban
Copy link

@chococandy63 I have the same issue, I recently install Ubuntu 24.04 and when I tried install cuda drivers I get the same error.

@tmcf22
Copy link

tmcf22 commented May 27, 2024

This is great! Thank you so much. I have used this as a guideline for installing on multiple computers, maybe 20 times (no joke). Works every time. Much appreciated!

@chococandy63
Copy link

@shravanvallaban I think cuda drivers are not officially supported on Ubuntu 24.04. I mean they are not available on official website. I'm using them on previous Ubuntu versions and they working fine as of now.

@chunhanl
Copy link

chunhanl commented Jun 5, 2024

nice! thank you so much for this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment