sudo apt update && sudo apt upgradesudo apt autoremove nvidia* --purgeubuntu-drivers devicesYou will install the NVIDIA driver whose version is tagged with recommended
sudo ubuntu-drivers autoinstallMy recommended version is 525, adapt to yours
sudo apt install nvidia-driver-525rebootafter restart verify that the following command works
nvidia-smisudo apt update && sudo apt upgradesudo apt install nvidia-cuda-toolkitnvcc --versionYou can download cuDNN file here. You will need an Nvidia account. Select the cuDNN version for the appropriate CUDA version, which is the version that appears when you run:
nvcc --versionsudo apt install ./<filename.deb>
sudo cp /var/cudnn-<something>.gpg /usr/share/keyrings/My cuDNN version is 8, adapt the following to your version:
sudo apt update
sudo apt install libcudnn8
sudo apt install libcudnn8-dev
sudo apt install libcudnn8-samplessudo apt-get install python3-pip
sudo pip3 install virtualenv
virtualenv -p py3.10 venv
source venv/bin/activatepip3 install torch torchvision torchaudioimport torch
print(torch.cuda.is_available()) # should be True
t = torch.rand(10, 10).cuda()
print(t.device) # should be CUDA
NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.No devices were foundsudo apt-get remove --purge '^nvidia-.'
sudo apt-get remove --purge '^libnvidia-.'
sudo apt-get remove --purge '^cuda-.*'
sudo apt autoremove
wget https://developer.download.nvidia.com/compute/cuda/12.3.0/local_installers/cuda_12.3.0_545.23.06_linux.run
sudo sh cuda_12.3.0_545.23.06_linux.run