Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
Install NVIDIA Driver and CUDA on Ubuntu / CentOS / Fedora Linux OS

In this article, I will share some of my experience on installing NVIDIA driver and CUDA on Linux OS. Here I mainly use Ubuntu as example. Comments for CentOS/Fedora are also provided as much as I can.

Table of Contents

Table of contents generated with markdown-toc

Install NVIDIA Graphics Driver via apt-get

In Ubuntu systems, drivers for NVIDIA Graphics Cards are already provided in the official repository. Installation is as simple as one command.

For ubuntu 14.04.5 LTS, the latest version is 352. To install the driver, excute sudo apt-get nvidia-352 nvidia-modprobe, and then reboot the machine.

For ubuntu 16.04.3 LTS, the latest version is 375. To install the driver, excute sudo apt-get nvidia-375 nvidia-modprobe, and then reboot the machine.

The nvidia-modprobe utility is used to load NVIDIA kernel modules and create NVIDIA character device files automatically everytime your machine boots up.

It is recommended for new users to install the driver via this way because it is simple. However, it has some drawbacks:

  1. The driver included in official Ubuntu repository is usually not the latest.
  2. There would be some naming conflicts when other repositories (e.g. ones from CUDA) are added to the system.
  3. One has to reinstall the driver after Linux kernel are updated.

Install NVIDIA Graphics Driver via runfile

For advanced user who wants to get the latest version of the driver, get rid of the reinstallation issue caused bby dkms, or using Linux distributions that do not have nvidia drivers provided in the repositories, installing from runfile is recommended.

Remove Previous Installations (Important)

One might have installed the driver via apt-get. So before reinstall the driver from runfile, uninstalling previous installations is required. Executing the following scripts carefully one by one.

sudo apt-get purge nvidia*

# Note this might remove your cuda installation as well
sudo apt-get autoremove 

# Recommended if .deb files from NVIDIA were installed
# Change 1404 to the exact system version or use tab autocompletion
# After executing this file, /etc/apt/sources.list.d should contain no files related to nvidia or cuda
sudo dpkg -P cuda-repo-ubuntu1404

Download the Driver

The latest NVIDIA driver for Linux OS can be fetched from NVIDIA's official website. The first one in the list, i.e. Latest Long Lived Branch version for Linux x86_64/AMD64/EM64T, is suitable for most case.

If you want to down load the driver directly in a Linux shell, the script below would be useful.

cd ~
wget http://us.download.nvidia.com/XFree86/Linux-x86_64/384.69/NVIDIA-Linux-x86_64-384.69.run

Detailed installation instruction can be found in the download page via a README hyperlink in the ADDITIONAL INFORMATION tab. I have also summarized key steps below.

Install Dependencies

Software required for the runfile are officially listed here. But this page seems to be stale and not easy to follow.

For Ubuntu, installing the following dependencies is enough.

  1. build-essential -- For building the driver
  2. (Optional) gcc-multilib -- For providing 32-bit support
  3. dkms -- For providing dkms support
  4. (Optional) xorg and xorg-dev. On a workstation with GUI, this is require but usually have already been installed, because you have already got the graphic display. On headless servers without GUI, this is not a must.

As a summary, excuting sudo apt-get install build-essential gcc-multilib dkms to install all dependencies.

Required packages for CentOS are epel-release dkms libstdc++.i686. Execute yum install epel-release dkms libstdc++.i686.

Required packages for Fedora are dkms libstdc++.i686 kernel-devel. Execute dnf install dkms libstdc++.i686 kernel-devel.

Creat Blacklist for Nouveau Driver

Create a file at /etc/modprobe.d/blacklist-nouveau.conf with the following contents:

blacklist nouveau
options nouveau modeset=0

Note: It is also possible for the NVIDIA installation runfile to creat this blacklist file automatically. Excute the runfile and follow instructions when an error realted Nouveau appears.

Then,

  1. for Ubuntu 14.04 LTS, reboot the computer;
  2. for Ubuntu 16.04 LTS, excute sudo update-initramfs -u and reboot the computer;
  3. for CentOS/Fedora, excute sudo dracut --force and reboot the computer.

Stop lightdm/gdm/kdm

After the computer is rebooted. We need to stop the desktop manager before excuting the runfile to install the driver. lightdm is the default desktop manager in Ubuntu. If GNOME or KDE desktop environment is used, installed desktop manager will then be gdm or kdm.

  1. For Ubuntu 14.04 / 16.04, excuting sudo service lightdm stop (or use gdm or kdm instead of lightdm)
  2. For Ubuntu 16.04 / Fedora / CentOS, excuting sudo systemctl stop lightdm (or use gdm or kdm instead of lightdm)

Excuting the Runfile

After above batch of preparition, we can eventually start excuting the runfile. So this is why I, from the very begining, recommend new users to install the driver via apt-get.

cd ~
chmod +x NVIDIA-Linux-x86_64-384.69.run
sudo ./NVIDIA-Linux-x86_64-384.69.run --dkms -s

Note:

  1. option --dkms is used for register dkms module into the kernel so that update of the kernel will not require a reinstallation of the driver. This option should be turned on by default.
  2. option -s is used for silent installation which should used for batch installation. For installation on a single computer, this option should be turned off for more installtion information.
  3. option --no-opengl-files can also be added if non-NVIDIA (AMD or Intel) graphics are used for display while NVIDIA graphics are used for display.
  4. The installer may prompt warning on a system without X.Org installed. It is safe to ignore that based on my experience.
WARNING: nvidia-installer was forced to guess the X library path '/usr/lib' and X module path '/usr/lib/xorg/modules'; these paths were not queryable from the system.  If X fails to find the NVIDIA X driver module, please install the `pkg-config` utility and the X.Org SDK/development package for your distribution and reinstall the driver.

Check the Installation

After a succesful installation, nvidia-smi command will report all your CUDA-capable devices in the system.

Common Errors and Solutions

  1. ERROR: Unable to load the 'nvidia-drm' kernel module.
  • One probable reason is that the system is boot from UEFI but Secure Boot option is turned on in the BIOS setting. Turn it off and the problem will be solved.

Additional Notes

nvidia-smi -pm 1 can enable the persistent mode, which will save some time from loading the driver. It will have significant effect on machines with more than 4 GPUs.

nvidia-smi -e 0 can disable ECC on TESLA products, which will provide about 1/15 more video memory. Reboot is reqired for taking effect. nvidia-smi -e 1 can be used to enable ECC again.

nvidia-smi -pl <some power value> can be used for increasing or decrasing the TDP limit of the GPU. Increasing will encourage higher GPU Boost frequency, but is somehow DANGEROUS and HARMFUL to the GPU. Decreasing will help to same some power, which is useful for machines that does not have enough power supply and will shutdown unintendedly when pull all GPU to their maximum load.

-i <GPUID> can be added after above commands to specify individual GPU.

These commands can be added to /etc/rc.local for excuting at system boot.

Install CUDA

Installing CUDA from runfile is much simpler and smoother than installing the NVIDIA driver. It just involves copying files to system directories and has nothing to do with the system kernel or online compilation. Removing CUDA is simply removing the installation directory. So I personally does not recommend adding NVIDIA's repositories and install CUDA via apt-get or other package managers as it will not reduce the complexity of installation or uninstallation but increase the risk of messing up the configurations for repositories.

The CUDA runfile installer can be downloaded from NVIDIA's websie. But what you download is a package the following three components:

  1. an NVIDIA driver installer, but usually of stale version;
  2. the actual CUDA installer;
  3. the CUDA samples installer;

To extract above three components, one can execute the runfile installer with --extract option. Then, executing the second one will finish the CUDA installation. Installation of the samples are also recommended because useful tool such as deviceQuery and p2pBandwidthLatencyTest are provided.

Scripts for installing CUDA Toolkit are summarized below.

cd ~
wget http://developer.download.nvidia.com/compute/cuda/7.5/Prod/local_installers/cuda_7.5.18_linux.run
chmod +x cuda_7.5.18_linux.run
./cuda_7.5.18_linux.run --extract=$HOME
sudo ./cuda-linux64-rel-7.5.18-19867135.run

After the installation finishes, configure runtime library.

sudo bash -c "echo /usr/local/cuda/lib64/ > /etc/ld.so.conf.d/cuda.conf"
sudo ldconfig

It is also recommended for Ubuntu users to append string /usr/local/cuda/bin to system file /etc/environments so that nvcc will be included in $PATH. This will take effect after reboot.

Install cuDNN

The recommended way for installing cuDNN is to first copy the tgz file to /usr/local and then extract it, and then remove the tgz file if necessary. This method will preserve symbolic links. At last, execute sudo ldconfig to update the shared library cache.

@Mozhdeh-d
Copy link

Mozhdeh-d commented Oct 19, 2018

Hi,
I installed Nvidia driver 390.77 on my system successfully via the Software Center > Additional software. Now when I try to install CUDA, the following error occurs:
Warning: Incomplete installation! This installation did not install the CUDA driver. A driver of version at least 384.00 is required for CUDA 9.1 functionality to work.

And I'm sure that the version of installed Nvidia driver is greater than 384.00!! Because when I use nvidia-smi command, it shows that the version of my my Nvidia driver is 390.77

Any suggestion? :(
Thanks in advance

Ubuntu: 18.04
Geforce GTX 750Ti
Nvidia driver: 390.77
CUDA: 9.1.85

@paloha
Copy link

paloha commented Dec 24, 2018

If I want to update the driver after installing it using this guide, do I still need to sudo apt-get purge nvidia*?
I would like to keep the current CUDA and CuDNN installation and I would only like to update the driver.
Is there an easy way, or do I need to do everything from scratch? Thanks a lot.

@wanghanlin14250
Copy link

wanghanlin14250 commented Jan 18, 2019

hey, when I finished driver, I run nvidia-smi and I get 'no devices were found', can someone help me out?

@doried-a-a
Copy link

doried-a-a commented Feb 9, 2019

Thank you very much! You mentioned literally everything I needed. After struggling for two days with nvidia drivers, I got the last version installed finally.

@JokerLbz
Copy link

JokerLbz commented Mar 6, 2019

Thanks a million!

@zeth-b
Copy link

zeth-b commented Mar 7, 2019

Hi! I'm just going to try this installation guide since I've been trying for a couples of days (many installation guides and Ubuntu releases) without any luck and it's frustrating me.

@JolerLbz can you please tell me what is your setup? Right now I'm trying Ubuntu 16.04.1, Kernel 4.15.0, an Nvidia GeForce GTX 1060. Should I install the last Nvidia driver available for my graph card, or any other?

Thanks in advance!

@zeth-b
Copy link

zeth-b commented Mar 7, 2019

Thanks a lot! It works now!!!

@colllin
Copy link

colllin commented Mar 24, 2019

Tip to list available/compatible nvidia-* drivers on your system:

$ ubuntu-drivers list
nvidia-384

From https://www.maketecheasier.com/install-nvidia-drivers-ubuntu/ — but don’t add the apt repository they recommend, or you will get different (incorrect) versions in that list.

@FlorinTulba
Copy link

FlorinTulba commented Mar 27, 2019

Based on the advises from https://easylinuxtipsproject.blogspot.com/p/nvidia.html#ID1 I managed to install the latest version of the nvidia driver (418.56 for Ubuntu 18.04(upstream for Linux Mint 19.1) - see: https://launchpad.net/~graphics-drivers/+archive/ubuntu/ppa where they regularly update the drivers list to include newer drivers).

The steps:

  • sudo add-apt-repository ppa:graphics-drivers/ppa
  • sudo apt-get update
  • selected nvidia-418 from the list provided by the Driver Manager and Apply Changes
  • reboot
  • [optionally] updated the nvidia-settings

@kenorb
Copy link

kenorb commented May 25, 2019

@kenorb
Copy link

kenorb commented May 25, 2019

@uzl
Copy link

uzl commented Jun 3, 2019

For Ubuntu 18.04 LTS
https://gist.github.com/uzl/f0a2f0b126cf0b569de370c3db5e95d4

Also solution for error during Building module or Compiler Mismatch problem

@aninternetian
Copy link

aninternetian commented Jun 4, 2019

I only needed CUDA on 18.04 and I got a Can't locate InstallUtils.pm error in the last line
In case anyone encountered this as well, this solution worked for me:
https://devtalk.nvidia.com/default/topic/983777/cuda-setup-and-installation/can-t-locate-installutils-pm-in-inc/post/5048816/#5048816

@thirdeye-yusuf
Copy link

thirdeye-yusuf commented Aug 9, 2019

Fantastic guide, got me out of a pickle :)

@CharlesB2
Copy link

CharlesB2 commented Aug 23, 2019

On Ubuntu, installing the NVIDIA graphics driver, you may have the following error in the install log:

Unable to load: nvidia-installer ncurses v6 user interface

My fix for it was to simply rm /usr/lib/nvidia/pre-install (not a great loss, as the script is just doing exit 1)

@kaaviyave
Copy link

kaaviyave commented Sep 6, 2019

Well explained! Worked like a charm after two days of problems with booting to a blank screen. Thanks a lot.

@avyas
Copy link

avyas commented Sep 8, 2019

CUDA 10.1 doesn't contain "the actual CUDA installer" cuda installer can be used with options: --samples --toolkit

@hash2430
Copy link

hash2430 commented Sep 17, 2019

So far, this is the best explanation that I have ever seen. Thanks a lot!

@stiv-yakovenko
Copy link

stiv-yakovenko commented Oct 16, 2019

Can you cover how to remove nvidia modules from kernel?

@vasi786
Copy link

vasi786 commented Feb 19, 2020

Worked perfectly. Thank you

@Guitaricet
Copy link

Guitaricet commented Mar 3, 2020

I had some issues but this guide saved me an hour or so. Thank you!

@Amused-Goose
Copy link

Amused-Goose commented Mar 26, 2020

I only needed to install cuda which also installed the driver (via the .run installer). Installing the driver first gave issues and the driver included with the cuda install was a bit older.
Thanks for this guide, installing the driver was never easier!

@XM-WANG
Copy link

XM-WANG commented May 20, 2020

Thanks for your amazing instruction! You know my computer was broken last week when I first came back to the company. IT staff assign me a new computer and therefore all of my configurations were changed. And I need to rebuild the whole environment including Nvidia driver, CUDA, and PyTorch. In this process, I noticed that the version of my driver was too old, which confused me a lot. But I suddenly reminded that my greatest leader has a perfect driver installation instruction on the gist. So I began to follow your instruction and updated my driver. That works well!

I couldn't remember how many times I used to update graphic drivers according to other instructions which always caused the graphic interface lost. This instruction is the best one I have ever met! I wish it could be known to all of the people who are troubled by the problems of graphic driver updating.

@mdgonzales1998
Copy link

mdgonzales1998 commented Jun 29, 2020

I got through all of the steps through the restart. Once I tried restarting and going into the BIO to make sure secure boot was disabled, I ran into an issue. My boot menus is a black screen with the mouse pointer that if I try moving it, it will move to the left of the screen and go down until I can't see it anymore. I tried proceeding without disabling secure boot as my machine doesn't have windows loaded, only Ubuntu 16.04. I see the Ubuntu load screen, then it goes to a black screen stuck with the text

"/dev/sda2: clean, 962340/60956672 files, 14739229/243809024 blocks
[ 27.018846] rc.local[1481]: 0"

Any help or guidance to helpful forums would be extremely helpful, thanks!

@yuqli
Copy link

yuqli commented Oct 1, 2020

Thanks! Particularly the first point. Manually update a driver, when there is already one driver installed, is a pain. Use apt-get is much easier! See this link to find available drivers on Ubuntu : https://www.cyberciti.biz/faq/ubuntu-linux-install-nvidia-driver-latest-proprietary-driver/

@KasperSkytte
Copy link

KasperSkytte commented Jan 20, 2021

Incredibly, this is still relevant in 2021!

@sidneydemoraes
Copy link

sidneydemoraes commented Apr 26, 2021

This is indeed the most incredible tutorial regarding NVidia drivers.
I got only one question: what if I need to uninstall all that? How to uninstall drivers installed through RUN files?

@sidneydemoraes
Copy link

sidneydemoraes commented Apr 26, 2021

Just found the answer to my own question: just run the same RUN file with the --uninstall option.

Besides, it worths mentioning that the new RUN file are much better now. We don't need to use the --extract option anymore. The installer already offers a menu with all installation options, including all three packages.

@buxizhizhoum
Copy link

buxizhizhoum commented Jul 16, 2021

Thanks

@laudai
Copy link

laudai commented Aug 18, 2021

Is that typo for "by" in sentence in "get rid of the reinstallation issue caused bby dkms," ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment