Check and understand the compute version required of your GPU on Nvidia's website. (GTX 560 TI = 2.1) https://developer.nvidia.com/cuda-gpus#compute Reference your compute version with the the CUDA toolkit documentation you wish to download. You can find the compute version that the toolkit offers in this page - 'Programming Guide' > 'I. Compute Capabilities'. The archive url should allow you to change the version to compare quickly what you need. https://docs.nvidia.com/cuda/archive/8.0/cuda-installation-guide-linux/index.html#post-installation-actions I learned that support for my GPU was dropped after CUDA 8.0 was released so, we will be installing v8.0.
I will be specifically speaking about CUDA 8.0 install from here on. (installing on Ubuntu 20.04)
This is to get an older packaged version of gcc 5.3 which is required (check the system requirements page in the toolkit document)
$ sudo add-apt-repository 'deb http://archive.ubuntu.com/ubuntu/ xenial main'
$ sudo apt update
$ sudo apt install gcc-5
$ sudo apt install g++-5
$ sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-5 10
$ sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-5 10
Do not run the install yet.
follow the instructions here: https://forums.developer.nvidia.com/t/cant-locate-installutils-pm-in-inc/46952
$ sh ./cuda_8.0.61_375.26_linux.run --tar mxvf
$ sudo cp InstallUtils.pm /usr/lib/x86_64-linux-gnu/perl-base
$ export $PERL5LIB