TensorRT on Google Colab

TensorRT_on_Google_Colab.md

Checks TensorRT installation on Google Colab

More information: googlecolab/colabtools#1844

Code

Installing TensorRT via pip

!pip install --upgrade --index-url https://pypi.ngc.nvidia.com nvidia-tensorrt

Confirmation of TensorRT in Python (Google Colab)

import tensorrt as trt
print(trt.__version__)

Test result

Cell 1

!pip install --upgrade --index-url https://pypi.ngc.nvidia.com nvidia-tensorrt

Output 1

Looking in indexes: https://pypi.ngc.nvidia.com
Collecting nvidia-tensorrt
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-tensorrt/nvidia_tensorrt-8.4.3.1-cp310-none-linux_x86_64.whl (340.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 340.9/340.9 MB 2.5 MB/s eta 0:00:00
Collecting nvidia-cuda-runtime-cu11 (from nvidia-tensorrt)
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-cuda-runtime-cu11/nvidia-cuda-runtime-cu11-2022.4.25.tar.gz (16 kB)
  Preparing metadata (setup.py) ... done
Collecting nvidia-cudnn-cu11 (from nvidia-tensorrt)
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-cudnn-cu11/nvidia-cudnn-cu11-2022.5.19.tar.gz (16 kB)
  Preparing metadata (setup.py) ... done
Collecting nvidia-cublas-cu11 (from nvidia-tensorrt)
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-cublas-cu11/nvidia-cublas-cu11-2022.4.8.tar.gz (16 kB)
  Preparing metadata (setup.py) ... done
Collecting nvidia-cublas-cu117 (from nvidia-cublas-cu11->nvidia-tensorrt)
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-cublas-cu117/nvidia_cublas_cu117-11.10.1.25-py3-none-manylinux1_x86_64.whl (333.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 333.1/333.1 MB 3.2 MB/s eta 0:00:00
Collecting nvidia-cuda-runtime-cu117 (from nvidia-cuda-runtime-cu11->nvidia-tensorrt)
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-cuda-runtime-cu117/nvidia_cuda_runtime_cu117-11.7.60-py3-none-manylinux1_x86_64.whl (849 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 849.3/849.3 kB 63.4 MB/s eta 0:00:00
Collecting nvidia-cudnn-cu116 (from nvidia-cudnn-cu11->nvidia-tensorrt)
  Downloading https://developer.download.nvidia.com/compute/redist/nvidia-cudnn-cu116/nvidia_cudnn_cu116-8.4.0.27-py3-none-manylinux1_x86_64.whl (719.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 719.3/719.3 MB 2.4 MB/s eta 0:00:00
Requirement already satisfied: setuptools in /usr/local/lib/python3.10/dist-packages (from nvidia-cublas-cu117->nvidia-cublas-cu11->nvidia-tensorrt) (67.7.2)
Requirement already satisfied: wheel in /usr/local/lib/python3.10/dist-packages (from nvidia-cublas-cu117->nvidia-cublas-cu11->nvidia-tensorrt) (0.41.2)
Building wheels for collected packages: nvidia-cublas-cu11, nvidia-cuda-runtime-cu11, nvidia-cudnn-cu11
  Building wheel for nvidia-cublas-cu11 (setup.py) ... done
  Created wheel for nvidia-cublas-cu11: filename=nvidia_cublas_cu11-2022.4.8-py3-none-any.whl size=15604 sha256=c05038228098941649bd70ce1174b822e37e6ac5a23b471ebc99ddc5a014c923
  Stored in directory: /root/.cache/pip/wheels/8f/ed/66/aa1caefa04698673b59e1799fface640a8f6e840e59b9c27e3
  Building wheel for nvidia-cuda-runtime-cu11 (setup.py) ... done
  Created wheel for nvidia-cuda-runtime-cu11: filename=nvidia_cuda_runtime_cu11-2022.4.25-py3-none-any.whl size=15676 sha256=9f88320a29ec8f44aa30a8c9c8ee432db725fdaceeb015831b16291ba37fbe54
  Stored in directory: /root/.cache/pip/wheels/13/1a/0c/e13ce07df95cd19a0671df35ef74895be1f1bf2a62437aa1a9
  Building wheel for nvidia-cudnn-cu11 (setup.py) ... done
  Created wheel for nvidia-cudnn-cu11: filename=nvidia_cudnn_cu11-2022.5.19-py3-none-any.whl size=15599 sha256=1dddfb45dc1c29fbe2ccb67763796c429faf4f835a3d7a9e39d34d221f031d7b
  Stored in directory: /root/.cache/pip/wheels/dd/54/d7/1fe1c468474961cf9e43e85e89fa73b9d41f1608b70e753b03
Successfully built nvidia-cublas-cu11 nvidia-cuda-runtime-cu11 nvidia-cudnn-cu11
Installing collected packages: nvidia-cudnn-cu116, nvidia-cuda-runtime-cu117, nvidia-cublas-cu117, nvidia-cudnn-cu11, nvidia-cuda-runtime-cu11, nvidia-cublas-cu11, nvidia-tensorrt
Successfully installed nvidia-cublas-cu11-2022.4.8 nvidia-cublas-cu117-11.10.1.25 nvidia-cuda-runtime-cu11-2022.4.25 nvidia-cuda-runtime-cu117-11.7.60 nvidia-cudnn-cu11-2022.5.19 nvidia-cudnn-cu116-8.4.0.27 nvidia-tensorrt-8.4.3.1

Cell 2

import tensorrt as trt
print(trt.__version__)

Output 2

8.4.3.1

Total time taken

Approx. less than 1 minute.