Virtualize your NVIDIA

README.md

General

If you have a server then you want to virtualize your GPU card, lets follow this workaround.

Tested on

• Windows Server 2022
• RHEL
• Ubuntu

Driver on VMHost

• Make sure you have installed driver on your VMHost, you can download on nvid.nvidia.com

Check on VMHost

After driver succesfully installed, you can run this command

nvidia-smi

Driver on VM

• Make sure you have installed NVIDIA vGPU driver on your VM, you can download too on nvid.nvidia.com

Check on VM

After driver succesfully installed, you can run this command

## UNIX VM
nvidia-smi

## Windows
C:\Windows\System32\DriverStore\FileRepository\nvgridsw.*\nvidia-smi

for Windows you can permanent add path to System Variable on this :
System Properties > Advanced > Environment Variables > System Variables -> Path -> Edit > New > insert folder path with nvidia-smi

for /l %g in () do @(nvidia-smi & timeout /t 5)

• Windows

• Unix

Command for Installation

• https://www.teradici.com/web-help/ter1702003/2.8/Content/_Graphics%20Agent/Installing/Linux/installing_nvidia_linux_ubuntu.htm

Have existing NVIDIA?

If you have an existing NVIDIA on your VMHost, makesure your NVIDIA version on your VM same with NVIDIA Cuda version on your VMHost.

You can search the right driver with type nvidia-smi then search the right version with comparing on this link

You can download the right driver on nvid.nvidia.com too.

Bench your GPU (tested on Wserver2022)

• https://www.geeks3d.com/gputest/

Monitoring your GPU

apt install nvtop
nvtop

Reference

• https://forums.debian.net/viewtopic.php?t=103947