with Ubuntu 18.04 and higher, this might be useful: https://askubuntu.com/questions/61396/how-do-i-install-the-nvidia-drivers/61433#61433
However, it seems that contrary to what the ubuntu-drivers devices | grep nvidia
recommends, for Ubuntu 16.04, installing the latest recommended version of the driver (currently 430) does not play nice with X (maybe my kernal is not updated). And once I update the kernal I'll have to go through this all over again. So, better write shit down.
For now, following this
NOTE: May remove CUDA installations as well*