Installing dlib using conda with CUDA enabled

install_dlib_conda.md

Installing dlib using conda with CUDA enabled

Prerequisite: conda and/or miniconda are already installed

1. Create a conda environment.

$ conda create -n dlib python=3.8 cmake ipython

2. Activate the environment.

$ conda activate dlib

3. Install CUDA and cuDNN with conda using nvidia channel

$ conda install cuda cudnn -c nvidia

Then find the path to the nvcc of this environment. We will use this path for the build step below

$which nvcc
/path/to/your/miniconda3/envs/dlib/bin/

4. Install dlib. Clone and build dlib from source

$ git clone https://github.com/davisking/dlib.git
$ cd dlib
$ mkdir build
$ cd build
$ cmake .. -DDLIB_USE_CUDA=1 -DUSE_AVX_INSTRUCTIONS=1 -DCUDAToolkit_ROOT=/path/to/your/miniconda3/envs/dlib/bin/
$ cmake --build .
$ cd ..
$ python setup.py install --set DLIB_USE_CUDA=1

5. Test dlib

(dlib) $ ipython
Python 3.8.12 (default, Oct 12 2021, 13:49:34)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.27.0 -- An enhanced Interactive Python. Type '?' for help.

In [1]: import dlib

In [2]: dlib.DLIB_USE_CUDA
Out[2]: True

In [3]: print(dlib.cuda.get_num_devices())
1

Nice guide! In my case I had to set export CUDAHOSTCXX=/usr/bin/g++ because otherwise I got the following error:

-- Building a CUDA test project to see if your compiler is compatible with CUDA...
-- *****************************************************************************************************************
-- *** CUDA was found but your compiler failed to compile a simple CUDA program so dlib isn't going to use CUDA. 
-- *** The output of the failed CUDA test compile is shown below: 
-- *** 
-- ***   Change Dir: /home/yannic/dlib/build/temp.linux-x86_64-3.10/dlib_build/cuda_test_build
   ***   
   ***   Run Build Command(s):/usr/bin/gmake -f Makefile && [ 50%] Building NVCC (Device) object CMakeFiles/cuda_test.dir/cuda_test_generated_cuda_test.cu.o
   ***   nvcc warning : Support for offline compilation for architectures prior to '<compute/sm/lto>_75' will be removed in a future release (Use -Wno-deprecated-gpu-targets to suppress warning).
   ***   cc: fatal error: cannot execute ‘cc1plus’: execvp: No such file or directory
   ***   compilation terminated.
   ***   nvcc fatal   : Failed to preprocess host compiler properties.
   ***   CMake Error at cuda_test_generated_cuda_test.cu.o.cmake:216 (message):
   ***     Error generating
   ***     /home/yannic/dlib/build/temp.linux-x86_64-3.10/dlib_build/cuda_test_build/CMakeFiles/cuda_test.dir//./cuda_test_generated_cuda_test.cu.o
   ***   
   ***   
   ***   gmake[2]: *** [CMakeFiles/cuda_test.dir/build.make:77: CMakeFiles/cuda_test.dir/cuda_test_generated_cuda_test.cu.o] Error 1
   ***   gmake[1]: *** [CMakeFiles/Makefile2:82: CMakeFiles/cuda_test.dir/all] Error 2
   ***   gmake: *** [Makefile:91: all] Error 2
   ***   
   ***   
-- *****************************************************************************************************************
-- Disabling CUDA support for dlib.  DLIB WILL NOT USE CUDA

The BEST manual!
It's works!
Thank You very much!
Win 11.

i've added some tweaks in my build
-install cuda 12.8
-install vs_BuildTools ->install Clang
-install intel onemkl
-install OpenBLAS

• cmake .. -DDLIB_USE_MKL_WITH_TBB=1 -DDLIB_USE_BLAS=1 -DDLIB_USE_CUDA=1 -DUSE_AVX_INSTRUCTIONS=1 -DUSE_SS2_INSTRUCTIONS=1 -DUSE_SS4_INSTRUCTIONS=1 -DCUDAToolkit_ROOT=E:\Source_Codes\WhoIsShe.conda\Library\bin\

• activate conda environment

• pip uninstall dlib #uninstall previous dlib

• python setup.py install --set DLIB_USE_CUDA=1

DLIB CUDA is available
DLIB BLAS is available
DLIB LAPACK is available
DLIB AVX is available

... and now face_recognition webcam face blur works flawlessly in my GTX 970

for windows user who met the import dlib Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\Users\oceanx\AppData\Local\Programs\Python\Python310\lib\site-packages\dlib-19.24.99-py3.10-win-amd64.egg\dlib\__init__.py", line 19, in <module> from _dlib_pybind11 import * ImportError: DLL load failed while importing _dlib_pybind11: The specified module could not be found. check your __init__.py , make sure its "on"=="on".

Thank you so much! I was wondering what was going on. Also make sure for anyone getting an error for not being able to find specific header files to ensure that your file paths are easily readable by C++ compilers. For example: If i have a apostrophe in my file path ex. C:\Go'Up, dlib will say it cannot find some header files when compiling for CUDA. But if i have ex. C:Go_Up, the problem is solves