NVIDIA Tesla T4 benchmark (hashcat 6.2.3)

gistfile1.txt

Testing Nvidia Tesla T4 with hashcat under Centos Linux 7

Actually, the server has 2 tesla's installed, and first one is occupied with the task, 
so we testing and showing info on the second tesla. 

linux:
```
$ cat /etc/centos-release
CentOS Linux release 7.9.2009 (Core)
$ uname -a
Linux labserver1 3.10.0-1160.36.2.el7.x86_64 #1 SMP Wed Jul 21 11:57:15 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
```

drivers:
```
$ rpm -qa | egrep -i "cuda|nvidia"
cuda-nvvp-11-4-11.4.100-1.x86_64
cuda-command-line-tools-11-4-11.4.1-1.x86_64
nvidia-driver-latest-dkms-NVML-470.57.02-1.el7.x86_64
nvidia-persistenced-latest-dkms-470.57.02-1.el7.x86_64
nvidia-driver-latest-dkms-libs-470.57.02-1.el7.x86_64
nvidia-container-toolkit-1.5.1-2.x86_64
cuda-libraries-11-4-11.4.1-1.x86_64
cuda-nvdisasm-11-4-11.4.100-1.x86_64
cuda-cudart-devel-11-4-11.4.108-1.x86_64
cuda-nvrtc-devel-11-4-11.4.100-1.x86_64
cuda-cupti-11-4-11.4.100-1.x86_64
cuda-nsight-systems-11-4-11.4.1-1.x86_64
cuda-nvprune-11-4-11.4.100-1.x86_64
yum-plugin-nvidia-0.5-1.el7.noarch
cuda-demo-suite-11-4-11.4.100-1.x86_64
cuda-toolkit-11-config-common-11.4.108-1.noarch
cuda-toolkit-config-common-11.4.108-1.noarch
cuda-cudart-11-4-11.4.108-1.x86_64
cuda-nvrtc-11-4-11.4.100-1.x86_64
cuda-cccl-11-4-11.4.43-1.x86_64
cuda-nvml-devel-11-4-11.4.43-1.x86_64
cuda-documentation-11-4-11.4.108-1.x86_64
cuda-nsight-compute-11-4-11.4.1-1.x86_64
cuda-nsight-11-4-11.4.100-1.x86_64
cuda-memcheck-11-4-11.4.100-1.x86_64
cuda-tools-11-4-11.4.1-1.x86_64
kmod-nvidia-latest-dkms-470.57.02-1.el7.x86_64
nvidia-xconfig-latest-dkms-470.57.02-1.el7.x86_64
nvidia-driver-latest-dkms-NvFBCOpenGL-470.57.02-1.el7.x86_64
nvidia-driver-latest-dkms-cuda-470.57.02-1.el7.x86_64
nvidia-driver-latest-dkms-470.57.02-1.el7.x86_64
cuda-runtime-11-4-11.4.1-1.x86_64
cuda-11.4.1-1.x86_64
nvidia-libXNVCtrl-470.57.02-1.el7.x86_64
nvidia-settings-470.57.02-1.el7.x86_64
cuda-license-7-5-7.5-18.x86_64
cuda-core-7-5-7.5-18.x86_64
libnvidia-container-tools-1.4.0-1.x86_64
nvidia-container-runtime-3.5.0-1.x86_64
cuda-driver-devel-11-4-11.4.108-1.x86_64
cuda-nvcc-11-4-11.4.100-1.x86_64
cuda-cuxxfilt-11-4-11.4.100-1.x86_64
cuda-cuobjdump-11-4-11.4.43-1.x86_64
cuda-sanitizer-11-4-11.4.108-1.x86_64
cuda-nvtx-11-4-11.4.100-1.x86_64
cuda-compiler-11-4-11.4.1-1.x86_64
cuda-gdb-11-4-11.4.100-1.x86_64
cuda-visual-tools-11-4-11.4.1-1.x86_64
cuda-toolkit-11-4-11.4.1-1.x86_64
nvidia-modprobe-latest-dkms-470.57.02-1.el7.x86_64
nvidia-driver-latest-dkms-devel-470.57.02-1.el7.x86_64
nvidia-driver-latest-dkms-cuda-libs-470.57.02-1.el7.x86_64
cuda-11-4-11.4.1-1.x86_64
nvidia-libXNVCtrl-devel-470.57.02-1.el7.x86_64
cuda-drivers-470.57.02-1.x86_64
cuda-misc-headers-7-5-7.5-18.x86_64
libnvidia-container1-1.4.0-1.x86_64
nvidia-docker2-2.6.0-1.noarch
cuda-toolkit-11-4-config-common-11.4.108-1.noarch
cuda-nvprof-11-4-11.4.100-1.x86_64
cuda-libraries-devel-11-4-11.4.1-1.x86_64
cuda-samples-11-4-11.4.100-1.x86_64
```

nvidia yum repo:
```
$ cat /etc/yum.repos.d/cuda-rhel7.repo
[cuda-rhel7-x86_64]
name=cuda-rhel7-x86_64
baseurl=https://developer.download.nvidia.com/compute/cuda/repos/rhel7/x86_64
enabled=1
gpgcheck=1
gpgkey=https://developer.download.nvidia.com/compute/cuda/repos/rhel7/x86_64/7fa2af80.pub
```

nvidia-smi:
```
$ nvidia-smi -i 1
Wed Aug 18 18:57:04 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.57.02    Driver Version: 470.57.02    CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   1  Tesla T4            Off  | 00000000:87:00.0 Off |                    0 |
| N/A   40C    P8     9W /  70W |      3MiB / 15109MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
```
hashcat backend info:
```
$ ./hashcat.bin -I
hashcat (v6.2.3) starting in backend information mode

CUDA Info:
==========

CUDA.Version.: 11.4

Backend Device ID #1 (Alias: #3)
  Name...........: Tesla T4
  Processor(s)...: 40
  Clock..........: 1590
  Memory.Total...: 15109 MB
  Memory.Free....: 13352 MB
  PCI.Addr.BDFe..: 0000:86:00.0

Backend Device ID #2 (Alias: #4)
  Name...........: Tesla T4
  Processor(s)...: 40
  Clock..........: 1590
  Memory.Total...: 15109 MB
  Memory.Free....: 15009 MB
  PCI.Addr.BDFe..: 0000:87:00.0

OpenCL Info:
============

OpenCL Platform ID #1
  Vendor..: NVIDIA Corporation
  Name....: NVIDIA CUDA
  Version.: OpenCL 3.0 CUDA 11.4.94

  Backend Device ID #3 (Alias: #1)
    Type...........: GPU
    Vendor.ID......: 32
    Vendor.........: NVIDIA Corporation
    Name...........: Tesla T4
    Version........: OpenCL 3.0 CUDA
    Processor(s)...: 40
    Clock..........: 1590
    Memory.Total...: 15109 MB (limited to 3777 MB allocatable in one block)
    Memory.Free....: 13312 MB
    OpenCL.Version.: OpenCL C 1.2
    Driver.Version.: 470.57.02
    PCI.Addr.BDF...: 86:00.0

  Backend Device ID #4 (Alias: #2)
    Type...........: GPU
    Vendor.ID......: 32
    Vendor.........: NVIDIA Corporation
    Name...........: Tesla T4
    Version........: OpenCL 3.0 CUDA
    Processor(s)...: 40
    Clock..........: 1590
    Memory.Total...: 15109 MB (limited to 3777 MB allocatable in one block)
    Memory.Free....: 14976 MB
    OpenCL.Version.: OpenCL C 1.2
    Driver.Version.: 470.57.02
    PCI.Addr.BDF...: 87:00.0
```

benchmark:
```
$ ./hashcat.bin -b -d 2
hashcat (v6.2.3) starting in benchmark mode

Benchmarking uses hand-optimized kernel code by default.
You can use it in your cracking session by setting the -O option.
Note: Using optimized kernel code limits the maximum supported password length.
To disable the optimized kernel code in benchmark mode, use the -w option.

nvmlDeviceGetFanSpeed(): Not Supported

CUDA API (CUDA 11.4)
====================
* Device #1: Tesla T4, skipped
* Device #2: Tesla T4, 15009/15109 MB, 40MCU

OpenCL API (OpenCL 3.0 CUDA 11.4.94) - Platform #1 [NVIDIA Corporation]
=======================================================================
* Device #3: Tesla T4, skipped
* Device #4: Tesla T4, skipped

Benchmark relevant options:
===========================
* --backend-devices=2
* --optimized-kernel-enable

Hashmode: 0 - MD5

Speed.#2.........: 22782.3 MH/s (58.80ms) @ Accel:64 Loops:512 Thr:1024 Vec:1

Hashmode: 100 - SHA1

Speed.#2.........:  7818.3 MH/s (85.73ms) @ Accel:32 Loops:512 Thr:1024 Vec:1

Hashmode: 1400 - SHA2-256

Speed.#2.........:  3336.3 MH/s (50.18ms) @ Accel:8 Loops:512 Thr:1024 Vec:1

Hashmode: 1700 - SHA2-512

Speed.#2.........:  1063.3 MH/s (78.79ms) @ Accel:8 Loops:256 Thr:1024 Vec:1

Hashmode: 22000 - WPA-PBKDF2-PMKID+EAPOL (Iterations: 4095)

Speed.#2.........:   376.6 kH/s (54.12ms) @ Accel:8 Loops:256 Thr:1024 Vec:1

Hashmode: 1000 - NTLM

Speed.#2.........: 38791.2 MH/s (69.09ms) @ Accel:64 Loops:1024 Thr:1024 Vec:1

Hashmode: 3000 - LM

Speed.#2.........: 22306.6 MH/s (59.15ms) @ Accel:512 Loops:1024 Thr:64 Vec:1

Hashmode: 5500 - NetNTLMv1 / NetNTLMv1+ESS

Speed.#2.........: 23898.9 MH/s (56.00ms) @ Accel:32 Loops:1024 Thr:1024 Vec:1

Hashmode: 5600 - NetNTLMv2

Speed.#2.........:  1639.9 MH/s (51.05ms) @ Accel:16 Loops:128 Thr:1024 Vec:1

Hashmode: 1500 - descrypt, DES (Unix), Traditional DES

Speed.#2.........:   916.9 MH/s (91.29ms) @ Accel:32 Loops:1024 Thr:64 Vec:1

Hashmode: 500 - md5crypt, MD5 (Unix), Cisco-IOS $1$ (MD5) (Iterations: 1000)

Speed.#2.........: 10691.5 kH/s (58.41ms) @ Accel:32 Loops:500 Thr:1024 Vec:1

Hashmode: 3200 - bcrypt $2*$, Blowfish (Unix) (Iterations: 32)

Speed.#2.........:    28343 H/s (88.12ms) @ Accel:8 Loops:16 Thr:16 Vec:1

Hashmode: 1800 - sha512crypt $6$, SHA512 (Unix) (Iterations: 5000)

Speed.#2.........:   122.6 kH/s (66.38ms) @ Accel:8 Loops:128 Thr:1024 Vec:1

Hashmode: 7500 - Kerberos 5, etype 23, AS-REQ Pre-Auth

Speed.#2.........:   446.0 MH/s (93.93ms) @ Accel:32 Loops:1024 Thr:32 Vec:1

Hashmode: 13100 - Kerberos 5, etype 23, TGS-REP

Speed.#2.........:   435.4 MH/s (96.23ms) @ Accel:512 Loops:64 Thr:32 Vec:1

Hashmode: 15300 - DPAPI masterkey file v1 (Iterations: 23999)

Speed.#2.........:    62389 H/s (55.91ms) @ Accel:8 Loops:256 Thr:1024 Vec:1

Hashmode: 15900 - DPAPI masterkey file v2 (Iterations: 12899)

Speed.#2.........:    36279 H/s (89.48ms) @ Accel:4 Loops:256 Thr:1024 Vec:1

Hashmode: 7100 - macOS v10.8+ (PBKDF2-SHA512) (Iterations: 1023)

Speed.#2.........:   445.0 kH/s (85.74ms) @ Accel:16 Loops:63 Thr:1024 Vec:1

Hashmode: 11600 - 7-Zip (Iterations: 16384)

Speed.#2.........:   342.5 kH/s (58.21ms) @ Accel:2 Loops:4096 Thr:1024 Vec:1

Hashmode: 12500 - RAR3-hp (Iterations: 262144)

Speed.#2.........:    38660 H/s (65.97ms) @ Accel:8 Loops:16384 Thr:128 Vec:1

Hashmode: 13000 - RAR5 (Iterations: 32799)

Speed.#2.........:    34727 H/s (73.37ms) @ Accel:16 Loops:128 Thr:1024 Vec:1

Hashmode: 6211 - TrueCrypt RIPEMD160 + XTS 512 bit (Iterations: 1999)

Speed.#2.........:   268.4 kH/s (70.94ms) @ Accel:16 Loops:64 Thr:1024 Vec:1

Hashmode: 13400 - KeePass 1 (AES/Twofish) and KeePass 2 (AES) (Iterations: 24569)

Speed.#2.........:    26979 H/s (252.98ms) @ Accel:4 Loops:1024 Thr:1024 Vec:1

Hashmode: 6800 - LastPass + LastPass sniffed (Iterations: 499)

Speed.#2.........:  2263.3 kH/s (46.43ms) @ Accel:8 Loops:249 Thr:1024 Vec:1

Hashmode: 11300 - Bitcoin/Litecoin wallet.dat (Iterations: 200459)

Speed.#2.........:     4765 H/s (87.66ms) @ Accel:2 Loops:1024 Thr:1024 Vec:1

Started: Wed Aug 18 19:05:21 2021
Stopped: Wed Aug 18 19:12:28 2021
```

PS: see as well https://gist.github.com/Chick3nman/bb22b28ec4ddec0cb5f59df97c994db4