gemm_ops_gpu_5_warmup_5_runs.md

Runtime Features

0. BLAS_APPLE : ✖ BLAS_APPLE
1. BLAS_ATLAS : ✖ BLAS_ATLAS
2. BLAS_MKL : ✖ BLAS_MKL
3. BLAS_OPEN : ✔ BLAS_OPEN
4. CAFFE : ✖ CAFFE
5. CPU_AVX : ✔ CPU_AVX
6. CPU_AVX2 : ✖ CPU_AVX2
7. CPU_SSE : ✔ CPU_SSE
8. CPU_SSE2 : ✔ CPU_SSE2
9. CPU_SSE3 : ✔ CPU_SSE3
10. CPU_SSE4A : ✖ CPU_SSE4A
11. CPU_SSE4_1 : ✔ CPU_SSE4_1
12. CPU_SSE4_2 : ✔ CPU_SSE4_2
13. CUDA : ✔ CUDA
14. CUDA_RTC : ✖ CUDA_RTC
15. CUDNN : ✔ CUDNN
16. CXX14 : ✖ CXX14
17. DEBUG : ✖ DEBUG
18. DIST_KVSTORE : ✖ DIST_KVSTORE
19. F16C : ✔ F16C
20. INT64_TENSOR_SIZE : ✖ INT64_TENSOR_SIZE
21. JEMALLOC : ✖ JEMALLOC
22. LAPACK : ✔ LAPACK
23. MKLDNN : ✔ MKLDNN
24. NCCL : ✖ NCCL
25. OPENCV : ✖ OPENCV
26. OPENMP : ✔ OPENMP
27. PROFILER : ✖ PROFILER
28. SIGNAL_HANDLER : ✖ SIGNAL_HANDLER
29. SSE : ✖ SSE
30. TENSORRT : ✖ TENSORRT
31. TVM_OP : ✖ TVM_OP

Benchmark Results

Operator	Avg Forward Time (ms)	Avg. Backward Time (ms)	Max Mem Usage (Storage) (Bytes)	Inputs
batch_dot	28.8235	---	67108.8672	{'lhs': (32, 1024, 1024), 'rhs': (32, 1024, 1024)}
batch_dot	2.749	---	64000.0	{'lhs': (32, 1000, 10), 'rhs': (32, 1000, 10), 'transpose_b': True}
batch_dot	0.4239	---	6.4	{'lhs': (32, 1000, 1), 'rhs': (32, 100, 1000), 'transpose_a': True, 'transpose_b': True}
dot	1.331	3.1084	2097.1521	{'lhs': (1024, 1024), 'rhs': (1024, 1024)}
dot	0.2314	0.465	2000.0	{'lhs': (1000, 10), 'rhs': (1000, 10), 'transpose_b': True}
dot	0.1888	0.094	0.2	{'lhs': (1000, 1), 'rhs': (100, 1000), 'transpose_a': True, 'transpose_b': True}