Skip to content

Instantly share code, notes, and snippets.

@HDCharles

HDCharles/gist:5b480764f5c1e50cf5bb20f9c401e2dc

Created May 15, 2023 18:17
Show Gist options
  • Save HDCharles/5b480764f5c1e50cf5bb20f9c401e2dc to your computer and use it in GitHub Desktop.
Save HDCharles/5b480764f5c1e50cf5bb20f9c401e2dc to your computer and use it in GitHub Desktop.
Download ZIP
benchmark_q_dq.py
Raw
gistfile1.txt
shape_x q_per_tensor_int8_ms trit_q_per_tensor_int8_ms dq_per_tensor_int8_ms trit_dq_per_tensor_int8_ms trit_q_per_tensor_int8_speedup trit_dq_per_tensor_int8_speedup
-------------- ---------------------- --------------------------- ----------------------- ---------------------------- -------------------------------- ---------------------------------
(512, 512) 249.966 96.5174 25.0979 54.0861 2.58986 0.464037
(512, 2048) 258.848 98.001 24.1691 54.1419 2.64128 0.446402
(512, 16384) 666.822 149.243 73.2224 53.4983 4.46801 1.36869
(2048, 512) 260.73 98.241 24.1514 54.3473 2.65398 0.444391
(2048, 2048) 446.207 115.152 33.172 54.3126 3.87495 0.610761
(2048, 16384) 2000.32 410.987 351.739 143.27 4.86711 2.45508
(16384, 512) 666.579 149.801 72.062 53.9642 4.44977 1.33537
(16384, 2048) 2003.65 411.576 351.836 144.331 4.86824 2.4377
(16384, 16384) 14536.5 2139.19 2718.65 1051.69 6.79533 2.58504
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment