Skip to content

Instantly share code, notes, and snippets.

@anonrig
Last active December 19, 2022 18:24
Show Gist options
  • Save anonrig/4428990335711e90f698638f1480ae16 to your computer and use it in GitHub Desktop.
Save anonrig/4428990335711e90f698638f1480ae16 to your computer and use it in GitHub Desktop.
➜  node git:(deps/simdutf) ✗ node-benchmark-compare decoder.csv
                                                                                                         confidence improvement accuracy (*)    (**)   (***)
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='iso-8859-3'               ***     -8.51 %       ±3.19%  ±4.26%  ±5.56%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='latin1'                   ***     -8.83 %       ±2.68%  ±3.57%  ±4.65%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='utf-8'                    ***    -25.31 %       ±5.46%  ±7.31%  ±9.60%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='iso-8859-3'               ***     -9.37 %       ±2.33%  ±3.10%  ±4.03%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='latin1'                   ***    -10.20 %       ±2.61%  ±3.48%  ±4.53%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='utf-8'                    ***    -29.48 %       ±2.77%  ±3.69%  ±4.81%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='iso-8859-3'               ***     -8.74 %       ±3.74%  ±5.00%  ±6.55%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='latin1'                   ***    -10.02 %       ±2.16%  ±2.88%  ±3.76%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='utf-8'                    ***    128.57 %       ±7.03%  ±9.42% ±12.39%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='iso-8859-3'               ***     -8.43 %       ±2.96%  ±3.95%  ±5.15%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='latin1'                   ***     -9.35 %       ±4.78%  ±6.41%  ±8.43%
util/text-decoder.js type='ArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='utf-8'                    ***    127.18 %       ±9.67% ±12.90% ±16.87%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                   *      4.43 %       ±3.91%  ±5.20%  ±6.78%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='latin1'                              0.99 %       ±5.86%  ±7.82% ±10.23%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='utf-8'                       **     -9.40 %       ±6.60%  ±8.79% ±11.44%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='iso-8859-3'                 ***      8.09 %       ±4.09%  ±5.46%  ±7.15%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='latin1'                              0.60 %       ±3.46%  ±4.61%  ±6.00%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='utf-8'                      ***     -7.76 %       ±3.73%  ±4.97%  ±6.48%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='iso-8859-3'                  **      9.17 %       ±6.61%  ±8.87% ±11.71%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='latin1'                              3.84 %       ±3.86%  ±5.13%  ±6.68%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='utf-8'                      ***    137.90 %       ±6.31%  ±8.41% ±10.97%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='iso-8859-3'                         -1.01 %       ±5.82%  ±7.76% ±10.15%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='latin1'                              1.33 %       ±3.18%  ±4.23%  ±5.51%
util/text-decoder.js type='ArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='utf-8'                      ***    133.89 %       ±5.51%  ±7.33%  ±9.55%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                       0.66 %       ±2.45%  ±3.27%  ±4.25%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='latin1'                          -0.99 %       ±1.84%  ±2.45%  ±3.19%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='utf-8'                           -2.42 %       ±3.90%  ±5.21%  ±6.82%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='iso-8859-3'                      -0.74 %       ±1.82%  ±2.42%  ±3.15%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='latin1'                          -1.61 %       ±1.66%  ±2.21%  ±2.90%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='utf-8'                   ***     -4.62 %       ±2.27%  ±3.03%  ±3.94%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='iso-8859-3'                       0.37 %       ±1.77%  ±2.36%  ±3.07%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='latin1'                          -0.33 %       ±1.96%  ±2.60%  ±3.39%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='utf-8'                   ***    273.54 %       ±5.53%  ±7.44%  ±9.83%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='iso-8859-3'                       0.04 %       ±1.62%  ±2.15%  ±2.80%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='latin1'                    *     -2.63 %       ±2.12%  ±2.84%  ±3.72%
util/text-decoder.js type='ArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='utf-8'                   ***    276.85 %       ±5.61%  ±7.53%  ±9.91%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                     **     -5.99 %       ±4.31%  ±5.75%  ±7.53%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='latin1'                        ***    -10.05 %       ±2.48%  ±3.30%  ±4.29%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='utf-8'                         ***     -9.96 %       ±5.17%  ±6.88%  ±8.96%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='iso-8859-3'                    ***     -9.32 %       ±4.49%  ±5.97%  ±7.77%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='latin1'                        ***    -11.56 %       ±2.82%  ±3.77%  ±4.92%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='utf-8'                         ***    -10.27 %       ±5.16%  ±6.88%  ±8.99%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='iso-8859-3'                    ***    -25.16 %       ±5.27%  ±7.05%  ±9.27%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='latin1'                        ***    -10.45 %       ±2.20%  ±2.94%  ±3.83%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='utf-8'                         ***     37.74 %       ±4.33%  ±5.78%  ±7.57%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='iso-8859-3'                    ***    -29.59 %       ±6.07%  ±8.08% ±10.51%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='latin1'                        ***    -12.76 %       ±6.69%  ±8.96% ±11.78%
util/text-decoder.js type='Buffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='utf-8'                         ***     45.32 %       ±3.90%  ±5.18%  ±6.75%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                               1.38 %       ±3.24%  ±4.31%  ±5.61%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='latin1'                                   2.55 %       ±4.18%  ±5.56%  ±7.23%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='utf-8'                           ***     -6.93 %       ±2.99%  ±3.99%  ±5.19%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='iso-8859-3'                        *      5.08 %       ±4.87%  ±6.49%  ±8.46%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='latin1'                                   2.85 %       ±5.04%  ±6.72%  ±8.76%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='utf-8'                           ***     -7.68 %       ±3.73%  ±4.98%  ±6.50%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='iso-8859-3'                               4.32 %       ±5.34%  ±7.10%  ±9.24%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='latin1'                           **      5.32 %       ±3.28%  ±4.38%  ±5.72%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='utf-8'                           ***    129.39 %       ±6.91%  ±9.22% ±12.04%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='iso-8859-3'                        *      4.33 %       ±3.79%  ±5.05%  ±6.59%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='latin1'                            *      4.91 %       ±4.48%  ±5.98%  ±7.83%
util/text-decoder.js type='Buffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='utf-8'                           ***    131.22 %       ±8.72% ±11.63% ±15.19%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                           -0.46 %       ±1.53%  ±2.04%  ±2.65%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='latin1'                                0.10 %       ±1.91%  ±2.54%  ±3.31%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='utf-8'                                -1.77 %       ±3.17%  ±4.23%  ±5.52%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='iso-8859-3'                           -0.28 %       ±2.34%  ±3.12%  ±4.06%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='latin1'                         *     -1.79 %       ±1.67%  ±2.22%  ±2.91%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='utf-8'                         **     -4.62 %       ±2.86%  ±3.83%  ±5.03%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='iso-8859-3'                            1.36 %       ±2.56%  ±3.42%  ±4.47%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='latin1'                         *     -1.57 %       ±1.39%  ±1.85%  ±2.42%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='utf-8'                        ***    267.70 %       ±6.94%  ±9.34% ±12.38%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='iso-8859-3'                            0.22 %       ±1.56%  ±2.08%  ±2.71%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='latin1'                               -1.51 %       ±2.19%  ±2.91%  ±3.81%
util/text-decoder.js type='Buffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='utf-8'                        ***    275.14 %       ±6.66%  ±8.94% ±11.80%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='iso-8859-3'         ***     -7.96 %       ±2.40%  ±3.19%  ±4.15%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='latin1'             ***     -9.33 %       ±2.53%  ±3.37%  ±4.39%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=0 encoding='utf-8'              ***    -27.26 %       ±3.22%  ±4.29%  ±5.59%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='iso-8859-3'         ***     -7.18 %       ±2.13%  ±2.83%  ±3.69%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='latin1'             ***     -8.74 %       ±2.63%  ±3.51%  ±4.56%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=0 ignoreBOM=1 encoding='utf-8'              ***    -28.88 %       ±3.06%  ±4.08%  ±5.31%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='iso-8859-3'         ***     -6.62 %       ±2.68%  ±3.57%  ±4.66%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='latin1'             ***     -8.10 %       ±2.10%  ±2.80%  ±3.64%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=0 encoding='utf-8'              ***    118.92 %       ±7.86% ±10.57% ±13.97%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='iso-8859-3'         ***    -10.92 %       ±3.00%  ±4.01%  ±5.26%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='latin1'             ***     -8.38 %       ±2.34%  ±3.12%  ±4.07%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=16384 fatal=1 ignoreBOM=1 encoding='utf-8'              ***    126.03 %       ±7.18%  ±9.62% ±12.68%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                    1.44 %       ±4.75%  ±6.32%  ±8.23%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='latin1'                **      6.45 %       ±4.07%  ±5.42%  ±7.06%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=0 encoding='utf-8'                 **     -6.15 %       ±3.55%  ±4.73%  ±6.17%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='iso-8859-3'           ***      7.36 %       ±2.99%  ±3.99%  ±5.20%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='latin1'                        0.79 %       ±3.83%  ±5.10%  ±6.63%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=0 ignoreBOM=1 encoding='utf-8'                ***    -11.88 %       ±3.80%  ±5.05%  ±6.58%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='iso-8859-3'            **      5.01 %       ±3.51%  ±4.67%  ±6.09%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='latin1'                        3.25 %       ±3.78%  ±5.03%  ±6.56%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=0 encoding='utf-8'                ***    127.32 %       ±6.20%  ±8.32% ±10.98%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='iso-8859-3'             *      7.55 %       ±5.89%  ±7.84% ±10.22%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='latin1'                        0.41 %       ±3.53%  ±4.70%  ±6.14%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=256 fatal=1 ignoreBOM=1 encoding='utf-8'                ***    137.80 %       ±4.81%  ±6.40%  ±8.32%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='iso-8859-3'                -0.23 %       ±1.86%  ±2.48%  ±3.23%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='latin1'              *     -1.74 %       ±1.51%  ±2.01%  ±2.63%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=0 encoding='utf-8'                     -2.30 %       ±4.76%  ±6.33%  ±8.25%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='iso-8859-3'                -0.03 %       ±1.64%  ±2.18%  ±2.84%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='latin1'              *     -2.01 %       ±1.93%  ±2.57%  ±3.35%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=0 ignoreBOM=1 encoding='utf-8'             ***     -3.71 %       ±2.09%  ±2.78%  ±3.63%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='iso-8859-3'                -0.10 %       ±1.67%  ±2.22%  ±2.90%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='latin1'                     0.36 %       ±1.57%  ±2.09%  ±2.72%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=0 encoding='utf-8'             ***    272.71 %       ±7.32%  ±9.84% ±13.01%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='iso-8859-3'                -1.48 %       ±1.89%  ±2.51%  ±3.27%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='latin1'                    -2.36 %       ±4.30%  ±5.74%  ±7.50%
util/text-decoder.js type='SharedArrayBuffer' n=100 len=524288 fatal=1 ignoreBOM=1 encoding='utf-8'             ***    277.95 %       ±5.15%  ±6.88%  ±9.02%

Be aware that when doing many comparisons the risk of a false-positive result increases.
In this case, there are 108 comparisons, you can thus expect the following amount of false-positive results:
  5.40 false positives, when considering a   5% risk acceptance (*, **, ***),
  1.08 false positives, when considering a   1% risk acceptance (**, ***),
  0.11 false positives, when considering a 0.1% risk acceptance (***)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment