Skip to content

Instantly share code, notes, and snippets.

@underyx

underyx/gist:6042073a3e464e7a60d542169e48f6a0

Created May 7, 2020 14:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save underyx/6042073a3e464e7a60d542169e48f6a0 to your computer and use it in GitHub Desktop.
Save underyx/6042073a3e464e7a60d542169e48f6a0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
--------------------------------------------------------------------------------------------------------------------------------------- benchmark: 147 tests ---------------------------------------------------------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_version 60.4464 (1.0) 83.2446 (1.06) 65.1780 (1.0) 6.5289 (7.17) 62.6424 (1.0) 2.3067 (2.71) 2;3 15.3426 (1.0) 15 1
test_semgrep_rules_rule[python/django/best_practices/upsell_django_environ.yaml] 72.9608 (1.21) 80.4681 (1.02) 74.6973 (1.15) 1.9850 (2.18) 74.2318 (1.19) 1.2242 (1.44) 1;1 13.3874 (0.87) 12 1
test_semgrep_rules_rule[python/flask/secure-cookies/secure-cookies.yml] 72.9675 (1.21) 80.8545 (1.03) 75.3696 (1.16) 1.9040 (2.09) 75.0609 (1.20) 1.0286 (1.21) 2;1 13.2680 (0.86) 12 1
test_semgrep_rules_rule[python/deadcode/useless-assign.notyaml] 73.0042 (1.21) 79.0142 (1.00) 74.1038 (1.14) 1.6728 (1.84) 73.5150 (1.17) 1.3746 (1.62) 1;1 13.4946 (0.88) 12 1
test_semgrep_rules_rule[python/flask/app-run-param-config/app-run-param-config.yaml] 73.1223 (1.21) 80.5897 (1.02) 75.1967 (1.15) 1.9773 (2.17) 74.9036 (1.20) 1.7005 (2.00) 2;1 13.2985 (0.87) 13 1
test_semgrep_rules_rule[python/flask/hardcoded-config.yaml] 73.2196 (1.21) 80.6551 (1.02) 76.4155 (1.17) 1.9420 (2.13) 75.9971 (1.21) 1.5087 (1.77) 3;2 13.0864 (0.85) 12 1
test_semgrep_rules_rule[python/django/performance-improvements.yaml] 73.4437 (1.22) 82.9168 (1.05) 75.8094 (1.16) 2.8498 (3.13) 74.5658 (1.19) 3.1314 (3.68) 2;1 13.1910 (0.86) 13 1
test_semgrep_rules_rule[go/gosec/pprof/pprof.yaml] 73.4594 (1.22) 79.0001 (1.00) 75.2146 (1.15) 1.5040 (1.65) 74.5975 (1.19) 2.0145 (2.37) 3;0 13.2953 (0.87) 14 1
test_semgrep_rules_rule[go/gosec/bad_crypto/use_of_weak_crypto.yaml] 73.9040 (1.22) 160.8636 (2.04) 107.3654 (1.65) 28.5200 (31.33) 112.0665 (1.79) 38.7558 (45.58) 5;0 9.3140 (0.61) 10 1
test_semgrep_rules_rule[go/gosec/html-template/unescaped-data-in-js.yaml] 74.2704 (1.23) 100.6496 (1.28) 82.1449 (1.26) 8.8733 (9.75) 77.5350 (1.24) 9.3461 (10.99) 3;1 12.1736 (0.79) 13 1
test_semgrep_rules_rule[c/goto-fail.yaml] 74.3654 (1.23) 119.7425 (1.52) 84.5216 (1.30) 16.4337 (18.05) 75.7297 (1.21) 12.3968 (14.58) 1;1 11.8313 (0.77) 7 1
test_semgrep_rules_rule[go/gosec/overflow/overflow.yaml] 74.7307 (1.24) 78.8541 (1.0) 76.1050 (1.17) 1.2504 (1.37) 75.4946 (1.21) 1.6852 (1.98) 4;0 13.1397 (0.86) 14 1
test_semgrep_rules_rule[python/deadcode/missing-fstring.yaml] 129.8292 (2.15) 137.5045 (1.74) 133.3981 (2.05) 3.0261 (3.32) 133.0868 (2.12) 5.3472 (6.29) 3;0 7.4964 (0.49) 7 1
test_semgrep_rules_rule[python/click/echo-style.yaml] 130.4620 (2.16) 177.4601 (2.25) 147.2224 (2.26) 15.5042 (17.03) 145.3879 (2.32) 19.6873 (23.15) 3;0 6.7924 (0.44) 8 1
test_semgrep_rules_rule[python/deadcode/useless-literal.yaml] 131.0979 (2.17) 137.8716 (1.75) 134.2622 (2.06) 2.3092 (2.54) 134.8174 (2.15) 3.1476 (3.70) 3;0 7.4481 (0.49) 8 1
test_semgrep_rules_rule[java/security/audit/spring-csrf-disabled.yaml] 131.1862 (2.17) 154.1295 (1.95) 138.2441 (2.12) 7.3201 (8.04) 136.9553 (2.19) 6.9665 (8.19) 1;1 7.2336 (0.47) 8 1
test_semgrep_rules_rule[go/gosec/bad_imports/insecure_ssh.yaml] 132.0927 (2.19) 150.8437 (1.91) 138.9291 (2.13) 6.3016 (6.92) 137.8134 (2.20) 7.0518 (8.29) 2;0 7.1979 (0.47) 7 1
test_semgrep_rules_rule[python/django/security/audit/custom-expression-as-sql.yaml] 132.0929 (2.19) 141.4126 (1.79) 137.8201 (2.11) 2.9976 (3.29) 138.7227 (2.21) 3.4312 (4.04) 2;0 7.2558 (0.47) 8 1
test_semgrep_rules_rule[java/security/crypto/no-null-cipher.yaml] 132.6534 (2.19) 151.7597 (1.92) 138.9802 (2.13) 5.8119 (6.38) 138.1333 (2.21) 4.7583 (5.60) 2;1 7.1953 (0.47) 8 1
test_semgrep_rules_rule[python/logging/listeneval.yaml] 133.5537 (2.21) 140.7604 (1.79) 135.8458 (2.08) 2.6841 (2.95) 134.8958 (2.15) 3.0286 (3.56) 2;0 7.3613 (0.48) 8 1
test_semgrep_rules_rule[python/tempfile/mktemp.yaml] 133.5582 (2.21) 141.3078 (1.79) 137.3058 (2.11) 2.4499 (2.69) 137.2332 (2.19) 2.5667 (3.02) 2;0 7.2830 (0.47) 7 1
test_semgrep_rules_rule[python/smells/exit.yaml] 133.8600 (2.21) 139.4141 (1.77) 136.3936 (2.09) 1.7285 (1.90) 136.0367 (2.17) 1.6591 (1.95) 2;0 7.3317 (0.48) 7 1
test_semgrep_rules_rule[python/bokeh/deprecated_apis.yaml] 133.9268 (2.22) 148.2929 (1.88) 138.3764 (2.12) 5.0324 (5.53) 136.5406 (2.18) 5.7483 (6.76) 1;0 7.2267 (0.47) 7 1
test_semgrep_rules_rule[python/socket/bind.yaml] 135.0772 (2.23) 144.7949 (1.84) 139.7204 (2.14) 2.8449 (3.12) 139.6149 (2.23) 1.1642 (1.37) 2;2 7.1572 (0.47) 7 1
test_semgrep_rules_rule[python/wtf-python/is-not-is-not.yml] 135.1136 (2.24) 142.2406 (1.80) 138.4340 (2.12) 2.9973 (3.29) 137.3166 (2.19) 5.7571 (6.77) 5;0 7.2237 (0.47) 8 1
test_semgrep_rules_rule[python/django/security/audit/raw-query.yaml] 135.1867 (2.24) 138.2444 (1.75) 136.7170 (2.10) 1.2379 (1.36) 137.0756 (2.19) 2.2607 (2.66) 4;0 7.3144 (0.48) 7 1
test_semgrep_rules_rule[python/flask/same-handler-name.yaml] 135.7155 (2.25) 142.9429 (1.81) 137.6303 (2.11) 2.4905 (2.74) 136.9791 (2.19) 1.8019 (2.12) 1;1 7.2658 (0.47) 7 1
test_semgrep_rules_rule[python/flask/secure-static-file-serve.yaml] 136.5893 (2.26) 173.8961 (2.21) 146.7089 (2.25) 12.7478 (14.00) 141.2325 (2.25) 7.9991 (9.41) 1;1 6.8162 (0.44) 7 1
test_semgrep_rules_rule[python/exceptions/exceptions.yaml] 136.7968 (2.26) 143.1500 (1.82) 139.8578 (2.15) 2.5605 (2.81) 138.4050 (2.21) 4.3812 (5.15) 3;0 7.1501 (0.47) 7 1
test_semgrep_rules_rule[python/django/security/injection/mass-assignment.yaml] 136.8871 (2.26) 143.4096 (1.82) 139.0137 (2.13) 2.4636 (2.71) 138.0958 (2.20) 3.5344 (4.16) 1;0 7.1935 (0.47) 7 1
test_semgrep_rules_rule[go/gosec/tls_ssl_blacklist/ssl.yaml] 136.9876 (2.27) 156.9076 (1.99) 149.2173 (2.29) 6.0179 (6.61) 150.5911 (2.40) 2.1706 (2.55) 2;2 6.7016 (0.44) 7 1
test_semgrep_rules_rule[python/smells/missing-hash-with-eq.yaml] 137.5417 (2.28) 143.3622 (1.82) 140.5672 (2.16) 1.9882 (2.18) 140.2248 (2.24) 2.7692 (3.26) 2;0 7.1140 (0.46) 7 1
test_semgrep_rules_rule[python/deadcode/useless-ifelse.yaml] 137.5758 (2.28) 146.1520 (1.85) 140.4516 (2.15) 2.7603 (3.03) 140.3783 (2.24) 1.6979 (2.00) 2;1 7.1199 (0.46) 7 1
test_semgrep_rules_rule[python/deadcode/baseclass-attribute-override.yaml] 137.7055 (2.28) 253.6064 (3.22) 159.4733 (2.45) 39.5299 (43.42) 141.8954 (2.27) 22.2026 (26.11) 1;1 6.2706 (0.41) 8 1
test_semgrep_rules_rule[go/gosec/bad_crypto/use_of_weak_rsa_key.yaml] 137.8403 (2.28) 184.2653 (2.34) 154.3644 (2.37) 15.7641 (17.31) 146.6584 (2.34) 16.9717 (19.96) 2;0 6.4782 (0.42) 7 1
test_semgrep_rules_rule[python/django/security/audit/csrf-exempt.yaml] 138.0281 (2.28) 142.9858 (1.81) 140.0738 (2.15) 1.5284 (1.68) 139.8011 (2.23) 1.2080 (1.42) 2;1 7.1391 (0.47) 7 1
test_semgrep_rules_rule[java/security/crypto/no-static-initialization-vector.yaml] 138.9238 (2.30) 143.6551 (1.82) 141.4952 (2.17) 1.7846 (1.96) 141.2516 (2.25) 3.0716 (3.61) 3;0 7.0674 (0.46) 7 1
test_semgrep_rules_rule[go/antipatterns/channel-guarded-with-mutex.yaml] 139.5524 (2.31) 173.0622 (2.19) 147.4486 (2.26) 11.5487 (12.68) 144.2212 (2.30) 4.7796 (5.62) 1;1 6.7820 (0.44) 7 1
test_semgrep_rules_rule[java/security/audit/insecure-hostname-verifier.yaml] 139.6682 (2.31) 143.2717 (1.82) 141.1321 (2.17) 1.3843 (1.52) 140.7321 (2.25) 2.4670 (2.90) 3;0 7.0856 (0.46) 8 1
test_semgrep_rules_rule[go/net/use-tls.yaml] 139.6956 (2.31) 200.2056 (2.54) 171.7486 (2.64) 26.5709 (29.18) 179.3862 (2.86) 51.6458 (60.74) 3;0 5.8225 (0.38) 6 1
test_semgrep_rules_rule[go/antipatterns/hidden-goroutine.yaml] 139.6979 (2.31) 189.6256 (2.40) 170.1539 (2.61) 19.4033 (21.31) 173.3830 (2.77) 32.4192 (38.13) 2;0 5.8770 (0.38) 6 1
test_semgrep_rules_rule[python/deadcode/useless-assign-keyed.yaml] 140.2336 (2.32) 176.4787 (2.24) 153.7173 (2.36) 13.8162 (15.18) 146.0542 (2.33) 21.2743 (25.02) 2;0 6.5054 (0.42) 7 1
test_semgrep_rules_rule[python/flask/use-jsonify/use-jsonify.yaml] 140.7363 (2.33) 151.5492 (1.92) 147.4197 (2.26) 3.5524 (3.90) 148.6370 (2.37) 3.7358 (4.39) 2;0 6.7834 (0.44) 7 1
test_semgrep_rules_rule[go/gosec/bad_imports/math_random.yaml] 140.8512 (2.33) 153.6444 (1.95) 147.5640 (2.26) 4.8291 (5.30) 148.4142 (2.37) 6.6354 (7.80) 2;0 6.7767 (0.44) 5 1
test_semgrep_rules_rule[python/compatibility/python36.yaml] 140.8934 (2.33) 150.7427 (1.91) 144.6982 (2.22) 3.2055 (3.52) 144.9501 (2.31) 2.7044 (3.18) 3;1 6.9109 (0.45) 7 1
test_semgrep_rules_rule[python/smells/dict-modify-iterating.yaml] 141.3556 (2.34) 147.0380 (1.86) 143.3262 (2.20) 2.1210 (2.33) 142.6446 (2.28) 3.1259 (3.68) 1;0 6.9771 (0.45) 7 1
test_semgrep_rules_rule[java/security/audit/spring-cookie-missing-httponly.yaml] 141.4509 (2.34) 147.1743 (1.87) 144.5230 (2.22) 2.3068 (2.53) 145.1173 (2.32) 4.3158 (5.08) 4;0 6.9193 (0.45) 7 1
test_semgrep_rules_rule[python/django/db/upsell_count.yaml] 141.4673 (2.34) 153.9166 (1.95) 145.9031 (2.24) 4.2228 (4.64) 146.4649 (2.34) 4.5013 (5.29) 2;0 6.8539 (0.45) 7 1
test_semgrep_rules_rule[python/smells/unchecked-returns.yaml] 141.7390 (2.34) 146.0432 (1.85) 143.3399 (2.20) 1.6800 (1.85) 142.6271 (2.28) 2.7172 (3.20) 1;0 6.9764 (0.45) 7 1
test_semgrep_rules_rule[python/flask/app-run-security-config/app-run-security-config.yaml] 141.9855 (2.35) 149.4443 (1.90) 144.8738 (2.22) 2.7059 (2.97) 144.9449 (2.31) 4.0784 (4.80) 2;0 6.9026 (0.45) 7 1
test_semgrep_rules_rule[python/multiprocessing/conn_recv.yaml] 142.2375 (2.35) 152.6272 (1.94) 148.0097 (2.27) 3.2765 (3.60) 148.4839 (2.37) 3.2122 (3.78) 2;0 6.7563 (0.44) 7 1
test_semgrep_rules_rule[python/sqlalchemy/delete-where.yaml] 142.3806 (2.36) 146.6169 (1.86) 144.2911 (2.21) 1.3874 (1.52) 144.6121 (2.31) 1.5755 (1.85) 2;0 6.9304 (0.45) 7 1
test_semgrep_rules_rule[go/deadcode/useless-ifelse.yaml] 142.4163 (2.36) 173.6550 (2.20) 153.0953 (2.35) 13.4087 (14.73) 149.2351 (2.38) 22.7218 (26.72) 2;0 6.5319 (0.43) 7 1
test_semgrep_rules_rule[python/django/json_response/json_response.yaml] 142.4300 (2.36) 148.8326 (1.89) 144.7838 (2.22) 2.6438 (2.90) 143.2401 (2.29) 4.5200 (5.32) 2;0 6.9069 (0.45) 7 1
test_semgrep_rules_rule[python/smells/sleep.yaml] 142.7494 (2.36) 151.2650 (1.92) 145.9237 (2.24) 3.3174 (3.64) 144.7971 (2.31) 5.0108 (5.89) 2;0 6.8529 (0.45) 7 1
test_semgrep_rules_rule[python/requests/security/no-auth-over-http.yaml] 142.7700 (2.36) 171.1929 (2.17) 149.9528 (2.30) 9.5998 (10.54) 147.5533 (2.36) 3.5874 (4.22) 1;1 6.6688 (0.43) 7 1
test_semgrep_rules_rule[python/django/security/passwords/use-none-for-password-default.yml] 143.0696 (2.37) 150.4146 (1.91) 146.2817 (2.24) 2.7522 (3.02) 145.6428 (2.32) 4.1107 (4.83) 3;0 6.8361 (0.45) 7 1
test_semgrep_rules_rule[python/django/db/model-save.yaml] 143.0859 (2.37) 148.4869 (1.88) 146.4105 (2.25) 1.8853 (2.07) 146.9854 (2.35) 2.6171 (3.08) 2;0 6.8301 (0.45) 7 1
test_semgrep_rules_rule[python/django/security/audit/query-set-extra.yaml] 143.1034 (2.37) 147.3641 (1.87) 145.3518 (2.23) 1.5695 (1.72) 145.8018 (2.33) 2.4996 (2.94) 2;0 6.8799 (0.45) 7 1
test_semgrep_rules_rule[python/deadcode/useless-comparison.yaml] 143.4608 (2.37) 150.9342 (1.91) 147.4501 (2.26) 2.5758 (2.83) 147.3059 (2.35) 3.6911 (4.34) 2;0 6.7820 (0.44) 7 1
test_semgrep_rules_rule[python/sqlalchemy/performance-improvements.yaml] 143.5078 (2.37) 157.4124 (2.00) 147.4720 (2.26) 5.3355 (5.86) 145.4103 (2.32) 5.5565 (6.54) 1;0 6.7809 (0.44) 6 1
test_semgrep_rules_rule[python/django/security/passwords/password-empty-string.yml] 143.6728 (2.38) 152.6959 (1.94) 148.0299 (2.27) 2.8365 (3.12) 147.9097 (2.36) 2.9866 (3.51) 2;0 6.7554 (0.44) 7 1
test_semgrep_rules_rule[javascript/deadcode/useless-eqeq.yaml] 144.0544 (2.38) 153.1606 (1.94) 148.7504 (2.28) 3.2655 (3.59) 147.3728 (2.35) 4.8504 (5.70) 3;0 6.7227 (0.44) 7 1
test_semgrep_rules_rule[java/security/audit/spring-cookie-missing-secure-flag.yaml] 144.1080 (2.38) 149.5619 (1.90) 146.0636 (2.24) 1.9305 (2.12) 145.8530 (2.33) 2.7573 (3.24) 4;0 6.8463 (0.45) 8 1
test_semgrep_rules_rule[python/marshal.yaml] 145.6238 (2.41) 156.4187 (1.98) 149.3173 (2.29) 3.5124 (3.86) 148.7149 (2.37) 2.9400 (3.46) 2;1 6.6971 (0.44) 7 1
test_semgrep_rules_rule[go/gosec/socket/bind_all.yaml] 145.9671 (2.41) 207.8218 (2.64) 170.4007 (2.61) 23.5272 (25.84) 164.2341 (2.62) 37.9056 (44.58) 3;0 5.8685 (0.38) 7 1
test_semgrep_rules_rule[python/django/performance/upsell_earliest_latest.yaml] 146.1042 (2.42) 153.6938 (1.95) 148.2781 (2.27) 2.5697 (2.82) 147.8046 (2.36) 2.0481 (2.41) 1;1 6.7441 (0.44) 7 1
test_semgrep_rules_rule[python/deadcode/useless-innerfunction.yaml] 146.2232 (2.42) 157.9871 (2.00) 151.1193 (2.32) 3.8551 (4.23) 150.2915 (2.40) 4.2632 (5.01) 2;0 6.6173 (0.43) 7 1
test_semgrep_rules_rule[python/django/use-onetoonefield.yml] 148.0125 (2.45) 157.7362 (2.00) 152.3092 (2.34) 3.3752 (3.71) 152.5205 (2.43) 3.8055 (4.48) 2;0 6.5656 (0.43) 6 1
test_semgrep_rules_rule[python/smells/return-in-init.yaml] 148.8121 (2.46) 154.2397 (1.96) 150.5445 (2.31) 1.7369 (1.91) 150.2777 (2.40) 0.8503 (1.0) 1;1 6.6426 (0.43) 7 1
test_semgrep_rules_rule[python/smells/list-modify-iterating.yaml] 150.2275 (2.49) 156.2888 (1.98) 153.0962 (2.35) 2.2492 (2.47) 153.0739 (2.44) 3.8324 (4.51) 3;0 6.5318 (0.43) 7 1
test_semgrep_rules_rule[python/tempfile/flush.yaml] 150.2882 (2.49) 183.5122 (2.33) 160.7336 (2.47) 11.2639 (12.37) 158.5903 (2.53) 11.3278 (13.32) 1;1 6.2215 (0.41) 7 1
test_semgrep_rules_rule[python/smells/pass-body.yaml] 150.8996 (2.50) 160.1016 (2.03) 154.2301 (2.37) 3.0261 (3.32) 153.5176 (2.45) 3.1469 (3.70) 2;1 6.4838 (0.42) 7 1
test_semgrep_rules_rule[javascript/deadcode/useless-assign.yaml] 151.1903 (2.50) 165.4674 (2.10) 156.1914 (2.40) 4.8398 (5.32) 156.2599 (2.49) 5.4927 (6.46) 2;0 6.4024 (0.42) 7 1
test_semgrep_rules_rule[python/flask/access-request-in-wrong-handler.yaml] 151.7540 (2.51) 157.3800 (2.00) 153.1575 (2.35) 1.9933 (2.19) 152.4147 (2.43) 1.7022 (2.00) 1;1 6.5292 (0.43) 7 1
test_semgrep_rules_rule[python/deadcode/return.yaml] 153.1864 (2.53) 157.3056 (1.99) 155.3645 (2.38) 1.6753 (1.84) 155.6051 (2.48) 3.0691 (3.61) 3;0 6.4365 (0.42) 7 1
test_semgrep_rules_rule[go/deadcode/useless-eqeq.yaml] 153.9931 (2.55) 192.8078 (2.45) 165.8947 (2.55) 15.8130 (17.37) 162.1053 (2.59) 17.7053 (20.82) 1;0 6.0279 (0.39) 5 1
test_semgrep_rules_rule[python/boto3/security/hardcoded-token.yaml] 155.9134 (2.58) 162.4270 (2.06) 159.1656 (2.44) 2.6039 (2.86) 159.7469 (2.55) 4.3637 (5.13) 3;0 6.2828 (0.41) 6 1
test_semgrep_rules_rule[python/django/use-decimalfield-for-money.yml] 156.6215 (2.59) 165.2835 (2.10) 159.2602 (2.44) 3.1030 (3.41) 158.0543 (2.52) 3.7607 (4.42) 1;0 6.2790 (0.41) 7 1
test_semgrep_rules_rule[javascript/smells/assigned-undefined.yaml] 157.9049 (2.61) 217.1507 (2.75) 197.1077 (3.02) 23.6304 (25.95) 204.5434 (3.27) 28.6806 (33.73) 1;0 5.0734 (0.33) 5 1
test_semgrep_rules_rule[javascript/smells/leftover_debugging.yaml] 160.3787 (2.65) 194.6586 (2.47) 168.1516 (2.58) 13.1001 (14.39) 162.9224 (2.60) 3.4717 (4.08) 1;1 5.9470 (0.39) 6 1
test_semgrep_rules_rule[java/security/audit/insecure-trust-manager.yaml] 160.4638 (2.65) 169.8854 (2.15) 165.4976 (2.54) 3.9888 (4.38) 164.1436 (2.62) 7.4033 (8.71) 3;0 6.0424 (0.39) 7 1
test_semgrep_rules_rule[python/wtf-python/is-comparison-string.yml] 160.6967 (2.66) 166.8554 (2.12) 163.1518 (2.50) 2.0966 (2.30) 162.7604 (2.60) 1.8513 (2.18) 2;1 6.1293 (0.40) 6 1
test_semgrep_rules_rule[python/django/security/passwords/unvalidated-password.yml] 161.2960 (2.67) 169.5434 (2.15) 164.1172 (2.52) 2.8936 (3.18) 163.2809 (2.61) 2.1988 (2.59) 1;1 6.0932 (0.40) 6 1
test_semgrep_rules_rule[go/jwt/jwt.yaml] 161.4877 (2.67) 204.0088 (2.59) 187.6084 (2.88) 13.9752 (15.35) 190.3514 (3.04) 14.7360 (17.33) 2;0 5.3303 (0.35) 7 1
test_semgrep_rules_rule[javascript/jwt-none-alg/jwt-none-alg.yaml] 161.5723 (2.67) 232.7910 (2.95) 203.6194 (3.12) 33.6778 (36.99) 223.0480 (3.56) 59.1418 (69.56) 1;0 4.9111 (0.32) 5 1
test_semgrep_rules_rule[python/flask/different-route-names.yaml] 161.8298 (2.68) 175.2962 (2.22) 168.6330 (2.59) 5.1761 (5.69) 168.7471 (2.69) 8.2650 (9.72) 2;0 5.9300 (0.39) 6 1
test_semgrep_rules_rule[java/security/audit/command-injection-formatted-runtime-call.yaml] 163.4499 (2.70) 187.8052 (2.38) 176.9009 (2.71) 9.1355 (10.03) 178.8946 (2.86) 14.4184 (16.96) 2;0 5.6529 (0.37) 6 1
test_semgrep_rules_rule[python/requests/best-practice/use-timeout.yaml] 165.1994 (2.73) 179.8900 (2.28) 173.2909 (2.66) 5.5974 (6.15) 173.8346 (2.78) 7.4092 (8.71) 2;0 5.7706 (0.38) 6 1
test_semgrep_rules_rule[python/django/nontext-field-must-set-null-true.yml] 166.1129 (2.75) 171.3137 (2.17) 168.9053 (2.59) 2.1394 (2.35) 168.8266 (2.70) 4.0616 (4.78) 3;0 5.9205 (0.39) 6 1
test_semgrep_rules_rule[python/flask/unsanitized_input.yaml] 168.4276 (2.79) 174.8635 (2.22) 171.1657 (2.63) 2.3816 (2.62) 170.4647 (2.72) 3.4042 (4.00) 2;0 5.8423 (0.38) 6 1
test_semgrep_rules_rule[python/flask/security/audit/secure-set-cookie.yaml] 172.1723 (2.85) 175.5899 (2.23) 173.9092 (2.67) 1.3792 (1.51) 174.2887 (2.78) 2.5037 (2.94) 3;0 5.7501 (0.37) 6 1
test_semgrep_rules_rule[python/deadcode/useless-eqeq.yaml] 175.1828 (2.90) 186.0584 (2.36) 179.6317 (2.76) 3.6683 (4.03) 178.9566 (2.86) 3.1414 (3.69) 2;1 5.5669 (0.36) 6 1
test_semgrep_rules_rule[javascript/spawn-git-clone/spawn-git-clone.yaml] 175.3018 (2.90) 237.5746 (3.01) 207.8675 (3.19) 29.5128 (32.42) 224.5181 (3.58) 51.8270 (60.95) 3;0 4.8108 (0.31) 5 1
test_semgrep_rules_rule[python/django/security/audit/secure-cookies.yml] 180.7382 (2.99) 184.4315 (2.34) 182.8223 (2.80) 1.6051 (1.76) 183.4014 (2.93) 3.0521 (3.59) 3;0 5.4698 (0.36) 6 1
test_semgrep_rules_rule[python/airflow/formatted-string-bashoperator.yaml] 181.0271 (2.99) 279.6652 (3.55) 227.4387 (3.49) 42.0215 (46.15) 240.4835 (3.84) 70.0771 (82.42) 2;0 4.3968 (0.29) 5 1
test_semgrep_rules_rule[go/gosec/tls_ssl_blacklist/tls.yaml] 181.0711 (3.00) 188.5303 (2.39) 184.2302 (2.83) 3.3372 (3.67) 182.9383 (2.92) 5.8891 (6.93) 1;0 5.4280 (0.35) 5 1
test_semgrep_rules_rule[go/gosec/html-template/unescaped-data-in-url.yaml] 182.0608 (3.01) 224.8457 (2.85) 202.3668 (3.10) 18.6710 (20.51) 204.6660 (3.27) 33.4819 (39.38) 2;0 4.9415 (0.32) 5 1
test_semgrep_rules_rule[python/django/string-field-null-checks.yml] 183.7882 (3.04) 189.9847 (2.41) 187.6656 (2.88) 2.0779 (2.28) 188.1721 (3.00) 1.0070 (1.18) 2;2 5.3286 (0.35) 6 1
test_semgrep_rules_rule[java/basic-rules.yaml] 185.5914 (3.07) 235.1598 (2.98) 211.1017 (3.24) 22.5576 (24.78) 213.4306 (3.41) 40.1781 (47.25) 2;0 4.7371 (0.31) 6 1
test_semgrep_rules_rule[python/flask/render-template-string/render-template-string.yml] 186.7200 (3.09) 193.1107 (2.45) 189.7794 (2.91) 2.8451 (3.12) 190.6197 (3.04) 5.0503 (5.94) 3;0 5.2693 (0.34) 5 1
test_semgrep_rules_rule[java/hardcoded-conditional.yaml] 186.8136 (3.09) 215.4642 (2.73) 204.5286 (3.14) 13.3412 (14.65) 211.5172 (3.38) 23.2370 (27.33) 1;0 4.8893 (0.32) 5 1
test_semgrep_rules_rule[javascript/jwt/audit/jwt-decode-without-verify.yaml] 186.9128 (3.09) 197.3143 (2.50) 190.3467 (2.92) 3.9953 (4.39) 188.4604 (3.01) 4.9413 (5.81) 1;0 5.2536 (0.34) 6 1
test_semgrep_rules_rule[python/flask/open-redirect/open-redirect.yml] 187.2955 (3.10) 198.1290 (2.51) 192.9896 (2.96) 4.3111 (4.74) 192.6286 (3.08) 6.8105 (8.01) 2;0 5.1816 (0.34) 5 1
test_semgrep_rules_rule[go/gosec/html-template/unescaped-data-in-htmlattr.yaml] 188.3376 (3.12) 207.5241 (2.63) 193.7598 (2.97) 7.0395 (7.73) 191.7372 (3.06) 4.2257 (4.97) 1;1 5.1610 (0.34) 6 1
test_semgrep_rules_rule[python/django/security/injection/user-exec.yaml] 189.7353 (3.14) 195.3900 (2.48) 192.7940 (2.96) 2.3804 (2.61) 192.1953 (3.07) 3.9345 (4.63) 2;0 5.1869 (0.34) 5 1
test_semgrep_rules_rule[python/django/security/injection/user-eval.yaml] 191.0170 (3.16) 242.4963 (3.08) 203.4837 (3.12) 21.9123 (24.07) 194.9624 (3.11) 15.8953 (18.69) 1;1 4.9144 (0.32) 5 1
test_semgrep_rules_rule[go/gosec/html-template/formatted-template-string.yaml] 199.9037 (3.31) 319.2860 (4.05) 238.9808 (3.67) 52.5150 (57.68) 206.6025 (3.30) 76.8966 (90.44) 1;0 4.1844 (0.27) 5 1
test_semgrep_rules_rule[python/django/django-2_0-compat.yaml] 201.3315 (3.33) 224.6557 (2.85) 208.3706 (3.20) 9.5706 (10.51) 206.2912 (3.29) 10.7638 (12.66) 1;0 4.7991 (0.31) 5 1
test_semgrep_rules_rule[python/flask/deprecated-apis.yaml] 202.1067 (3.34) 205.0417 (2.60) 204.1809 (3.13) 1.2021 (1.32) 204.5578 (3.27) 1.2585 (1.48) 1;0 4.8976 (0.32) 5 1
test_semgrep_rules_rule[go/gorilla/handler-attribute-read-from-multiple-sources.yml] 215.7516 (3.57) 237.7928 (3.02) 226.5753 (3.48) 8.7261 (9.58) 228.9803 (3.66) 13.1508 (15.47) 2;0 4.4135 (0.29) 5 1
test_semgrep_rules_rule[python/smells/manual-collections-create.yaml] 215.8567 (3.57) 221.5605 (2.81) 218.5791 (3.35) 2.0784 (2.28) 218.3989 (3.49) 2.4561 (2.89) 2;0 4.5750 (0.30) 5 1
test_semgrep_rules_rule[go/net/wip-xss-using-responsewriter-and-printf.yaml] 218.1342 (3.61) 264.4222 (3.35) 237.7707 (3.65) 19.9287 (21.89) 235.3739 (3.76) 34.7205 (40.84) 1;0 4.2057 (0.27) 5 1
test_semgrep_rules_rule[python/compatibility/python37.yaml] 218.3769 (3.61) 223.1771 (2.83) 221.1989 (3.39) 1.7790 (1.95) 221.5837 (3.54) 1.9719 (2.32) 2;0 4.5208 (0.29) 5 1
test_semgrep_rules_rule[python/certificates/disabled-cert-validation.yaml] 219.9154 (3.64) 381.3647 (4.84) 255.2058 (3.92) 70.5687 (77.51) 225.2144 (3.60) 42.9152 (50.47) 1;1 3.9184 (0.26) 5 1
test_semgrep_rules_rule[python/smells/open-never-closed.yml] 220.8049 (3.65) 223.0556 (2.83) 222.0076 (3.41) 0.9105 (1.0) 222.3320 (3.55) 1.4188 (1.67) 2;0 4.5043 (0.29) 5 1
test_semgrep_rules_rule[go/gorilla/handler-assignment-from-multiple-sources.yml] 230.3238 (3.81) 320.2469 (4.06) 262.9315 (4.03) 33.7765 (37.10) 253.6902 (4.05) 25.8500 (30.40) 1;1 3.8033 (0.25) 5 1
test_eqeq 233.1676 (3.86) 243.5382 (3.09) 238.6170 (3.66) 4.6307 (5.09) 240.7144 (3.84) 8.0246 (9.44) 2;0 4.1908 (0.27) 5 1
test_semgrep_rules_rule[python/django/security/injection/path-traversal-join.yaml] 238.8461 (3.95) 245.7469 (3.12) 241.6695 (3.71) 3.0234 (3.32) 241.0310 (3.85) 5.3017 (6.24) 1;0 4.1379 (0.27) 5 1
test_semgrep_rules_rule[python/django/security/injection/path-traversal-file-name.yaml] 246.5484 (4.08) 256.7887 (3.26) 248.8044 (3.82) 4.4684 (4.91) 246.8174 (3.94) 2.8619 (3.37) 1;1 4.0192 (0.26) 5 1
test_semgrep_rules_rule[javascript/jwt/jwt-hardcode/jwt-hardcode.yaml] 279.7160 (4.63) 360.7299 (4.57) 314.8589 (4.83) 30.3293 (33.31) 311.0108 (4.96) 38.6805 (45.49) 2;0 3.1760 (0.21) 5 1
test_semgrep_rules_rule[python/django/security/injection/request-data-fileresponse.yaml] 296.8486 (4.91) 305.8258 (3.88) 301.5013 (4.63) 3.8519 (4.23) 302.6265 (4.83) 6.6705 (7.85) 2;0 3.3167 (0.22) 5 1
test_semgrep_rules_rule[python/django/security/audit/extends-custom-expression.yaml] 316.5658 (5.24) 328.4697 (4.17) 320.0391 (4.91) 5.0537 (5.55) 317.3180 (5.07) 6.1787 (7.27) 1;0 3.1246 (0.20) 5 1
test_semgrep_rules_rule[go/gosec/sql/string-formatted-query.yaml] 356.1482 (5.89) 383.1703 (4.86) 371.4022 (5.70) 10.4165 (11.44) 370.4830 (5.91) 14.4258 (16.97) 2;0 2.6925 (0.18) 5 1
test_semgrep_rules_rule[python/wtf-python/default-mutable-dict.yaml] 384.2281 (6.36) 396.2143 (5.02) 390.3461 (5.99) 4.3258 (4.75) 390.4900 (6.23) 4.8211 (5.67) 2;0 2.5618 (0.17) 5 1
test_semgrep_rules_rule[python/wtf-python/default-mutable-list.yaml] 400.7794 (6.63) 409.5805 (5.19) 405.1821 (6.22) 4.0536 (4.45) 405.2171 (6.47) 7.7110 (9.07) 2;0 2.4680 (0.16) 5 1
test_semgrep_rules_rule[python/django/security/injection/user-eval-format-string.yaml] 451.1513 (7.46) 456.2555 (5.79) 454.1035 (6.97) 2.0055 (2.20) 453.9115 (7.25) 2.8535 (3.36) 2;0 2.2021 (0.14) 5 1
test_semgrep_rules_rule[python/django/security/globals-misuse-code-execution.yaml] 564.1733 (9.33) 577.7516 (7.33) 569.9860 (8.75) 5.6695 (6.23) 571.1145 (9.12) 9.0530 (10.65) 2;0 1.7544 (0.11) 5 1
test_semgrep_rules_rule[javascript/hardcoded-passport-secret/passport-hardcode.yaml] 598.4015 (9.90) 603.3669 (7.65) 601.4635 (9.23) 1.9375 (2.13) 601.5394 (9.60) 2.5072 (2.95) 1;0 1.6626 (0.11) 5 1
test_semgrep_rules_rule[python/django/security/injection/request-data-write.yaml] 623.9208 (10.32) 634.2381 (8.04) 630.5563 (9.67) 4.1788 (4.59) 630.2981 (10.06) 5.3934 (6.34) 1;0 1.5859 (0.10) 5 1
test_semgrep_rules_rule[python/django/security/injection/xss-html-email-body.yaml] 697.8127 (11.54) 723.7242 (9.18) 708.9543 (10.88) 9.3342 (10.25) 707.5140 (11.29) 7.8830 (9.27) 2;0 1.4105 (0.09) 5 1
test_semgrep_rules_rule[python/django/security/injection/user-exec-format-string.yaml] 712.2506 (11.78) 731.7001 (9.28) 722.8321 (11.09) 7.9784 (8.76) 724.9282 (11.57) 13.0469 (15.34) 2;0 1.3834 (0.09) 5 1
test_semgrep_rules_rule[python/django/security/injection/ssrf-injection-urllib.yaml] 774.5253 (12.81) 783.5746 (9.94) 778.9969 (11.95) 4.4899 (4.93) 778.7615 (12.43) 8.9386 (10.51) 2;0 1.2837 (0.08) 5 1
test_semgrep_rules_rule[python/django/security/injection/xss-send-mail-html-message.yaml] 776.6657 (12.85) 785.3651 (9.96) 780.9786 (11.98) 3.0805 (3.38) 780.8904 (12.47) 2.5226 (2.97) 2;0 1.2804 (0.08) 5 1
test_semgrep_rules_rule[python/django/security/injection/reflected-data-httpresponse.yaml] 832.8300 (13.78) 843.2654 (10.69) 837.7113 (12.85) 4.7763 (5.25) 837.5243 (13.37) 9.0103 (10.60) 2;0 1.1937 (0.08) 5 1
test_semgrep_rules_rule[python/django/security/injection/reflected-data-httpresponsebadrequest.yaml] 843.1268 (13.95) 870.3102 (11.04) 856.4201 (13.14) 12.0571 (13.24) 856.5957 (13.67) 22.2218 (26.14) 2;0 1.1677 (0.08) 5 1
test_semgrep_rules_rule[python/django/security/injection/ssrf-injection-requests.yaml] 854.4834 (14.14) 1,021.6236 (12.96) 925.3931 (14.20) 60.7951 (66.77) 922.5561 (14.73) 58.0400 (68.26) 2;0 1.0806 (0.07) 5 1
test_semgrep_rules_rule[python/django/security/injection/command-injection-os-system.yaml] 872.3413 (14.43) 884.7682 (11.22) 879.4750 (13.49) 4.8565 (5.33) 879.7330 (14.04) 7.0918 (8.34) 2;0 1.1370 (0.07) 5 1
test_semgrep_rules_rule[python/django/security/injection/sql/sql-injection-extra.yaml] 880.2117 (14.56) 901.0192 (11.43) 888.4676 (13.63) 9.6277 (10.57) 882.4737 (14.09) 16.2091 (19.06) 1;0 1.1255 (0.07) 5 1
test_semgrep_rules_rule[python/django/security/injection/sql/sql-injection-rawsql.yaml] 885.0515 (14.64) 903.0869 (11.45) 895.7707 (13.74) 8.9873 (9.87) 901.5792 (14.39) 16.0318 (18.86) 1;0 1.1164 (0.07) 5 1
test_semgrep_rules_rule[python/django/security/injection/sql/sql-injection-using-raw.yaml] 897.3203 (14.84) 933.2415 (11.84) 911.6890 (13.99) 14.6530 (16.09) 911.3510 (14.55) 22.5768 (26.55) 1;0 1.0969 (0.07) 5 1
test_semgrep_rules_rule[python/django/security/injection/sql/sql-injection-using-db-cursor-execute.yaml] 899.7484 (14.89) 996.9801 (12.64) 925.6284 (14.20) 42.0465 (46.18) 900.3197 (14.37) 47.2286 (55.55) 1;0 1.0803 (0.07) 5 1
test_semgrep_rules_rule[python/django/security/injection/path-traversal-open.yaml] 1,424.0817 (23.56) 1,458.6812 (18.50) 1,439.5466 (22.09) 12.6949 (13.94) 1,437.9325 (22.95) 14.8913 (17.51) 2;0 0.6947 (0.05) 5 1
test_semgrep_rules_rule[javascript/jwt/jwt-exposed-credentials.yaml] 1,461.0861 (24.17) 1,491.3580 (18.91) 1,478.4991 (22.68) 13.2377 (14.54) 1,482.6269 (23.67) 23.1294 (27.20) 1;0 0.6764 (0.04) 5 1
test_semgrep_rules_rule[python/django/security/injection/open-redirect.yml] 1,697.1982 (28.08) 1,715.9479 (21.76) 1,710.1935 (26.24) 7.6784 (8.43) 1,711.6959 (27.32) 8.8109 (10.36) 1;0 0.5847 (0.04) 5 1
test_public_repos[sentry] 5,419.3195 (89.65) 5,717.0020 (72.50) 5,593.1802 (85.81) 116.5961 (128.06) 5,634.0129 (89.94) 163.8531 (192.71) 2;0 0.1788 (0.01) 5 1
test_public_repos[highcharts] 53,517.2864 (885.37) 59,697.8663 (757.07) 55,537.1338 (852.08) 2,449.9332 (>1000.0) 54,456.9576 (869.33) 2,544.5775 (>1000.0) 1;0 0.0180 (0.00) 5 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
================================================================================================================ 147 passed, 72 skipped in 1089.80s (0:18:09) ================================================================================================================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment