py3.5 comparison to unicode-utf8-py3 and pypy2 comparison to unicode-utf8-py3

gistfile1.txt

I ran the python performance suite (not our benchmark suite) 3 times for each pypy3 latest nightly and pypy3
on the unicode-utf8-py3 branch commit 95595-316992f1c55d

for i in `seq 1 3`; do pyperformance run --python=pypy-c-jit-95576-f638e10d6074-linux64/bin/pypy3 -o pypy3_$i.json; done

for i in `seq 1 3`; do pyperformance run --python=pypy-c-jit-95575-82d3ff852926-linux64/bin/pypy3 -o pypy3utf8_$i.json; done

python -mperf compare_to pypy3*.json --min-speed 5
2to3
====

Mean +- std dev: [pypy3_1] 2.66 sec +- 0.04 sec -> [pypy3_2] 2.64 sec +- 0.02 sec: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 2.66 sec +- 0.04 sec -> [pypy3_3] 2.65 sec +- 0.02 sec: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 2.66 sec +- 0.04 sec -> [pypy3utf8_1] 2.57 sec +- 0.04 sec: 1.04x faster (-4%)
Mean +- std dev: [pypy3_1] 2.66 sec +- 0.04 sec -> [pypy3utf8_2] 2.54 sec +- 0.02 sec: 1.05x faster (-4%)
Mean +- std dev: [pypy3_1] 2.66 sec +- 0.04 sec -> [pypy3utf8_3] 2.54 sec +- 0.02 sec: 1.05x faster (-4%)

chameleon
=========

Mean +- std dev: [pypy3_1] 6.00 ms +- 0.14 ms -> [pypy3_2] 5.96 ms +- 0.12 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 6.00 ms +- 0.14 ms -> [pypy3_3] 6.02 ms +- 0.16 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 6.00 ms +- 0.14 ms -> [pypy3utf8_1] 12.2 ms +- 0.1 ms: 2.04x slower (+104%)
Mean +- std dev: [pypy3_1] 6.00 ms +- 0.14 ms -> [pypy3utf8_2] 12.3 ms +- 0.1 ms: 2.05x slower (+105%)
Mean +- std dev: [pypy3_1] 6.00 ms +- 0.14 ms -> [pypy3utf8_3] 12.3 ms +- 0.1 ms: 2.05x slower (+105%)

chaos
=====

Mean +- std dev: [pypy3_1] 7.94 ms +- 0.25 ms -> [pypy3_2] 7.91 ms +- 0.23 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 7.94 ms +- 0.25 ms -> [pypy3_3] 7.95 ms +- 0.26 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 7.94 ms +- 0.25 ms -> [pypy3utf8_1] 7.81 ms +- 0.24 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 7.94 ms +- 0.25 ms -> [pypy3utf8_2] 7.88 ms +- 0.23 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 7.94 ms +- 0.25 ms -> [pypy3utf8_3] 7.83 ms +- 0.24 ms: 1.01x faster (-1%)

crypto_pyaes
============

Mean +- std dev: [pypy3_1] 5.59 ms +- 0.11 ms -> [pypy3_2] 5.58 ms +- 0.12 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 5.59 ms +- 0.11 ms -> [pypy3_3] 5.64 ms +- 0.14 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 5.59 ms +- 0.11 ms -> [pypy3utf8_1] 5.53 ms +- 0.10 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 5.59 ms +- 0.11 ms -> [pypy3utf8_2] 5.61 ms +- 0.11 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 5.59 ms +- 0.11 ms -> [pypy3utf8_3] 5.55 ms +- 0.10 ms: 1.01x faster (-1%)

deltablue
=========

Mean +- std dev: [pypy3_1] 512 us +- 17 us -> [pypy3_2] 513 us +- 18 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 512 us +- 17 us -> [pypy3_3] 514 us +- 19 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 512 us +- 17 us -> [pypy3utf8_1] 527 us +- 18 us: 1.03x slower (+3%)
Mean +- std dev: [pypy3_1] 512 us +- 17 us -> [pypy3utf8_2] 533 us +- 20 us: 1.04x slower (+4%)
Mean +- std dev: [pypy3_1] 512 us +- 17 us -> [pypy3utf8_3] 527 us +- 18 us: 1.03x slower (+3%)

django_template
===============

Mean +- std dev: [pypy3_1] 94.7 ms +- 3.2 ms -> [pypy3_2] 95.2 ms +- 2.6 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 94.7 ms +- 3.2 ms -> [pypy3_3] 94.9 ms +- 2.9 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 94.7 ms +- 3.2 ms -> [pypy3utf8_1] 88.8 ms +- 3.5 ms: 1.07x faster (-6%)
Mean +- std dev: [pypy3_1] 94.7 ms +- 3.2 ms -> [pypy3utf8_2] 88.5 ms +- 3.2 ms: 1.07x faster (-7%)
Mean +- std dev: [pypy3_1] 94.7 ms +- 3.2 ms -> [pypy3utf8_3] 87.0 ms +- 3.0 ms: 1.09x faster (-8%)

dulwich_log
===========

Mean +- std dev: [pypy3_1] 155 ms +- 6 ms -> [pypy3_2] 152 ms +- 6 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 155 ms +- 6 ms -> [pypy3_3] 154 ms +- 7 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 155 ms +- 6 ms -> [pypy3utf8_1] 148 ms +- 4 ms: 1.05x faster (-4%)
Mean +- std dev: [pypy3_1] 155 ms +- 6 ms -> [pypy3utf8_2] 149 ms +- 2 ms: 1.04x faster (-4%)
Mean +- std dev: [pypy3_1] 155 ms +- 6 ms -> [pypy3utf8_3] 148 ms +- 3 ms: 1.04x faster (-4%)

fannkuch
========

Mean +- std dev: [pypy3_1] 142 ms +- 1 ms -> [pypy3_2] 142 ms +- 1 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 142 ms +- 1 ms -> [pypy3_3] 141 ms +- 1 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 142 ms +- 1 ms -> [pypy3utf8_1] 143 ms +- 1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 142 ms +- 1 ms -> [pypy3utf8_2] 143 ms +- 1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 142 ms +- 1 ms -> [pypy3utf8_3] 144 ms +- 1 ms: 1.01x slower (+1%)

float
=====

Mean +- std dev: [pypy3_1] 31.9 ms +- 0.5 ms -> [pypy3_2] 31.6 ms +- 0.5 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 31.9 ms +- 0.5 ms -> [pypy3_3] 31.7 ms +- 0.5 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 31.9 ms +- 0.5 ms -> [pypy3utf8_1] 32.5 ms +- 1.2 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy3_1] 31.9 ms +- 0.5 ms -> [pypy3utf8_2] 32.6 ms +- 1.2 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy3_1] 31.9 ms +- 0.5 ms -> [pypy3utf8_3] 32.5 ms +- 1.1 ms: 1.02x slower (+2%)

go
==

Mean +- std dev: [pypy3_1] 83.3 ms +- 6.5 ms -> [pypy3_2] 74.7 ms +- 3.0 ms: 1.12x faster (-10%)
Mean +- std dev: [pypy3_1] 83.3 ms +- 6.5 ms -> [pypy3_3] 71.3 ms +- 5.4 ms: 1.17x faster (-14%)
Mean +- std dev: [pypy3_1] 83.3 ms +- 6.5 ms -> [pypy3utf8_1] 59.1 ms +- 2.5 ms: 1.41x faster (-29%)
Mean +- std dev: [pypy3_1] 83.3 ms +- 6.5 ms -> [pypy3utf8_2] 59.8 ms +- 2.9 ms: 1.39x faster (-28%)
Mean +- std dev: [pypy3_1] 83.3 ms +- 6.5 ms -> [pypy3utf8_3] 59.4 ms +- 2.6 ms: 1.40x faster (-29%)

hexiom
======

Mean +- std dev: [pypy3_1] 2.39 ms +- 0.07 ms -> [pypy3_2] 2.38 ms +- 0.07 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 2.39 ms +- 0.07 ms -> [pypy3_3] 2.38 ms +- 0.07 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 2.39 ms +- 0.07 ms -> [pypy3utf8_1] 2.71 ms +- 0.08 ms: 1.13x slower (+13%)
Mean +- std dev: [pypy3_1] 2.39 ms +- 0.07 ms -> [pypy3utf8_2] 2.73 ms +- 0.09 ms: 1.14x slower (+14%)
Mean +- std dev: [pypy3_1] 2.39 ms +- 0.07 ms -> [pypy3utf8_3] 2.73 ms +- 0.07 ms: 1.14x slower (+14%)

html5lib
========

Mean +- std dev: [pypy3_1] 64.9 ms +- 4.5 ms -> [pypy3_2] 63.6 ms +- 3.6 ms: 1.02x faster (-2%)
Not significant!
Mean +- std dev: [pypy3_1] 64.9 ms +- 4.5 ms -> [pypy3_3] 65.7 ms +- 4.2 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 64.9 ms +- 4.5 ms -> [pypy3utf8_1] 58.0 ms +- 3.8 ms: 1.12x faster (-11%)
Mean +- std dev: [pypy3_1] 64.9 ms +- 4.5 ms -> [pypy3utf8_2] 58.1 ms +- 3.9 ms: 1.12x faster (-10%)
Mean +- std dev: [pypy3_1] 64.9 ms +- 4.5 ms -> [pypy3utf8_3] 55.8 ms +- 3.6 ms: 1.16x faster (-14%)

json_dumps
==========

Mean +- std dev: [pypy3_1] 8.00 ms +- 0.15 ms -> [pypy3_2] 8.05 ms +- 0.19 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 8.00 ms +- 0.15 ms -> [pypy3_3] 8.03 ms +- 0.14 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 8.00 ms +- 0.15 ms -> [pypy3utf8_1] 7.76 ms +- 0.18 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 8.00 ms +- 0.15 ms -> [pypy3utf8_2] 7.84 ms +- 0.20 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 8.00 ms +- 0.15 ms -> [pypy3utf8_3] 7.86 ms +- 0.22 ms: 1.02x faster (-2%)

json_loads
==========

Mean +- std dev: [pypy3_1] 23.9 us +- 0.5 us -> [pypy3_2] 23.9 us +- 0.5 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 23.9 us +- 0.5 us -> [pypy3_3] 23.9 us +- 0.5 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 23.9 us +- 0.5 us -> [pypy3utf8_1] 27.0 us +- 0.2 us: 1.13x slower (+13%)
Mean +- std dev: [pypy3_1] 23.9 us +- 0.5 us -> [pypy3utf8_2] 26.9 us +- 0.1 us: 1.12x slower (+12%)
Mean +- std dev: [pypy3_1] 23.9 us +- 0.5 us -> [pypy3utf8_3] 26.9 us +- 0.2 us: 1.13x slower (+13%)

logging_format
==============

Mean +- std dev: [pypy3_1] 7.37 us +- 0.08 us -> [pypy3_2] 7.38 us +- 0.11 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 7.37 us +- 0.08 us -> [pypy3_3] 7.32 us +- 0.14 us: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 7.37 us +- 0.08 us -> [pypy3utf8_1] 6.22 us +- 0.16 us: 1.19x faster (-16%)
Mean +- std dev: [pypy3_1] 7.37 us +- 0.08 us -> [pypy3utf8_2] 6.27 us +- 0.19 us: 1.18x faster (-15%)
Mean +- std dev: [pypy3_1] 7.37 us +- 0.08 us -> [pypy3utf8_3] 6.22 us +- 0.18 us: 1.19x faster (-16%)

logging_silent
==============

Mean +- std dev: [pypy3_1] 0.16 ns +- 0.00 ns -> [pypy3_2] 0.16 ns +- 0.00 ns: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 0.16 ns +- 0.00 ns -> [pypy3_3] 0.16 ns +- 0.00 ns: 1.00x faster (-0%)
Mean +- std dev: [pypy3_1] 0.16 ns +- 0.00 ns -> [pypy3utf8_1] 0.16 ns +- 0.00 ns: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 0.16 ns +- 0.00 ns -> [pypy3utf8_2] 0.16 ns +- 0.00 ns: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 0.16 ns +- 0.00 ns -> [pypy3utf8_3] 0.16 ns +- 0.00 ns: 1.00x faster (-0%)
Not significant!

logging_simple
==============

Mean +- std dev: [pypy3_1] 5.39 us +- 0.09 us -> [pypy3_2] 5.40 us +- 0.07 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 5.39 us +- 0.09 us -> [pypy3_3] 5.40 us +- 0.05 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 5.39 us +- 0.09 us -> [pypy3utf8_1] 4.98 us +- 0.06 us: 1.08x faster (-8%)
Mean +- std dev: [pypy3_1] 5.39 us +- 0.09 us -> [pypy3utf8_2] 4.98 us +- 0.07 us: 1.08x faster (-8%)
Mean +- std dev: [pypy3_1] 5.39 us +- 0.09 us -> [pypy3utf8_3] 4.99 us +- 0.11 us: 1.08x faster (-7%)

meteor_contest
==============

Mean +- std dev: [pypy3_1] 63.4 ms +- 1.5 ms -> [pypy3_2] 63.5 ms +- 1.4 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 63.4 ms +- 1.5 ms -> [pypy3_3] 63.4 ms +- 1.4 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 63.4 ms +- 1.5 ms -> [pypy3utf8_1] 66.8 ms +- 1.4 ms: 1.05x slower (+5%)
Mean +- std dev: [pypy3_1] 63.4 ms +- 1.5 ms -> [pypy3utf8_2] 66.7 ms +- 1.5 ms: 1.05x slower (+5%)
Mean +- std dev: [pypy3_1] 63.4 ms +- 1.5 ms -> [pypy3utf8_3] 66.2 ms +- 0.8 ms: 1.04x slower (+4%)

nqueens
=======

Mean +- std dev: [pypy3_1] 32.4 ms +- 0.7 ms -> [pypy3_2] 32.1 ms +- 0.3 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 32.4 ms +- 0.7 ms -> [pypy3_3] 32.4 ms +- 0.6 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 32.4 ms +- 0.7 ms -> [pypy3utf8_1] 31.9 ms +- 0.3 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 32.4 ms +- 0.7 ms -> [pypy3utf8_2] 32.2 ms +- 0.7 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 32.4 ms +- 0.7 ms -> [pypy3utf8_3] 31.9 ms +- 0.1 ms: 1.02x faster (-2%)

pathlib
=======

Mean +- std dev: [pypy3_1] 28.0 ms +- 1.2 ms -> [pypy3_2] 28.2 ms +- 1.3 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 28.0 ms +- 1.2 ms -> [pypy3_3] 27.9 ms +- 1.1 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 28.0 ms +- 1.2 ms -> [pypy3utf8_1] 17.3 ms +- 0.6 ms: 1.62x faster (-38%)
Mean +- std dev: [pypy3_1] 28.0 ms +- 1.2 ms -> [pypy3utf8_2] 17.5 ms +- 0.6 ms: 1.60x faster (-38%)
Mean +- std dev: [pypy3_1] 28.0 ms +- 1.2 ms -> [pypy3utf8_3] 17.4 ms +- 0.6 ms: 1.61x faster (-38%)

pickle
======

Mean +- std dev: [pypy3_1] 98.8 us +- 3.1 us -> [pypy3_2] 99.8 us +- 3.2 us: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 98.8 us +- 3.1 us -> [pypy3_3] 100 us +- 3 us: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 98.8 us +- 3.1 us -> [pypy3utf8_1] 93.1 us +- 3.1 us: 1.06x faster (-6%)
Mean +- std dev: [pypy3_1] 98.8 us +- 3.1 us -> [pypy3utf8_2] 93.3 us +- 2.8 us: 1.06x faster (-6%)
Mean +- std dev: [pypy3_1] 98.8 us +- 3.1 us -> [pypy3utf8_3] 93.8 us +- 4.6 us: 1.05x faster (-5%)

pickle_dict
===========

Mean +- std dev: [pypy3_1] 524 us +- 14 us -> [pypy3_2] 525 us +- 17 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 524 us +- 14 us -> [pypy3_3] 524 us +- 17 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 524 us +- 14 us -> [pypy3utf8_1] 516 us +- 16 us: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 524 us +- 14 us -> [pypy3utf8_2] 519 us +- 14 us: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 524 us +- 14 us -> [pypy3utf8_3] 517 us +- 17 us: 1.01x faster (-1%)

pickle_list
===========

Mean +- std dev: [pypy3_1] 57.1 us +- 1.3 us -> [pypy3_2] 57.6 us +- 1.5 us: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 57.1 us +- 1.3 us -> [pypy3_3] 56.9 us +- 1.2 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 57.1 us +- 1.3 us -> [pypy3utf8_1] 57.8 us +- 1.3 us: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 57.1 us +- 1.3 us -> [pypy3utf8_2] 58.0 us +- 1.4 us: 1.02x slower (+2%)
Mean +- std dev: [pypy3_1] 57.1 us +- 1.3 us -> [pypy3utf8_3] 58.4 us +- 1.5 us: 1.02x slower (+2%)

pickle_pure_python
==================

Mean +- std dev: [pypy3_1] 100 us +- 3 us -> [pypy3_2] 99.7 us +- 3.6 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 100 us +- 3 us -> [pypy3_3] 99.1 us +- 3.0 us: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 100 us +- 3 us -> [pypy3utf8_1] 93.4 us +- 3.1 us: 1.07x faster (-7%)
Mean +- std dev: [pypy3_1] 100 us +- 3 us -> [pypy3utf8_2] 93.0 us +- 3.1 us: 1.08x faster (-7%)
Mean +- std dev: [pypy3_1] 100 us +- 3 us -> [pypy3utf8_3] 93.3 us +- 3.3 us: 1.07x faster (-7%)

pidigits
========

Mean +- std dev: [pypy3_1] 245 ms +- 4 ms -> [pypy3_2] 245 ms +- 4 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 245 ms +- 4 ms -> [pypy3_3] 245 ms +- 4 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 245 ms +- 4 ms -> [pypy3utf8_1] 245 ms +- 4 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 245 ms +- 4 ms -> [pypy3utf8_2] 245 ms +- 5 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 245 ms +- 4 ms -> [pypy3utf8_3] 243 ms +- 3 ms: 1.01x faster (-1%)

python_startup
==============

Mean +- std dev: [pypy3_1] 48.5 ms +- 1.2 ms -> [pypy3_2] 48.5 ms +- 1.1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 48.5 ms +- 1.2 ms -> [pypy3_3] 47.9 ms +- 1.1 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 48.5 ms +- 1.2 ms -> [pypy3utf8_1] 43.4 ms +- 1.0 ms: 1.12x faster (-11%)
Mean +- std dev: [pypy3_1] 48.5 ms +- 1.2 ms -> [pypy3utf8_2] 43.5 ms +- 1.1 ms: 1.12x faster (-10%)
Mean +- std dev: [pypy3_1] 48.5 ms +- 1.2 ms -> [pypy3utf8_3] 43.2 ms +- 1.2 ms: 1.12x faster (-11%)

python_startup_no_site
======================

Mean +- std dev: [pypy3_1] 29.6 ms +- 1.4 ms -> [pypy3_2] 29.6 ms +- 1.6 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 29.6 ms +- 1.4 ms -> [pypy3_3] 29.6 ms +- 1.6 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 29.6 ms +- 1.4 ms -> [pypy3utf8_1] 27.2 ms +- 1.3 ms: 1.09x faster (-8%)
Mean +- std dev: [pypy3_1] 29.6 ms +- 1.4 ms -> [pypy3utf8_2] 27.5 ms +- 1.3 ms: 1.07x faster (-7%)
Mean +- std dev: [pypy3_1] 29.6 ms +- 1.4 ms -> [pypy3utf8_3] 27.6 ms +- 1.3 ms: 1.07x faster (-7%)

raytrace
========

Mean +- std dev: [pypy3_1] 15.9 ms +- 0.2 ms -> [pypy3_2] 16.2 ms +- 0.4 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy3_1] 15.9 ms +- 0.2 ms -> [pypy3_3] 16.1 ms +- 0.1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 15.9 ms +- 0.2 ms -> [pypy3utf8_1] 16.2 ms +- 0.1 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy3_1] 15.9 ms +- 0.2 ms -> [pypy3utf8_2] 16.3 ms +- 0.3 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy3_1] 15.9 ms +- 0.2 ms -> [pypy3utf8_3] 16.4 ms +- 0.3 ms: 1.03x slower (+3%)

regex_compile
=============

Mean +- std dev: [pypy3_1] 49.9 ms +- 1.3 ms -> [pypy3_2] 50.0 ms +- 1.3 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 49.9 ms +- 1.3 ms -> [pypy3_3] 49.7 ms +- 1.3 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 49.9 ms +- 1.3 ms -> [pypy3utf8_1] 60.0 ms +- 2.3 ms: 1.20x slower (+20%)
Mean +- std dev: [pypy3_1] 49.9 ms +- 1.3 ms -> [pypy3utf8_2] 60.1 ms +- 1.9 ms: 1.20x slower (+20%)
Mean +- std dev: [pypy3_1] 49.9 ms +- 1.3 ms -> [pypy3utf8_3] 59.5 ms +- 1.8 ms: 1.19x slower (+19%)

regex_dna
=========

Mean +- std dev: [pypy3_1] 99.6 ms +- 0.5 ms -> [pypy3_2] 99.2 ms +- 0.5 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy3_1] 99.6 ms +- 0.5 ms -> [pypy3_3] 99.7 ms +- 0.5 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 99.6 ms +- 0.5 ms -> [pypy3utf8_1] 99.7 ms +- 1.5 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 99.6 ms +- 0.5 ms -> [pypy3utf8_2] 99.6 ms +- 1.5 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 99.6 ms +- 0.5 ms -> [pypy3utf8_3] 99.6 ms +- 1.3 ms: 1.00x slower (+0%)
Not significant!

regex_effbot
============

Mean +- std dev: [pypy3_1] 2.61 ms +- 0.08 ms -> [pypy3_2] 2.59 ms +- 0.07 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 2.61 ms +- 0.08 ms -> [pypy3_3] 2.59 ms +- 0.06 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 2.61 ms +- 0.08 ms -> [pypy3utf8_1] 3.52 ms +- 0.07 ms: 1.35x slower (+35%)
Mean +- std dev: [pypy3_1] 2.61 ms +- 0.08 ms -> [pypy3utf8_2] 3.49 ms +- 0.02 ms: 1.34x slower (+34%)
Mean +- std dev: [pypy3_1] 2.61 ms +- 0.08 ms -> [pypy3utf8_3] 3.48 ms +- 0.03 ms: 1.33x slower (+33%)

regex_v8
========

Mean +- std dev: [pypy3_1] 29.4 ms +- 0.7 ms -> [pypy3_2] 28.9 ms +- 1.2 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 29.4 ms +- 0.7 ms -> [pypy3_3] 29.7 ms +- 0.8 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 29.4 ms +- 0.7 ms -> [pypy3utf8_1] 30.6 ms +- 0.4 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy3_1] 29.4 ms +- 0.7 ms -> [pypy3utf8_2] 30.4 ms +- 0.2 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy3_1] 29.4 ms +- 0.7 ms -> [pypy3utf8_3] 30.4 ms +- 0.2 ms: 1.03x slower (+3%)

richards
========

Mean +- std dev: [pypy3_1] 5.57 ms +- 0.15 ms -> [pypy3_2] 5.63 ms +- 0.13 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 5.57 ms +- 0.15 ms -> [pypy3_3] 5.50 ms +- 0.13 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 5.57 ms +- 0.15 ms -> [pypy3utf8_1] 5.07 ms +- 0.05 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy3_1] 5.57 ms +- 0.15 ms -> [pypy3utf8_2] 5.64 ms +- 0.13 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 5.57 ms +- 0.15 ms -> [pypy3utf8_3] 5.67 ms +- 0.11 ms: 1.02x slower (+2%)

scimark_fft
===========

Mean +- std dev: [pypy3_1] 10.1 ms +- 0.0 ms -> [pypy3_2] 10.2 ms +- 0.1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 10.1 ms +- 0.0 ms -> [pypy3_3] 10.2 ms +- 0.2 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 10.1 ms +- 0.0 ms -> [pypy3utf8_1] 10.1 ms +- 0.1 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 10.1 ms +- 0.0 ms -> [pypy3utf8_2] 10.2 ms +- 0.1 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 10.1 ms +- 0.0 ms -> [pypy3utf8_3] 10.1 ms +- 0.1 ms: 1.00x slower (+0%)

scimark_lu
==========

Mean +- std dev: [pypy3_1] 1.99 ms +- 0.01 ms -> [pypy3_2] 2.00 ms +- 0.03 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 1.99 ms +- 0.01 ms -> [pypy3_3] 2.01 ms +- 0.01 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 1.99 ms +- 0.01 ms -> [pypy3utf8_1] 1.95 ms +- 0.03 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 1.99 ms +- 0.01 ms -> [pypy3utf8_2] 1.95 ms +- 0.00 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 1.99 ms +- 0.01 ms -> [pypy3utf8_3] 1.96 ms +- 0.03 ms: 1.02x faster (-2%)

scimark_monte_carlo
===================

Mean +- std dev: [pypy3_1] 3.35 ms +- 0.02 ms -> [pypy3_2] 3.35 ms +- 0.02 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 3.35 ms +- 0.02 ms -> [pypy3_3] 3.34 ms +- 0.01 ms: 1.00x faster (-0%)
Mean +- std dev: [pypy3_1] 3.35 ms +- 0.02 ms -> [pypy3utf8_1] 3.30 ms +- 0.04 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy3_1] 3.35 ms +- 0.02 ms -> [pypy3utf8_2] 3.28 ms +- 0.01 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 3.35 ms +- 0.02 ms -> [pypy3utf8_3] 3.28 ms +- 0.01 ms: 1.02x faster (-2%)

scimark_sor
===========

Mean +- std dev: [pypy3_1] 1.08 ms +- 0.02 ms -> [pypy3_2] 1.08 ms +- 0.02 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 1.08 ms +- 0.02 ms -> [pypy3_3] 1.08 ms +- 0.02 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 1.08 ms +- 0.02 ms -> [pypy3utf8_1] 1.12 ms +- 0.03 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy3_1] 1.08 ms +- 0.02 ms -> [pypy3utf8_2] 1.12 ms +- 0.02 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy3_1] 1.08 ms +- 0.02 ms -> [pypy3utf8_3] 1.10 ms +- 0.02 ms: 1.02x slower (+2%)

scimark_sparse_mat_mult
=======================

Mean +- std dev: [pypy3_1] 167 us +- 2 us -> [pypy3_2] 167 us +- 2 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 167 us +- 2 us -> [pypy3_3] 167 us +- 1 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 167 us +- 2 us -> [pypy3utf8_1] 158 us +- 1 us: 1.05x faster (-5%)
Mean +- std dev: [pypy3_1] 167 us +- 2 us -> [pypy3utf8_2] 158 us +- 1 us: 1.05x faster (-5%)
Mean +- std dev: [pypy3_1] 167 us +- 2 us -> [pypy3utf8_3] 158 us +- 1 us: 1.05x faster (-5%)

spectral_norm
=============

Mean +- std dev: [pypy3_1] 7.28 ms +- 0.32 ms -> [pypy3_2] 7.07 ms +- 0.06 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 7.28 ms +- 0.32 ms -> [pypy3_3] 7.08 ms +- 0.08 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 7.28 ms +- 0.32 ms -> [pypy3utf8_1] 7.04 ms +- 0.03 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 7.28 ms +- 0.32 ms -> [pypy3utf8_2] 7.05 ms +- 0.02 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 7.28 ms +- 0.32 ms -> [pypy3utf8_3] 7.23 ms +- 0.43 ms: 1.01x faster (-1%)
Not significant!

sqlalchemy_declarative
======================

Mean +- std dev: [pypy3_1] 302 ms +- 15 ms -> [pypy3_2] 208 ms +- 13 ms: 1.45x faster (-31%)
Mean +- std dev: [pypy3_1] 302 ms +- 15 ms -> [pypy3_3] 205 ms +- 13 ms: 1.47x faster (-32%)
Mean +- std dev: [pypy3_1] 302 ms +- 15 ms -> [pypy3utf8_1] 207 ms +- 11 ms: 1.46x faster (-32%)
Mean +- std dev: [pypy3_1] 302 ms +- 15 ms -> [pypy3utf8_2] 203 ms +- 11 ms: 1.49x faster (-33%)
Mean +- std dev: [pypy3_1] 302 ms +- 15 ms -> [pypy3utf8_3] 203 ms +- 11 ms: 1.49x faster (-33%)

sqlite_synth
============

Mean +- std dev: [pypy3_1] 4.33 us +- 0.12 us -> [pypy3_2] 4.35 us +- 0.13 us: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 4.33 us +- 0.12 us -> [pypy3_3] 4.34 us +- 0.13 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 4.33 us +- 0.12 us -> [pypy3utf8_1] 5.02 us +- 0.08 us: 1.16x slower (+16%)
Mean +- std dev: [pypy3_1] 4.33 us +- 0.12 us -> [pypy3utf8_2] 5.05 us +- 0.12 us: 1.17x slower (+17%)
Mean +- std dev: [pypy3_1] 4.33 us +- 0.12 us -> [pypy3utf8_3] 5.05 us +- 0.12 us: 1.17x slower (+17%)

sympy_expand
============

Mean +- std dev: [pypy3_1] 277 ms +- 5 ms -> [pypy3_2] 277 ms +- 3 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 277 ms +- 5 ms -> [pypy3_3] 279 ms +- 5 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy3_1] 277 ms +- 5 ms -> [pypy3utf8_1] 271 ms +- 3 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 277 ms +- 5 ms -> [pypy3utf8_2] 269 ms +- 3 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 277 ms +- 5 ms -> [pypy3utf8_3] 271 ms +- 4 ms: 1.02x faster (-2%)

sympy_integrate
===============

Mean +- std dev: [pypy3_1] 135 ms +- 13 ms -> [pypy3_2] 84.6 ms +- 8.9 ms: 1.60x faster (-37%)
Mean +- std dev: [pypy3_1] 135 ms +- 13 ms -> [pypy3_3] 56.4 ms +- 4.6 ms: 2.39x faster (-58%)
Mean +- std dev: [pypy3_1] 135 ms +- 13 ms -> [pypy3utf8_1] 52.0 ms +- 5.0 ms: 2.59x faster (-61%)
Mean +- std dev: [pypy3_1] 135 ms +- 13 ms -> [pypy3utf8_2] 58.9 ms +- 5.0 ms: 2.29x faster (-56%)
Mean +- std dev: [pypy3_1] 135 ms +- 13 ms -> [pypy3utf8_3] 111 ms +- 11 ms: 1.22x faster (-18%)

sympy_sum
=========

Mean +- std dev: [pypy3_1] 143 ms +- 6 ms -> [pypy3_2] 171 ms +- 9 ms: 1.19x slower (+19%)
Mean +- std dev: [pypy3_1] 143 ms +- 6 ms -> [pypy3_3] 166 ms +- 9 ms: 1.16x slower (+16%)
Mean +- std dev: [pypy3_1] 143 ms +- 6 ms -> [pypy3utf8_1] 157 ms +- 8 ms: 1.10x slower (+10%)
Mean +- std dev: [pypy3_1] 143 ms +- 6 ms -> [pypy3utf8_2] 148 ms +- 6 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy3_1] 143 ms +- 6 ms -> [pypy3utf8_3] 150 ms +- 5 ms: 1.04x slower (+4%)

sympy_str
=========

Mean +- std dev: [pypy3_1] 160 ms +- 9 ms -> [pypy3_2] 158 ms +- 9 ms: 1.02x faster (-2%)
Not significant!
Mean +- std dev: [pypy3_1] 160 ms +- 9 ms -> [pypy3_3] 174 ms +- 8 ms: 1.08x slower (+8%)
Mean +- std dev: [pypy3_1] 160 ms +- 9 ms -> [pypy3utf8_1] 158 ms +- 7 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 160 ms +- 9 ms -> [pypy3utf8_2] 146 ms +- 7 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy3_1] 160 ms +- 9 ms -> [pypy3utf8_3] 149 ms +- 5 ms: 1.08x faster (-7%)

telco
=====

Mean +- std dev: [pypy3_1] 103 ms +- 2 ms -> [pypy3_2] 103 ms +- 2 ms: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 103 ms +- 2 ms -> [pypy3_3] 103 ms +- 2 ms: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 103 ms +- 2 ms -> [pypy3utf8_1] 93.6 ms +- 4.1 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy3_1] 103 ms +- 2 ms -> [pypy3utf8_2] 94.2 ms +- 4.3 ms: 1.10x faster (-9%)
Mean +- std dev: [pypy3_1] 103 ms +- 2 ms -> [pypy3utf8_3] 94.9 ms +- 4.8 ms: 1.09x faster (-8%)

tornado_http
============

Mean +- std dev: [pypy3_1] 266 ms +- 13 ms -> [pypy3_2] 269 ms +- 13 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 266 ms +- 13 ms -> [pypy3_3] 275 ms +- 14 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy3_1] 266 ms +- 13 ms -> [pypy3utf8_1] 264 ms +- 14 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 266 ms +- 13 ms -> [pypy3utf8_2] 268 ms +- 15 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 266 ms +- 13 ms -> [pypy3utf8_3] 273 ms +- 15 ms: 1.03x slower (+3%)

unpickle
========

Mean +- std dev: [pypy3_1] 74.1 us +- 1.7 us -> [pypy3_2] 73.9 us +- 1.7 us: 1.00x faster (-0%)
Not significant!
Mean +- std dev: [pypy3_1] 74.1 us +- 1.7 us -> [pypy3_3] 74.2 us +- 1.7 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 74.1 us +- 1.7 us -> [pypy3utf8_1] 64.5 us +- 1.3 us: 1.15x faster (-13%)
Mean +- std dev: [pypy3_1] 74.1 us +- 1.7 us -> [pypy3utf8_2] 64.4 us +- 1.1 us: 1.15x faster (-13%)
Mean +- std dev: [pypy3_1] 74.1 us +- 1.7 us -> [pypy3utf8_3] 64.7 us +- 1.6 us: 1.15x faster (-13%)

unpickle_pure_python
====================

Mean +- std dev: [pypy3_1] 73.7 us +- 1.7 us -> [pypy3_2] 73.9 us +- 1.7 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 73.7 us +- 1.7 us -> [pypy3_3] 74.0 us +- 1.7 us: 1.00x slower (+0%)
Not significant!
Mean +- std dev: [pypy3_1] 73.7 us +- 1.7 us -> [pypy3utf8_1] 64.4 us +- 1.4 us: 1.15x faster (-13%)
Mean +- std dev: [pypy3_1] 73.7 us +- 1.7 us -> [pypy3utf8_2] 65.1 us +- 1.6 us: 1.13x faster (-12%)
Mean +- std dev: [pypy3_1] 73.7 us +- 1.7 us -> [pypy3utf8_3] 64.4 us +- 1.3 us: 1.14x faster (-13%)

xml_etree_pure_python_parse
===========================

Mean +- std dev: [pypy3_1] 671 ms +- 26 ms -> [pypy3_2] 650 ms +- 10 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 671 ms +- 26 ms -> [pypy3_3] 654 ms +- 15 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 671 ms +- 26 ms -> [pypy3utf8_1] 570 ms +- 10 ms: 1.18x faster (-15%)
Mean +- std dev: [pypy3_1] 671 ms +- 26 ms -> [pypy3utf8_2] 570 ms +- 8 ms: 1.18x faster (-15%)
Mean +- std dev: [pypy3_1] 671 ms +- 26 ms -> [pypy3utf8_3] 572 ms +- 10 ms: 1.17x faster (-15%)

xml_etree_pure_python_iterparse
===============================

Mean +- std dev: [pypy3_1] 275 ms +- 10 ms -> [pypy3_2] 270 ms +- 10 ms: 1.02x faster (-2%)
Mean +- std dev: [pypy3_1] 275 ms +- 10 ms -> [pypy3_3] 267 ms +- 7 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 275 ms +- 10 ms -> [pypy3utf8_1] 240 ms +- 8 ms: 1.14x faster (-13%)
Mean +- std dev: [pypy3_1] 275 ms +- 10 ms -> [pypy3utf8_2] 241 ms +- 6 ms: 1.14x faster (-13%)
Mean +- std dev: [pypy3_1] 275 ms +- 10 ms -> [pypy3utf8_3] 239 ms +- 6 ms: 1.15x faster (-13%)

xml_etree_pure_python_generate
==============================

Mean +- std dev: [pypy3_1] 79.8 ms +- 5.0 ms -> [pypy3_2] 84.7 ms +- 4.8 ms: 1.06x slower (+6%)
Mean +- std dev: [pypy3_1] 79.8 ms +- 5.0 ms -> [pypy3_3] 78.3 ms +- 3.8 ms: 1.02x faster (-2%)
Not significant!
Mean +- std dev: [pypy3_1] 79.8 ms +- 5.0 ms -> [pypy3utf8_1] 78.6 ms +- 3.4 ms: 1.02x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 79.8 ms +- 5.0 ms -> [pypy3utf8_2] 79.2 ms +- 3.2 ms: 1.01x faster (-1%)
Not significant!
Mean +- std dev: [pypy3_1] 79.8 ms +- 5.0 ms -> [pypy3utf8_3] 79.3 ms +- 4.8 ms: 1.01x faster (-1%)
Not significant!

xml_etree_pure_python_process
=============================

Mean +- std dev: [pypy3_1] 64.1 ms +- 5.5 ms -> [pypy3_2] 67.6 ms +- 6.1 ms: 1.05x slower (+5%)
Mean +- std dev: [pypy3_1] 64.1 ms +- 5.5 ms -> [pypy3_3] 64.4 ms +- 6.1 ms: 1.01x slower (+1%)
Not significant!
Mean +- std dev: [pypy3_1] 64.1 ms +- 5.5 ms -> [pypy3utf8_1] 69.5 ms +- 8.7 ms: 1.08x slower (+8%)
Mean +- std dev: [pypy3_1] 64.1 ms +- 5.5 ms -> [pypy3utf8_2] 61.9 ms +- 5.9 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy3_1] 64.1 ms +- 5.5 ms -> [pypy3utf8_3] 60.9 ms +- 6.8 ms: 1.05x faster (-5%)
Benchmark hidden because not significant (3): nbody, unpack_sequence, unpickle_list
Ignored benchmarks (1) of pypy3_1.json: mako
Ignored benchmarks (1) of pypy3_2.json: mako
Ignored benchmarks (1) of pypy3_3.json: mako

gistfile2.txt

And here is a comparison between pypy2 default and the same pypy3 unicode-utf8-py3. 

python -mperf compare_to pypy2_1.json pypy3utf8_*.json --min-speed 5

2to3
====

Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy3utf8_1] 2.57 sec +- 0.04 sec: 1.43x slower (+43%)
Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy3utf8_2] 2.54 sec +- 0.02 sec: 1.42x slower (+42%)
Mean +- std dev: [pypy2_1] 1.79 sec +- 0.05 sec -> [pypy3utf8_3] 2.54 sec +- 0.02 sec: 1.42x slower (+42%)

chameleon
=========

Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy3utf8_1] 12.2 ms +- 0.1 ms: 1.89x slower (+89%)
Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy3utf8_2] 12.3 ms +- 0.1 ms: 1.90x slower (+90%)
Mean +- std dev: [pypy2_1] 6.48 ms +- 0.09 ms -> [pypy3utf8_3] 12.3 ms +- 0.1 ms: 1.90x slower (+90%)

chaos
=====

Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy3utf8_1] 7.81 ms +- 0.24 ms: 1.36x slower (+36%)
Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy3utf8_2] 7.88 ms +- 0.23 ms: 1.37x slower (+37%)
Mean +- std dev: [pypy2_1] 5.76 ms +- 0.01 ms -> [pypy3utf8_3] 7.83 ms +- 0.24 ms: 1.36x slower (+36%)

crypto_pyaes
============

Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy3utf8_1] 5.53 ms +- 0.10 ms: 1.99x faster (-50%)
Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy3utf8_2] 5.61 ms +- 0.11 ms: 1.96x faster (-49%)
Mean +- std dev: [pypy2_1] 11.0 ms +- 0.2 ms -> [pypy3utf8_3] 5.55 ms +- 0.10 ms: 1.99x faster (-50%)

deltablue
=========

Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy3utf8_1] 527 us +- 18 us: 1.35x slower (+35%)
Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy3utf8_2] 533 us +- 20 us: 1.36x slower (+36%)
Mean +- std dev: [pypy2_1] 391 us +- 8 us -> [pypy3utf8_3] 527 us +- 18 us: 1.35x slower (+35%)

django_template
===============

Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy3utf8_1] 88.8 ms +- 3.5 ms: 2.60x slower (+160%)
Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy3utf8_2] 88.5 ms +- 3.2 ms: 2.59x slower (+159%)
Mean +- std dev: [pypy2_1] 34.2 ms +- 1.6 ms -> [pypy3utf8_3] 87.0 ms +- 3.0 ms: 2.54x slower (+154%)

dulwich_log
===========

Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy3utf8_1] 148 ms +- 4 ms: 1.10x slower (+10%)
Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy3utf8_2] 149 ms +- 2 ms: 1.11x slower (+11%)
Mean +- std dev: [pypy2_1] 134 ms +- 2 ms -> [pypy3utf8_3] 148 ms +- 3 ms: 1.10x slower (+10%)

fannkuch
========

Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy3utf8_1] 143 ms +- 1 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy3utf8_2] 143 ms +- 1 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 139 ms +- 1 ms -> [pypy3utf8_3] 144 ms +- 1 ms: 1.03x slower (+3%)

float
=====

Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy3utf8_1] 32.5 ms +- 1.2 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy3utf8_2] 32.6 ms +- 1.2 ms: 1.03x slower (+3%)
Mean +- std dev: [pypy2_1] 31.7 ms +- 1.1 ms -> [pypy3utf8_3] 32.5 ms +- 1.1 ms: 1.02x slower (+2%)

go
==

Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy3utf8_1] 59.1 ms +- 2.5 ms: 1.69x faster (-41%)
Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy3utf8_2] 59.8 ms +- 2.9 ms: 1.68x faster (-40%)
Mean +- std dev: [pypy2_1] 100 ms +- 7 ms -> [pypy3utf8_3] 59.4 ms +- 2.6 ms: 1.69x faster (-41%)

hexiom
======

Mean +- std dev: [pypy2_1] 2.16 ms +- 0.06 ms -> [pypy3utf8_1] 2.71 ms +- 0.08 ms: 1.26x slower (+26%)
Mean +- std dev: [pypy2_1] 2.16 ms +- 0.06 ms -> [pypy3utf8_2] 2.73 ms +- 0.09 ms: 1.26x slower (+26%)
Mean +- std dev: [pypy2_1] 2.16 ms +- 0.06 ms -> [pypy3utf8_3] 2.73 ms +- 0.07 ms: 1.26x slower (+26%)

html5lib
========

Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy3utf8_1] 58.0 ms +- 3.8 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy3utf8_2] 58.1 ms +- 3.9 ms: 1.03x faster (-3%)
Mean +- std dev: [pypy2_1] 59.7 ms +- 2.4 ms -> [pypy3utf8_3] 55.8 ms +- 3.6 ms: 1.07x faster (-7%)

json_dumps
==========

Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy3utf8_1] 7.76 ms +- 0.18 ms: 1.28x slower (+28%)
Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy3utf8_2] 7.84 ms +- 0.20 ms: 1.29x slower (+29%)
Mean +- std dev: [pypy2_1] 6.07 ms +- 0.06 ms -> [pypy3utf8_3] 7.86 ms +- 0.22 ms: 1.29x slower (+29%)

json_loads
==========

Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy3utf8_1] 27.0 us +- 0.2 us: 1.24x slower (+24%)
Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy3utf8_2] 26.9 us +- 0.1 us: 1.23x slower (+23%)
Mean +- std dev: [pypy2_1] 21.9 us +- 0.1 us -> [pypy3utf8_3] 26.9 us +- 0.2 us: 1.23x slower (+23%)

logging_format
==============

Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy3utf8_1] 6.22 us +- 0.16 us: 1.12x slower (+12%)
Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy3utf8_2] 6.27 us +- 0.19 us: 1.13x slower (+13%)
Mean +- std dev: [pypy2_1] 5.55 us +- 0.17 us -> [pypy3utf8_3] 6.22 us +- 0.18 us: 1.12x slower (+12%)

logging_silent
==============

Mean +- std dev: [pypy2_1] 0.18 ns +- 0.00 ns -> [pypy3utf8_1] 0.16 ns +- 0.00 ns: 1.08x faster (-7%)
Mean +- std dev: [pypy2_1] 0.18 ns +- 0.00 ns -> [pypy3utf8_2] 0.16 ns +- 0.00 ns: 1.08x faster (-7%)
Mean +- std dev: [pypy2_1] 0.18 ns +- 0.00 ns -> [pypy3utf8_3] 0.16 ns +- 0.00 ns: 1.08x faster (-7%)

logging_simple
==============

Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy3utf8_1] 4.98 us +- 0.06 us: 1.50x slower (+50%)
Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy3utf8_2] 4.98 us +- 0.07 us: 1.50x slower (+50%)
Mean +- std dev: [pypy2_1] 3.32 us +- 0.08 us -> [pypy3utf8_3] 4.99 us +- 0.11 us: 1.50x slower (+50%)

meteor_contest
==============

Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy3utf8_1] 66.8 ms +- 1.4 ms: 1.05x slower (+5%)
Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy3utf8_2] 66.7 ms +- 1.5 ms: 1.05x slower (+5%)
Mean +- std dev: [pypy2_1] 63.5 ms +- 1.3 ms -> [pypy3utf8_3] 66.2 ms +- 0.8 ms: 1.04x slower (+4%)

nbody
=====

Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy3utf8_1] 28.5 ms +- 0.2 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy3utf8_2] 28.5 ms +- 0.2 ms: 1.01x faster (-1%)
Mean +- std dev: [pypy2_1] 28.8 ms +- 0.2 ms -> [pypy3utf8_3] 28.6 ms +- 0.3 ms: 1.01x faster (-1%)

nqueens
=======

Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy3utf8_1] 31.9 ms +- 0.3 ms: 1.08x slower (+8%)
Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy3utf8_2] 32.2 ms +- 0.7 ms: 1.09x slower (+9%)
Mean +- std dev: [pypy2_1] 29.5 ms +- 0.2 ms -> [pypy3utf8_3] 31.9 ms +- 0.1 ms: 1.08x slower (+8%)

pathlib
=======

Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy3utf8_1] 17.3 ms +- 0.6 ms: 1.58x faster (-37%)
Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy3utf8_2] 17.5 ms +- 0.6 ms: 1.56x faster (-36%)
Mean +- std dev: [pypy2_1] 27.2 ms +- 1.0 ms -> [pypy3utf8_3] 17.4 ms +- 0.6 ms: 1.57x faster (-36%)

pickle
======

Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy3utf8_1] 93.1 us +- 3.1 us: 1.72x slower (+72%)
Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy3utf8_2] 93.3 us +- 2.8 us: 1.72x slower (+72%)
Mean +- std dev: [pypy2_1] 54.2 us +- 1.0 us -> [pypy3utf8_3] 93.8 us +- 4.6 us: 1.73x slower (+73%)

pickle_dict
===========

Mean +- std dev: [pypy2_1] 240 us +- 4 us -> [pypy3utf8_1] 516 us +- 16 us: 2.15x slower (+115%)
Mean +- std dev: [pypy2_1] 240 us +- 4 us -> [pypy3utf8_2] 519 us +- 14 us: 2.16x slower (+116%)
Mean +- std dev: [pypy2_1] 240 us +- 4 us -> [pypy3utf8_3] 517 us +- 17 us: 2.15x slower (+115%)

pickle_list
===========

Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy3utf8_1] 57.8 us +- 1.3 us: 1.73x slower (+73%)
Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy3utf8_2] 58.0 us +- 1.4 us: 1.74x slower (+74%)
Mean +- std dev: [pypy2_1] 33.4 us +- 0.6 us -> [pypy3utf8_3] 58.4 us +- 1.5 us: 1.75x slower (+75%)

pickle_pure_python
==================

Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy3utf8_1] 93.4 us +- 3.1 us: 1.72x slower (+72%)
Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy3utf8_2] 93.0 us +- 3.1 us: 1.72x slower (+72%)
Mean +- std dev: [pypy2_1] 54.1 us +- 0.9 us -> [pypy3utf8_3] 93.3 us +- 3.3 us: 1.72x slower (+72%)

pidigits
========

Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy3utf8_1] 245 ms +- 4 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy3utf8_2] 245 ms +- 5 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 242 ms +- 3 ms -> [pypy3utf8_3] 243 ms +- 3 ms: 1.00x slower (+0%)
Not significant!

python_startup
==============

Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy3utf8_1] 43.4 ms +- 1.0 ms: 1.97x slower (+97%)
Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy3utf8_2] 43.5 ms +- 1.1 ms: 1.97x slower (+97%)
Mean +- std dev: [pypy2_1] 22.0 ms +- 1.4 ms -> [pypy3utf8_3] 43.2 ms +- 1.2 ms: 1.96x slower (+96%)

python_startup_no_site
======================

Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy3utf8_1] 27.2 ms +- 1.3 ms: 1.35x slower (+35%)
Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy3utf8_2] 27.5 ms +- 1.3 ms: 1.37x slower (+37%)
Mean +- std dev: [pypy2_1] 20.1 ms +- 1.3 ms -> [pypy3utf8_3] 27.6 ms +- 1.3 ms: 1.38x slower (+38%)

raytrace
========

Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy3utf8_1] 16.2 ms +- 0.1 ms: 1.13x slower (+13%)
Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy3utf8_2] 16.3 ms +- 0.3 ms: 1.14x slower (+14%)
Mean +- std dev: [pypy2_1] 14.4 ms +- 0.2 ms -> [pypy3utf8_3] 16.4 ms +- 0.3 ms: 1.14x slower (+14%)

regex_compile
=============

Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy3utf8_1] 60.0 ms +- 2.3 ms: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy3utf8_2] 60.1 ms +- 1.9 ms: 1.04x faster (-4%)
Mean +- std dev: [pypy2_1] 62.7 ms +- 1.7 ms -> [pypy3utf8_3] 59.5 ms +- 1.8 ms: 1.05x faster (-5%)

regex_effbot
============

Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy3utf8_1] 3.52 ms +- 0.07 ms: 1.39x slower (+39%)
Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy3utf8_2] 3.49 ms +- 0.02 ms: 1.38x slower (+38%)
Mean +- std dev: [pypy2_1] 2.53 ms +- 0.02 ms -> [pypy3utf8_3] 3.48 ms +- 0.03 ms: 1.38x slower (+38%)

regex_v8
========

Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy3utf8_1] 30.6 ms +- 0.4 ms: 1.48x slower (+48%)
Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy3utf8_2] 30.4 ms +- 0.2 ms: 1.46x slower (+46%)
Mean +- std dev: [pypy2_1] 20.8 ms +- 0.6 ms -> [pypy3utf8_3] 30.4 ms +- 0.2 ms: 1.47x slower (+47%)

richards
========

Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy3utf8_1] 5.07 ms +- 0.05 ms: 1.17x faster (-14%)
Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy3utf8_2] 5.64 ms +- 0.13 ms: 1.05x faster (-5%)
Mean +- std dev: [pypy2_1] 5.91 ms +- 0.17 ms -> [pypy3utf8_3] 5.67 ms +- 0.11 ms: 1.04x faster (-4%)

scimark_fft
===========

Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy3utf8_1] 10.1 ms +- 0.1 ms: 1.07x faster (-6%)
Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy3utf8_2] 10.2 ms +- 0.1 ms: 1.06x faster (-6%)
Mean +- std dev: [pypy2_1] 10.8 ms +- 0.1 ms -> [pypy3utf8_3] 10.1 ms +- 0.1 ms: 1.07x faster (-6%)

scimark_lu
==========

Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy3utf8_1] 1.95 ms +- 0.03 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy3utf8_2] 1.95 ms +- 0.00 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 1.94 ms +- 0.02 ms -> [pypy3utf8_3] 1.96 ms +- 0.03 ms: 1.01x slower (+1%)

scimark_monte_carlo
===================

Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy3utf8_1] 3.30 ms +- 0.04 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy3utf8_2] 3.28 ms +- 0.01 ms: 1.01x slower (+1%)
Mean +- std dev: [pypy2_1] 3.25 ms +- 0.01 ms -> [pypy3utf8_3] 3.28 ms +- 0.01 ms: 1.01x slower (+1%)

scimark_sor
===========

Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy3utf8_1] 1.12 ms +- 0.03 ms: 1.05x slower (+5%)
Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy3utf8_2] 1.12 ms +- 0.02 ms: 1.04x slower (+4%)
Mean +- std dev: [pypy2_1] 1.07 ms +- 0.02 ms -> [pypy3utf8_3] 1.10 ms +- 0.02 ms: 1.03x slower (+3%)

scimark_sparse_mat_mult
=======================

Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy3utf8_1] 158 us +- 1 us: 1.05x faster (-4%)
Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy3utf8_2] 158 us +- 1 us: 1.05x faster (-4%)
Mean +- std dev: [pypy2_1] 166 us +- 2 us -> [pypy3utf8_3] 158 us +- 1 us: 1.05x faster (-4%)

spectral_norm
=============

Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy3utf8_1] 7.04 ms +- 0.03 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy3utf8_2] 7.05 ms +- 0.02 ms: 1.02x slower (+2%)
Mean +- std dev: [pypy2_1] 6.92 ms +- 0.06 ms -> [pypy3utf8_3] 7.23 ms +- 0.43 ms: 1.04x slower (+4%)

sqlalchemy_declarative
======================

Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy3utf8_1] 207 ms +- 11 ms: 1.15x slower (+15%)
Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy3utf8_2] 203 ms +- 11 ms: 1.13x slower (+13%)
Mean +- std dev: [pypy2_1] 180 ms +- 10 ms -> [pypy3utf8_3] 203 ms +- 11 ms: 1.13x slower (+13%)

sqlite_synth
============

Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy3utf8_1] 5.02 us +- 0.08 us: 1.13x slower (+13%)
Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy3utf8_2] 5.05 us +- 0.12 us: 1.13x slower (+13%)
Mean +- std dev: [pypy2_1] 4.46 us +- 0.08 us -> [pypy3utf8_3] 5.05 us +- 0.12 us: 1.13x slower (+13%)

sympy_expand
============

Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy3utf8_1] 271 ms +- 3 ms: 1.15x slower (+15%)
Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy3utf8_2] 269 ms +- 3 ms: 1.14x slower (+14%)
Mean +- std dev: [pypy2_1] 236 ms +- 3 ms -> [pypy3utf8_3] 271 ms +- 4 ms: 1.15x slower (+15%)

sympy_integrate
===============

Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy3utf8_1] 52.0 ms +- 5.0 ms: 1.37x slower (+37%)
Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy3utf8_2] 58.9 ms +- 5.0 ms: 1.55x slower (+55%)
Mean +- std dev: [pypy2_1] 38.0 ms +- 5.7 ms -> [pypy3utf8_3] 111 ms +- 11 ms: 2.91x slower (+191%)

sympy_sum
=========

Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy3utf8_1] 157 ms +- 8 ms: 1.24x slower (+24%)
Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy3utf8_2] 148 ms +- 6 ms: 1.16x slower (+16%)
Mean +- std dev: [pypy2_1] 127 ms +- 7 ms -> [pypy3utf8_3] 150 ms +- 5 ms: 1.18x slower (+18%)

sympy_str
=========

Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy3utf8_1] 158 ms +- 7 ms: 1.36x slower (+36%)
Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy3utf8_2] 146 ms +- 7 ms: 1.25x slower (+25%)
Mean +- std dev: [pypy2_1] 116 ms +- 5 ms -> [pypy3utf8_3] 149 ms +- 5 ms: 1.28x slower (+28%)

telco
=====

Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy3utf8_1] 93.6 ms +- 4.1 ms: 4.97x slower (+397%)
Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy3utf8_2] 94.2 ms +- 4.3 ms: 5.00x slower (+400%)
Mean +- std dev: [pypy2_1] 18.8 ms +- 0.4 ms -> [pypy3utf8_3] 94.9 ms +- 4.8 ms: 5.04x slower (+404%)

tornado_http
============

Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy3utf8_1] 264 ms +- 14 ms: 1.11x slower (+11%)
Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy3utf8_2] 268 ms +- 15 ms: 1.13x slower (+13%)
Mean +- std dev: [pypy2_1] 237 ms +- 9 ms -> [pypy3utf8_3] 273 ms +- 15 ms: 1.15x slower (+15%)

unpack_sequence
===============

Mean +- std dev: [pypy2_1] 182 ns +- 9 ns -> [pypy3utf8_1] 171 ns +- 4 ns: 1.06x faster (-6%)
Mean +- std dev: [pypy2_1] 182 ns +- 9 ns -> [pypy3utf8_2] 172 ns +- 6 ns: 1.06x faster (-5%)
Mean +- std dev: [pypy2_1] 182 ns +- 9 ns -> [pypy3utf8_3] 170 ns +- 5 ns: 1.07x faster (-6%)

unpickle
========

Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy3utf8_1] 64.5 us +- 1.3 us: 1.36x slower (+36%)
Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy3utf8_2] 64.4 us +- 1.1 us: 1.36x slower (+36%)
Mean +- std dev: [pypy2_1] 47.4 us +- 0.4 us -> [pypy3utf8_3] 64.7 us +- 1.6 us: 1.36x slower (+36%)

unpickle_list
=============

Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy3utf8_1] 23.6 us +- 0.5 us: 1.32x slower (+32%)
Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy3utf8_2] 23.5 us +- 0.5 us: 1.31x slower (+31%)
Mean +- std dev: [pypy2_1] 17.9 us +- 0.2 us -> [pypy3utf8_3] 23.8 us +- 0.7 us: 1.33x slower (+33%)

unpickle_pure_python
====================

Mean +- std dev: [pypy2_1] 47.5 us +- 0.9 us -> [pypy3utf8_1] 64.4 us +- 1.4 us: 1.36x slower (+36%)
Mean +- std dev: [pypy2_1] 47.5 us +- 0.9 us -> [pypy3utf8_2] 65.1 us +- 1.6 us: 1.37x slower (+37%)
Mean +- std dev: [pypy2_1] 47.5 us +- 0.9 us -> [pypy3utf8_3] 64.4 us +- 1.3 us: 1.36x slower (+36%)
Benchmark hidden because not significant (1): regex_dna
Ignored benchmarks (8) of pypy2_1.json: hg_startup, mako, pyflate, spambayes, xml_etree_generate, xml_etree_iterparse, xml_etree_parse, xml_etree_process
Ignored benchmarks (4) of pypy3utf8_1.json: xml_etree_pure_python_generate, xml_etree_pure_python_iterparse, xml_etree_pure_python_parse, xml_etree_pure_python_process
Ignored benchmarks (4) of pypy3utf8_2.json: xml_etree_pure_python_generate, xml_etree_pure_python_iterparse, xml_etree_pure_python_parse, xml_etree_pure_python_process
Ignored benchmarks (4) of pypy3utf8_3.json: xml_etree_pure_python_generate, xml_etree_pure_python_iterparse, xml_etree_pure_python_parse, xml_etree_pure_python_process