Comparing PyPy 2.1 (2.7.3) against PyPy3-beta 1 (3.2.3) using CPython benchmarks

gistfile1.txt

$ pypy-2.1/bin/pypy --version
Python 2.7.3 (480845e6b1dd, Jul 31 2013, 09:57:07)
[PyPy 2.1.0 with GCC 4.6.3]

 $ pypy3-2.1-beta1-linux64/bin/pypy --version
Python 3.2.3 (d63636b30cc0, Jul 30 2013, 07:02:17)
[PyPy 2.1.0-beta1 with GCC 4.6.3]

~/projects/pypy-2.1/bin/pypy perf.py --fast -b 2n3,threading,-fastunpickle,-fastpickle ~/projects/pypy-2.1/bin/pypy ~/projects/pypy3-2.1-beta1-linux64/bin/pypy > 	~/projects/results.txt

Running call_method...
Running call_method_slots...
Running call_method_unknown...
Running call_simple...
Running chaos...
Running django_v2...
Running fannkuch...
Running float...
Running formatted_logging...
Running go...
Running iterative_count...
Running json_dump_v2...
Running json_load...
Running meteor_contest...
Running nbody...
Running normal_startup...
Running nqueens...
Running pathlib...
Running pidigits...
Running raytrace...
Running regex_compile...
Running regex_effbot...
Running regex_v8...
Running richards...
Running silent_logging...
Running simple_logging...
Running spectral_norm...
Running startup_nosite...
Running telco...
Running threaded_count...
Running unpack_sequence...

Report on Linux richard-laptop 3.5.0-17-generic #28-Ubuntu SMP Tue Oct 9 19:31:23 UTC 2012 x86_64 x86_64
Total CPU cores: 2

### call_method ###
Min: 0.020182 -> 0.023920: 1.19x slower
Avg: 0.022950 -> 0.027883: 1.21x slower
Significant (t=-2.53)
Stddev: 0.00500 -> 0.00568: 1.1356x larger

### call_method_slots ###
Min: 0.019828 -> 0.023288: 1.17x slower
Avg: 0.022638 -> 0.026773: 1.18x slower
Significant (t=-2.14)
Stddev: 0.00503 -> 0.00553: 1.0979x larger

### call_simple ###
Min: 0.019689 -> 0.144544: 7.34x slower
Avg: 0.022389 -> 0.151247: 6.76x slower
Significant (t=-57.63)
Stddev: 0.00402 -> 0.00767: 1.9054x larger

### chaos ###
Min: 0.015768 -> 1.082079: 68.63x slower
Avg: 0.070128 -> 1.118725: 15.95x slower
Significant (t=-18.59)
Stddev: 0.11466 -> 0.05254: 2.1824x smaller

### django_v2 ###
Min: 0.080481 -> 3.551487: 44.13x slower
Avg: 0.092426 -> 3.566983: 38.59x slower
Significant (t=-413.14)
Stddev: 0.01565 -> 0.01042: 1.5023x smaller

### fannkuch ###
Min: 0.233359 -> 0.513639: 2.20x slower
Avg: 0.260459 -> 0.553068: 2.12x slower
Significant (t=-6.99)
Stddev: 0.05937 -> 0.07235: 1.2186x larger

### formatted_logging ###
Min: 0.029355 -> 0.663547: 22.60x slower
Avg: 0.111561 -> 0.730922: 6.55x slower
Significant (t=-7.53)
Stddev: 0.14617 -> 0.11167: 1.3089x smaller

### go ###
Min: 0.527398 -> 3.331925: 6.32x slower
Avg: 0.608387 -> 3.392275: 5.58x slower
Significant (t=-58.91)
Stddev: 0.09641 -> 0.04325: 2.2290x smaller

### iterative_count ###
Min: 0.002874 -> 0.072460: 25.21x slower
Avg: 0.003159 -> 0.072897: 23.08x slower
Significant (t=-148.88)
Stddev: 0.00062 -> 0.00085: 1.3713x larger

### json_dump_v2 ###
Min: 4.839894 -> 44.219898: 9.14x slower
Avg: 5.009223 -> 44.424584: 8.87x slower
Significant (t=-246.18)
Stddev: 0.22533 -> 0.27821: 1.2347x larger

### json_load ###
Min: 1.868465 -> 7.543618: 4.04x slower
Avg: 1.982001 -> 7.630992: 3.85x slower
Significant (t=-43.98)
Stddev: 0.23090 -> 0.17078: 1.3521x smaller

### meteor_contest ###
Min: 0.154217 -> 1.851861: 12.01x slower
Avg: 0.179716 -> 1.871399: 10.41x slower
Significant (t=-73.79)
Stddev: 0.04747 -> 0.01935: 2.4532x smaller

### nbody ###
Min: 0.051845 -> 0.338484: 6.53x slower
Avg: 0.052160 -> 0.340830: 6.53x slower
Significant (t=-227.65)
Stddev: 0.00047 -> 0.00280: 5.9889x larger

### normal_startup ###
Min: 0.924151 -> 1.941646: 2.10x slower
Avg: 0.946998 -> 1.974203: 2.08x slower
Significant (t=-67.84)
Stddev: 0.01538 -> 0.03016: 1.9618x larger

### nqueens ###
Min: 0.088193 -> 1.603407: 18.18x slower
Avg: 0.097911 -> 1.613368: 16.48x slower
Significant (t=-253.81)
Stddev: 0.01139 -> 0.00697: 1.6329x smaller

### pathlib ###
Min: 0.029560 -> 0.431757: 14.61x slower
Avg: 0.041926 -> 0.453768: 10.82x slower
Significant (t=-34.86)
Stddev: 0.04802 -> 0.03440: 1.3957x smaller

### pidigits ###
Min: 0.439176 -> 0.459689: 1.05x slower
Avg: 0.443041 -> 0.462275: 1.04x slower
Significant (t=-13.43)
Stddev: 0.00233 -> 0.00220: 1.0595x smaller

### raytrace ###
Min: 0.046104 -> 1.558443: 33.80x slower
Avg: 0.052449 -> 1.581166: 30.15x slower
Significant (t=-143.03)
Stddev: 0.00715 -> 0.02280: 3.1903x larger

### regex_compile ###
Min: 0.385829 -> 2.254271: 5.84x slower
Avg: 0.933103 -> 2.658449: 2.85x slower
Significant (t=-5.42)
Stddev: 0.56421 -> 0.43331: 1.3021x smaller

### richards ###
Min: 0.007160 -> 0.298150: 41.64x slower
Avg: 0.010399 -> 0.309177: 29.73x slower
Significant (t=-70.76)
Stddev: 0.00628 -> 0.00705: 1.1227x larger

### simple_logging ###
Min: 0.028142 -> 0.598108: 21.25x slower
Avg: 0.106693 -> 0.660344: 6.19x slower
Significant (t=-6.74)
Stddev: 0.14155 -> 0.11709: 1.2089x smaller

### spectral_norm ###
Min: 0.025895 -> 0.349223: 13.49x slower
Avg: 0.039269 -> 0.362302: 9.23x slower
Significant (t=-20.49)
Stddev: 0.02369 -> 0.02611: 1.1021x larger

### startup_nosite ###
Min: 0.352939 -> 0.753363: 2.13x slower
Avg: 0.413081 -> 0.792769: 1.92x slower
Significant (t=-30.48)
Stddev: 0.03030 -> 0.02517: 1.2038x smaller

### telco ###
Min: 0.088005 -> 1.408088: 16.00x slower
Avg: 0.122408 -> 1.437690: 11.75x slower
Significant (t=-76.20)
Stddev: 0.03106 -> 0.02291: 1.3559x smaller

### threaded_count ###
Min: 0.011460 -> 0.081812: 7.14x slower
Avg: 0.015983 -> 0.083821: 5.24x slower
Significant (t=-33.12)
Stddev: 0.00349 -> 0.00296: 1.1793x smaller

The following not significant results are hidden, use -v to show them:
call_method_unknown, float, regex_effbot, regex_v8, silent_logging, unpack_sequence.