mattip

$ grep -a 'build/testenv/site-packages/numpy' ../test.out |grep 'test_[a-zA-Z_]*\.py' |cut -f10-12 -d'/' |cut -f1 -d '"' | sort | uniq -c | sort -n -r
      7 core/tests/test_multiarray.py
      4 core/tests/test_regression.py
      3 core/tests/test_records.py
      3 core/tests/test_nditer.py
      3 core/tests/test_defchararray.py
      2 core/tests/test_arrayprint.py
      1 tests/test_scripts.py
      1 tests/test_ctypeslib.py
      1 matrixlib/tests/test_defmatrix.py

mattip

UPDATE: this no longer works.

build, install numpy on pypy
copy pkg_resources, numpy-1.*, easy-install.pth from pypy/site-packages to /tmp/numpy
in pypy/module/cpyext/api.py change all 'cpyexttest' to 'PyPy'
then run

python pypy/bin/pyinteractive.py --withmod-struct --withmod-binascii --withmod-zipimport --withmod-_socket --withmod-cpyext --withmod-_cffi_backend --withmod-_rawffi --withmod-signal -c "import sys; sys.path.append('/tmp/numpy'); import numpy as np"

pypy startup is about 35 secs

mattip

http://www.sevenforums.com/windows-updates-activation/159323-code-8024402f-windows-update.html

mattip

Windows, test run requires __580__ seconds

> python pytest.py rpython\translator\c\test\test_typed.py --duration=10                                         
[platform:msg] Set platform with 'host' cc=None, using cc='cl.exe', version=90                                   
============================= test session starts =============================                                  
platform win32 -- Python 2.7.13, pytest-2.9.2, py-1.4.29, pluggy-0.3.1                                           
pytest-2.9.2 from D:\pypy_stuff\pypy\pytest.pyc                                                                  
rootdir: D:\pypy_stuff\pypy\rpython, inifile: pytest.ini                                                         
plugins: profiling-1.2.6                                                                                         
collected 71 items                                                                                               

mattip

With pandas HEAD, numpy refactor-updateifcopy, pypy cpyext-add_newdoc:

$(ulimit -v 5000000; p=../pypy-latest/bin/pypy; export PYTHONHASHSEED=$($p -c 'import random; print(random.randint(1, 4294967295))'); $p -mpytest pandas -n 4)

bottom line, four xdist tests in parallel
267 failed, 9087 passed, 1631 skipped, 6 xfailed in 1036.08 seconds

$ grep -a '\(^E *[A-Z][a-zA-Z]*Error:\)\|\(^AssertionError$\)\|\(^E *MemoryError\)' ../test_pandas.txt |cut -c 5- |cut -f1,2 -d: | sed -e's/ */ /' | sort |uniq -c |sort -n -r
     58  TypeError: don't know how to convert scalar number to int
     54  ValueError: setting an array element with a sequence.

mattip

$ ../pypy-latest/bin/pypy runtests.py 
Building, see build.log...
Build OK
Running unit tests for numpy
NumPy version 1.14.0.dev0+f6822b4
NumPy relaxed strides checking option: True
NumPy is installed in /home/matti/pypy_stuff/numpy/build/testenv/site-packages/numpy
Python version 2.7.13 (5e7bef99e9f5, May 31 2017, 22:00:12)[PyPy 5.9.0-alpha0 with GCC 6.2.0 20160901]
nose version 1.3.7

mattip

############ lambda: a: math.degrees #############
debug-capi:Python C/API function _test_ext_module_5403.t(fun,fun_extra_args=())
debug-capi:int a=:output,hidden,scalar
debug-capi:a=0
debug-capi:fun=>cb_fun_in_t__user__routines:input,required,callback
debug-capi:create_cb_arglist
debug-capi:create_cb_arglist:maxnofargs(-nofoptargs),tot,opt,ext,siz,nofargs=0(-0),1,0,1,1,0
debug-capi:create_cb_arglist-end
debug-capi:Assuming 0 arguments; at most 0(-0) is expected.
debug-capi:for fun=NULL

mattip

running with    "pypy test_memory 10" -> 77  MB retained when using range()
running with "cpython test_memory 10" -> 0.6 MB retained when using range()

mattip

grep -a '\(^E *[A-Z][a-zA-Z]*Error:\)\|\(^AssertionError$\)\|\(^E *MemoryError\)' ../test_pandas.txt |cut -c 5- |cut -f1,2 -d: | sed -e's/ */ /' | sort |uniq -c |sort -n -r
     20  TypeError: sys.getsizeof() is not implemented on PyPy.
      8  SystemError: An exception was set, but function returned a value
      6  AssertionError: Attributes are different
      4  SystemError: Bad internal call!
      4  AttributeError: 'str' object has no attribute '__sizeof__'
      4  AssertionError: numpy array are different
      3  PicklingError: Can't pickle <type 'pandas._libs.sparse.BlockIndex'>
      2  SettingWithCopyError: 
      2  OperationalError: database table is locked

mattip

$ grep -a '\(^E *[A-Z][a-zA-Z]*Error:\)\|\(^E *AssertionError$\)\|\(^E *MemoryError\)\|\(^E *Bad\)\|\(^E *Failed:\)' ../test_pandas.txt |cut -c 5- |cut -f1,2 -d: | sed -e's/ */ /' | sort |uniq -c |sort -n -r 
      2  OperationalError: database table is locked
      2  Failed: DID NOT RAISE <type 'exceptions.Exception'>
      2  BadZipfile: File is not a zip file
      1  ValueError: ('year must be in 1..9999', 0)
      1  TypeError: expected a readable buffer object
      1  SettingWithCopyError: 
      1  BadMove: testing
      1  BadMove: test
      1  AssertionError: TypeError not raised.