Last active
October 14, 2020 16:15
-
-
Save yuxuanzhuang/4918cd1b5d8d62de79eab9df40de4bb7 to your computer and use it in GitHub Desktop.
I can confirm it should be an OpenBlas
issue. For numpy
built with mkl
, the default num_of_thread will be 6 (the physical core number), so the oversubscribing won't be happening.
[{'filepath': '/home/scottzhuang/anaconda3/lib/libmkl_rt.so',
'prefix': 'libmkl_rt',
'user_api': 'blas',
'internal_api': 'mkl',
'version': '2020.0.0',
'num_threads': 6,
'threading_layer': 'intel'},
{'filepath': '/home/scottzhuang/anaconda3/lib/libiomp5.so',
'prefix': 'libiomp',
'user_api': 'openmp',
'internal_api': 'openmp',
'version': None,
'num_threads': 12}]
The problem now is, OpenBlas
always uses all hyperthreading in default, which the numerical code doesn't seem to benefit from (?), and also tend to cause the troubles mentioned above. I guess we should limit threads to the number of physical cores for all the MDAnalysis
code...before OpenBlas
changes its default.
Can you share your conclusions in the MDA issue MDAnalysis/mdanalysis#2975 for discussion so that other interested parties can also comment?
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This is just weird.
I suppose the conclusion is still that oversubscribing hurts performance.