Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save ThomasHoffmann77/b6f61d58726b955a2386e325543c184f to your computer and use it in GitHub Desktop.
Save ThomasHoffmann77/b6f61d58726b955a2386e325543c184f to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/CuPy-13.0.0-foss-2023a-CUDA-12.1.1.eb (PR(s) #19664, #20128, #20203, #19684)
== 2024-03-25 12:18:43,440 easyblock.py:313 INFO This is EasyBuild 4.9.0 (framework: 4.9.0, easyblocks: 4.9.0) on host srv-mahamid-01.embl.de.
== 2024-03-25 12:18:43,440 easyblock.py:319 INFO This is easyblock PythonBundle from module easybuild.easyblocks.generic.pythonbundle (/g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/lib/python3.6/site-packages/easybuild/easyblocks/generic/pythonbundle.py)
== 2024-03-25 12:18:43,440 easyblock.py:1056 INFO Build dir set to /tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1
== 2024-03-25 12:18:43,440 easyblock.py:1113 INFO Software install dir set to /tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1
== 2024-03-25 12:18:43,440 easyblock.py:1118 INFO Module install dir set to /tmp/pyTME_test/REPO/znver2/modules/all
== 2024-03-25 12:18:43,440 easyblock.py:288 INFO Init completed for application name CuPy version 13.0.0
== 2024-03-25 12:18:43,440 pythonbundle.py:73 INFO Detection of downloaded extension dependencies is enabled
== 2024-03-25 12:18:43,440 pythonbundle.py:75 INFO exts_default_options: {'source_urls': ['https://pypi.python.org/packages/source/%(nameletterlower)s/%(namelower)s'], 'buildcmd': None, 'check_ldshared': None, 'download_dep_fail': True, 'install_src': None, 'install_target': 'install', 'pip_ignore_installed': True, 'pip_no_index': None, 'req_py_majver': None, 'req_py_minver': None, 'sanity_pip_check': True, 'runtest': True, 'testinstall': False, 'unpack_sources': None, 'unversioned_packages': [], 'use_pip': True, 'use_pip_editable': False, 'use_pip_extras': None, 'use_pip_for_deps': False, 'use_pip_requirement': False, 'zipped_egg': False, 'options': {}}
== 2024-03-25 12:18:43,441 easyblock.py:4226 INFO Obtained application instance of for CuPy (easyblock: PythonBundle)
== 2024-03-25 12:18:43,441 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,441 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,441 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,441 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,442 one.py:180 INFO Skipping reformatting value for parameter 'toolchain'
== 2024-03-25 12:18:43,443 filetools.py:1911 INFO Creating directory /tmp/eb-3_uwp29_/reprod_20240325121843_916279 (parents: True, set_gid: False, sticky: False)
== 2024-03-25 12:18:43,443 easyblock.py:4480 INFO Dumped easyconfig instance to /tmp/eb-3_uwp29_/reprod_20240325121843_916279/CuPy-13.0.0-foss-2023a-CUDA-12.1.1.eb
== 2024-03-25 12:18:43,443 filetools.py:1911 INFO Creating directory /tmp/eb-3_uwp29_/reprod_20240325121843_916279/easyblocks (parents: True, set_gid: False, sticky: False)
== 2024-03-25 12:18:43,444 filetools.py:2424 INFO /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/lib/python3.6/site-packages/easybuild/easyblocks/generic/pythonbundle.py copied to /tmp/eb-3_uwp29_/reprod_20240325121843_916279/easyblocks/pythonbundle.py
== 2024-03-25 12:18:43,444 easyblock.py:4460 INFO Dumped easyblock pythonbundle.py required for reproduction to /tmp/eb-3_uwp29_/reprod_20240325121843_916279/easyblocks
== 2024-03-25 12:18:43,445 filetools.py:2424 INFO /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/lib/python3.6/site-packages/easybuild/easyblocks/generic/bundle.py copied to /tmp/eb-3_uwp29_/reprod_20240325121843_916279/easyblocks/bundle.py
== 2024-03-25 12:18:43,445 easyblock.py:4460 INFO Dumped easyblock bundle.py required for reproduction to /tmp/eb-3_uwp29_/reprod_20240325121843_916279/easyblocks
== 2024-03-25 12:18:43,445 easyblock.py:2231 INFO Number of iterations to perform for central part of installation procedure: 1
== 2024-03-25 12:18:43,445 build_log.py:267 INFO building and installing CuPy/13.0.0-foss-2023a-CUDA-12.1.1...
== 2024-03-25 12:18:43,445 filetools.py:2004 INFO Lock /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock does not exist
== 2024-03-25 12:18:43,445 filetools.py:1945 INFO Creating lock at /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock...
== 2024-03-25 12:18:43,445 filetools.py:1911 INFO Creating directory /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock (parents: True, set_gid: False, sticky: False)
== 2024-03-25 12:18:43,445 filetools.py:1954 INFO Lock created: /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock
== 2024-03-25 12:18:43,445 build_log.py:267 INFO fetching files...
== 2024-03-25 12:18:43,445 easyblock.py:3948 INFO Starting fetch step
== 2024-03-25 12:18:43,445 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,446 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,446 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,446 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', builddir='/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', installdir='/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,446 easyblock.py:3956 INFO Running method fetch_step part of step fetch
== 2024-03-25 12:18:43,446 easyblock.py:2353 WARNING Easyconfig does not specify an EasyBuild-version (key 'easybuild_version')! Assuming the latest version
== 2024-03-25 12:18:43,446 easyconfig.py:2034 WARNING Unable to resolve template value CUPY_NUM_BUILD_JOBS=%(parallel)s EB_CCC="%(cuda_cc_cmake)s" with dict {'arch': 'x86_64', 'sysroot': '', 'nameletter': 'C', 'toolchain_name': 'foss', 'toolchain_version': '2023a', 'version_major': '13', 'version_minor': '0', 'version_major_minor': '13.0', 'pyver': '3.11.3', 'pymajver': '3', 'pyminver': '11', 'pyshortver': '3.11', 'cudaver': '12.1.1', 'cudamajver': '12', 'cudaminver': '1', 'cudashortver': '12.1', 'bitbucket_account': 'cupy', 'github_account': 'cupy', 'name': 'CuPy', 'version': '13.0.0', 'versionsuffix': '-CUDA-12.1.1', 'versionprefix': '', 'namelower': 'cupy', 'nameletterlower': 'c', 'cuda_compute_capabilities': '5.0,6.0,7.0,7.5,8.0,8.6,9.0', 'cuda_cc_space_sep': '5.0 6.0 7.0 7.5 8.0 8.6 9.0', 'cuda_cc_semicolon_sep': '5.0;6.0;7.0;7.5;8.0;8.6;9.0', 'cuda_cc_cmake': '50;60;70;75;80;86;90', 'cuda_sm_comma_sep': 'sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', 'cuda_sm_space_sep': 'sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', 'mpi_cmd_prefix': 'mpirun -n 1', 'module_name': 'CuPy/13.0.0-foss-2023a-CUDA-12.1.1', 'builddir': '/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', 'installdir': '/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', 'start_dir': 'None'}
== 2024-03-25 12:18:43,446 easyblock.py:2381 INFO no sources provided
== 2024-03-25 12:18:43,446 easyblock.py:2396 INFO no patches provided
== 2024-03-25 12:18:43,446 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for fastrlock-0.8.2.tar.gz: /tmp/eb-3_uwp29_/files_pr20203/c/CuPy
== 2024-03-25 12:18:43,446 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/bin/eb
== 2024-03-25 12:18:43,446 tools.py:287 INFO Also considering installation prefix /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0 (determined via path to 'eb' script)...
== 2024-03-25 12:18:43,447 easyblock.py:851 INFO Found file fastrlock-0.8.2.tar.gz at /tmp/pyTME_test/etc/sources/c/CuPy/extensions/fastrlock-0.8.2.tar.gz
== 2024-03-25 12:18:43,447 easyblock.py:679 INFO md5 checksum for /tmp/pyTME_test/etc/sources/c/CuPy/extensions/fastrlock-0.8.2.tar.gz: f58b54b004d2b51fb10247f978362bdd
== 2024-03-25 12:18:43,447 easyblock.py:679 INFO sha256 checksum for /tmp/pyTME_test/etc/sources/c/CuPy/extensions/fastrlock-0.8.2.tar.gz: 644ec9215cf9c4df8028d8511379a15d9c1af3e16d80e47f1b6fdc6ba118356a
== 2024-03-25 12:18:43,448 easyblock.py:685 INFO Checksum for extension source fastrlock-0.8.2.tar.gz verified
== 2024-03-25 12:18:43,448 easyblock.py:532 INFO Fetched extension patches: []
== 2024-03-25 12:18:43,448 easyconfig.py:2034 WARNING Unable to resolve template value CUPY_NUM_BUILD_JOBS=%(parallel)s EB_CCC="%(cuda_cc_cmake)s" with dict {'arch': 'x86_64', 'sysroot': '', 'nameletter': 'c', 'toolchain_name': 'foss', 'toolchain_version': '2023a', 'version_major': '13', 'version_minor': '0', 'version_major_minor': '13.0', 'pyver': '3.11.3', 'pymajver': '3', 'pyminver': '11', 'pyshortver': '3.11', 'cudaver': '12.1.1', 'cudamajver': '12', 'cudaminver': '1', 'cudashortver': '12.1', 'bitbucket_account': 'cupy', 'github_account': 'cupy', 'name': 'cupy', 'version': '13.0.0', 'versionsuffix': '-CUDA-12.1.1', 'versionprefix': '', 'namelower': 'cupy', 'nameletterlower': 'c', 'cuda_compute_capabilities': '5.0,6.0,7.0,7.5,8.0,8.6,9.0', 'cuda_cc_space_sep': '5.0 6.0 7.0 7.5 8.0 8.6 9.0', 'cuda_cc_semicolon_sep': '5.0;6.0;7.0;7.5;8.0;8.6;9.0', 'cuda_cc_cmake': '50;60;70;75;80;86;90', 'cuda_sm_comma_sep': 'sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', 'cuda_sm_space_sep': 'sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', 'mpi_cmd_prefix': 'mpirun -n 1', 'module_name': None, 'builddir': '/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', 'installdir': '/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', 'start_dir': 'None'}
== 2024-03-25 12:18:43,448 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for cupy-13.0.0.tar.gz: /tmp/eb-3_uwp29_/files_pr20203/c/CuPy
== 2024-03-25 12:18:43,449 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/bin/eb
== 2024-03-25 12:18:43,449 tools.py:287 INFO Also considering installation prefix /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0 (determined via path to 'eb' script)...
== 2024-03-25 12:18:43,449 easyblock.py:851 INFO Found file cupy-13.0.0.tar.gz at /tmp/pyTME_test/etc/sources/c/CuPy/extensions/cupy-13.0.0.tar.gz
== 2024-03-25 12:18:43,454 easyblock.py:679 INFO md5 checksum for /tmp/pyTME_test/etc/sources/c/CuPy/extensions/cupy-13.0.0.tar.gz: fb80d11542c2e3ac31223551d8447eb3
== 2024-03-25 12:18:43,457 easyblock.py:679 INFO sha256 checksum for /tmp/pyTME_test/etc/sources/c/CuPy/extensions/cupy-13.0.0.tar.gz: 2f04e7857f692a713360dc9c3b06709806ab8404fca39b5af9721c04a2979aae
== 2024-03-25 12:18:43,459 easyblock.py:685 INFO Checksum for extension source cupy-13.0.0.tar.gz verified
== 2024-03-25 12:18:43,459 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for cupy-13.0.0_cusparselt_0.6.0.patch: /tmp/eb-3_uwp29_/files_pr20203/c/CuPy
== 2024-03-25 12:18:43,459 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/bin/eb
== 2024-03-25 12:18:43,459 tools.py:287 INFO Also considering installation prefix /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0 (determined via path to 'eb' script)...
== 2024-03-25 12:18:43,459 easyblock.py:851 INFO Found file cupy-13.0.0_cusparselt_0.6.0.patch at /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_cusparselt_0.6.0.patch
== 2024-03-25 12:18:43,459 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for checksums.json: /tmp/eb-3_uwp29_/files_pr20203/c/CuPy
== 2024-03-25 12:18:43,459 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/bin/eb
== 2024-03-25 12:18:43,459 tools.py:287 INFO Also considering installation prefix /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0 (determined via path to 'eb' script)...
== 2024-03-25 12:18:43,460 easyblock.py:881 WARNING Couldn't find file checksums.json anywhere, and downloading it is disabled... Paths attempted (in order): /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/c/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/checksums.json, /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/easybuild/easyconfigs/c/CuPy/checksums.json, /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/easybuild/easyconfigs/CuPy/checksums.json, /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/easybuild/easyconfigs/checksums.json, /tmp/eb-3_uwp29_/files_pr19664/c/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr19664/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr19664/checksums.json, /tmp/eb-3_uwp29_/files_pr20128/c/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr20128/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr20128/checksums.json, /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr20203/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr20203/checksums.json, /tmp/eb-3_uwp29_/files_pr19684/c/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr19684/CuPy/checksums.json, /tmp/eb-3_uwp29_/files_pr19684/checksums.json, /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/easybuild/easyconfigs/c/CuPy/checksums.json, /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/easybuild/easyconfigs/CuPy/checksums.json, /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/easybuild/easyconfigs/checksums.json, /tmp/pyTME_test/etc/sources/c/CuPy/checksums.json, /tmp/pyTME_test/etc/sources/CuPy/checksums.json, /tmp/pyTME_test/etc/sources/checksums.json
== 2024-03-25 12:18:43,460 easyblock.py:810 INFO Considering directory in which easyconfig file is located when searching for cupy-13.0.0_eb_ccc.patch: /tmp/eb-3_uwp29_/files_pr20203/c/CuPy
== 2024-03-25 12:18:43,460 tools.py:273 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/bin/eb
== 2024-03-25 12:18:43,460 tools.py:287 INFO Also considering installation prefix /g/easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0 (determined via path to 'eb' script)...
== 2024-03-25 12:18:43,460 easyblock.py:851 INFO Found file cupy-13.0.0_eb_ccc.patch at /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_eb_ccc.patch
== 2024-03-25 12:18:43,460 easyblock.py:532 INFO Fetched extension patches: [{'name': 'cupy-13.0.0_cusparselt_0.6.0.patch', 'postinstall': False, 'path': '/tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_cusparselt_0.6.0.patch', 'checksum': None}, {'name': 'cupy-13.0.0_eb_ccc.patch', 'postinstall': False, 'path': '/tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_eb_ccc.patch', 'checksum': None}]
== 2024-03-25 12:18:43,460 easyblock.py:709 INFO md5 checksum for /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_cusparselt_0.6.0.patch: a361890ec4f79c15f338640b0a62d56a
== 2024-03-25 12:18:43,460 easyblock.py:709 INFO sha256 checksum for /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_cusparselt_0.6.0.patch: 09cb12d26e78079c50b06f17002bf54c66e5e4743b917c5a218d3fe90124d499
== 2024-03-25 12:18:43,460 easyblock.py:709 INFO md5 checksum for /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_eb_ccc.patch: 187557a3c2bb4db2b461fe65f3a8863e
== 2024-03-25 12:18:43,460 easyblock.py:709 INFO sha256 checksum for /tmp/eb-3_uwp29_/files_pr20203/c/CuPy/cupy-13.0.0_eb_ccc.patch: bfe8b46344759f58491f55418bd9c856d6f72d681ee5fef12820009f808d2db1
== 2024-03-25 12:18:43,460 easyblock.py:719 INFO Checksum for extension patch cupy-13.0.0_cusparselt_0.6.0.patch verified
== 2024-03-25 12:18:43,461 easyblock.py:719 INFO Checksum for extension patch cupy-13.0.0_eb_ccc.patch verified
== 2024-03-25 12:18:43,461 easyblock.py:2441 INFO Checking dirs that need to be created: ['/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', '/tmp/pyTME_test/REPO/znver2/modules/all/CuPy', '/tmp/pyTME_test/REPO/znver2/modules/lib/CuPy']
== 2024-03-25 12:18:43,461 build_log.py:267 INFO ... (took < 1 sec)
== 2024-03-25 12:18:43,461 build_log.py:267 INFO creating build dir, resetting environment...
== 2024-03-25 12:18:43,461 easyblock.py:3948 INFO Starting ready step
== 2024-03-25 12:18:43,461 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,461 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,461 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,461 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', builddir='/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', installdir='/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,461 easyblock.py:3956 INFO Running method check_readiness_step part of step ready
== 2024-03-25 12:18:43,461 easyblock.py:2250 INFO Setting parallelism: 32
== 2024-03-25 12:18:43,492 easyblock.py:2302 WARNING Loaded modules detected: ['EasyBuild/4.9.0']
== 2024-03-25 12:18:43,492 easyblock.py:3956 INFO Running method make_builddir part of step ready
== 2024-03-25 12:18:43,493 easyblock.py:1138 INFO Found old directory /tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1
== 2024-03-25 12:18:43,493 filetools.py:383 INFO Path /tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1 successfully removed.
== 2024-03-25 12:18:43,493 easyblock.py:1146 INFO Removed old directory /tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1
== 2024-03-25 12:18:43,493 filetools.py:1911 INFO Creating directory /tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1 (parents: True, set_gid: False, sticky: False)
== 2024-03-25 12:18:43,493 easyblock.py:3956 INFO Running method reset_env part of step ready
== 2024-03-25 12:18:43,493 easyblock.py:3956 INFO Running method handle_iterate_opts part of step ready
== 2024-03-25 12:18:43,493 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,493 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,494 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,494 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', builddir='/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', installdir='/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', parallel='32', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,494 build_log.py:267 INFO ... (took < 1 sec)
== 2024-03-25 12:18:43,494 build_log.py:267 INFO unpacking...
== 2024-03-25 12:18:43,494 easyblock.py:3948 INFO Starting source step
== 2024-03-25 12:18:43,494 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,494 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,494 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,494 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', builddir='/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', installdir='/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', parallel='32', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,494 easyblock.py:3956 INFO Running method checksum_step part of step source
== 2024-03-25 12:18:43,494 easyblock.py:3956 INFO Running method extract_step part of step source
== 2024-03-25 12:18:43,494 build_log.py:267 INFO ... (took < 1 sec)
== 2024-03-25 12:18:43,495 build_log.py:267 INFO patching...
== 2024-03-25 12:18:43,495 easyblock.py:3948 INFO Starting patch step
== 2024-03-25 12:18:43,495 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,495 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,495 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,495 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', builddir='/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', installdir='/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', parallel='32', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,495 easyblock.py:3956 INFO Running method patch_step part of step patch
== 2024-03-25 12:18:43,495 build_log.py:267 INFO ... (took < 1 sec)
== 2024-03-25 12:18:43,495 build_log.py:267 INFO preparing...
== 2024-03-25 12:18:43,495 easyblock.py:3948 INFO Starting prepare step
== 2024-03-25 12:18:43,495 easyconfig.py:1702 INFO Generating template values...
== 2024-03-25 12:18:43,495 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-03-25 12:18:43,495 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-03-25 12:18:43,496 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='cupy', builddir='/tmp/eb-build_thoffman/CuPy/13.0.0/foss-2023a-CUDA-12.1.1', cuda_cc_cmake='50;60;70;75;80;86;90', cuda_cc_semicolon_sep='5.0;6.0;7.0;7.5;8.0;8.6;9.0', cuda_cc_space_sep='5.0 6.0 7.0 7.5 8.0 8.6 9.0', cuda_compute_capabilities='5.0,6.0,7.0,7.5,8.0,8.6,9.0', cuda_sm_comma_sep='sm_50,sm_60,sm_70,sm_75,sm_80,sm_86,sm_90', cuda_sm_space_sep='sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='cupy', installdir='/tmp/pyTME_test/REPO/znver2/software/CuPy/13.0.0-foss-2023a-CUDA-12.1.1', module_name='CuPy/13.0.0-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='CuPy', nameletter='C', nameletterlower='c', namelower='cupy', parallel='32', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='13.0.0', version_major='13', version_major_minor='13.0', version_minor='0', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-03-25 12:18:43,496 easyblock.py:3956 INFO Running method prepare_step part of step prepare
== 2024-03-25 12:18:43,496 modules.py:626 INFO Checking whether hypothesis/6.82.0-GCCcore-12.3.0 exists...
== 2024-03-25 12:18:43,496 modules.py:631 INFO Module hypothesis/6.82.0-GCCcore-12.3.0 exists (found in list of available modules)
== 2024-03-25 12:18:43,496 modules.py:654 INFO Result for existence check of hypothesis/6.82.0-GCCcore-12.3.0 module: True
== 2024-03-25 12:18:43,496 modules.py:626 INFO Checking whether Python/3.11.3-GCCcore-12.3.0 exists...
== 2024-03-25 12:18:43,496 modules.py:631 INFO Module Python/3.11.3-GCCcore-12.3.0 exists (found in list of available modules)
== 2024-03-25 12:18:43,496 modules.py:654 INFO Result for existence check of Python/3.11.3-GCCcore-12.3.0 module: True
== 2024-03-25 12:18:43,497 modules.py:626 INFO Checking whether SciPy-bundle/2023.07-gfbf-2023a exists...
== 2024-03-25 12:18:43,497 modules.py:631 INFO Module SciPy-bundle/2023.07-gfbf-2023a exists (found in list of available modules)
== 2024-03-25 12:18:43,497 modules.py:654 INFO Result for existence check of SciPy-bundle/2023.07-gfbf-2023a module: True
== 2024-03-25 12:18:43,497 modules.py:626 INFO Checking whether CUDA/12.1.1 exists...
== 2024-03-25 12:18:43,497 modules.py:631 INFO Module CUDA/12.1.1 exists (found in list of available modules)
== 2024-03-25 12:18:43,497 modules.py:654 INFO Result for existence check of CUDA/12.1.1 module: True
== 2024-03-25 12:18:43,497 modules.py:626 INFO Checking whether cuDNN/8.9.2.26-CUDA-12.1.1 exists...
== 2024-03-25 12:18:43,497 modules.py:631 INFO Module cuDNN/8.9.2.26-CUDA-12.1.1 exists (found in list of available modules)
== 2024-03-25 12:18:43,497 modules.py:654 INFO Result for existence check of cuDNN/8.9.2.26-CUDA-12.1.1 module: True
== 2024-03-25 12:18:43,497 modules.py:626 INFO Checking whether NCCL/2.18.3-GCCcore-12.3.0-CUDA-12.1.1 exists...
== 2024-03-25 12:18:43,497 modules.py:631 INFO Module NCCL/2.18.3-GCCcore-12.3.0-CUDA-12.1.1 exists (found in list of available modules)
== 2024-03-25 12:18:43,497 modules.py:654 INFO Result for existence check of NCCL/2.18.3-GCCcore-12.3.0-CUDA-12.1.1 module: True
== 2024-03-25 12:18:43,497 modules.py:626 INFO Checking whether cuTENSOR/2.0.1.2-CUDA-12.1.1 exists...
== 2024-03-25 12:18:43,497 modules.py:634 INFO Module cuTENSOR/2.0.1.2-CUDA-12.1.1 not found in list of available modules, checking via 'module show'...
== 2024-03-25 12:18:43,668 modules.py:647 INFO Module cuTENSOR/2.0.1.2-CUDA-12.1.1 not found via module avail/show, checking whether it is a wrapper
== 2024-03-25 12:18:43,668 modules.py:654 INFO Result for existence check of cuTENSOR/2.0.1.2-CUDA-12.1.1 module: False
== 2024-03-25 12:18:43,668 modules.py:626 INFO Checking whether cuSPARSELt/0.6.0.6-CUDA-12.1.1 exists...
== 2024-03-25 12:18:43,669 modules.py:631 INFO Module cuSPARSELt/0.6.0.6-CUDA-12.1.1 exists (found in list of available modules)
== 2024-03-25 12:18:43,669 modules.py:654 INFO Result for existence check of cuSPARSELt/0.6.0.6-CUDA-12.1.1 module: True
== 2024-03-25 12:18:43,685 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/lib/python3.6/site-packages/easybuild/base/exceptions.py:126 in __init__): Missing modules for dependencies (use --robot?): cuTENSOR/2.0.1.2-CUDA-12.1.1 (at easybuild/x86_64/Rocky/8/rome/software/EasyBuild/4.9.0/lib/python3.6/site-packages/easybuild/tools/toolchain/toolchain.py:559 in _check_dependencies)
== 2024-03-25 12:18:43,685 build_log.py:267 INFO ... (took < 1 sec)
== 2024-03-25 12:18:43,685 filetools.py:2012 INFO Removing lock /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock...
== 2024-03-25 12:18:43,686 filetools.py:383 INFO Path /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock successfully removed.
== 2024-03-25 12:18:43,686 filetools.py:2016 INFO Lock removed: /tmp/pyTME_test/REPO/znver2/software/.locks/_tmp_pyTME_test_REPO_znver2_software_CuPy_13.0.0-foss-2023a-CUDA-12.1.1.lock
== 2024-03-25 12:18:43,686 easyblock.py:4283 WARNING build failed (first 300 chars): Missing modules for dependencies (use --robot?): cuTENSOR/2.0.1.2-CUDA-12.1.1
== 2024-03-25 12:18:43,686 easyblock.py:328 INFO Closing log for application name CuPy version 13.0.0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment