Created
April 28, 2021 16:48
-
-
Save sassy-crick/49f13a2d2766c9edfbbea8b3f221f3c2 to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.1-foss-2020b.eb (PR #12347)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| == 2021-04-28 17:47:57,693 easyblock.py:283 INFO This is EasyBuild 4.3.4 (framework: 4.3.4, easyblocks: 4.3.4) on host gpu05.pri.rosalind2.alces.network. | |
| == 2021-04-28 17:47:57,693 easyblock.py:289 INFO This is easyblock EB_PyTorch from module easybuild.easyblocks.pytorch (/scratch/groups/celgene/software/software/EasyBuild/4.3.4/lib/python3.6/site-packages/easybuild/easyblocks/p/pytorch.py) | |
| == 2021-04-28 17:47:57,694 easyblock.py:925 INFO Build dir set to /dev/shm/build/PyTorch/1.8.1/foss-2020b | |
| == 2021-04-28 17:47:57,694 easyblock.py:985 INFO Software install dir set to /scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b | |
| == 2021-04-28 17:47:57,694 easyblock.py:990 INFO Module install dir set to /scratch/groups/celgene/software/modules/all | |
| == 2021-04-28 17:47:57,694 easyblock.py:268 INFO Init completed for application name PyTorch version 1.8.1 | |
| == 2021-04-28 17:47:57,694 pythonpackage.py:301 INFO Using default value for expected module name (lowercase software name): 'pytorch' | |
| == 2021-04-28 17:47:57,694 easyblock.py:3372 INFO Obtained application instance of for PyTorch (easyblock: None) | |
| == 2021-04-28 17:47:57,694 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:47:57,695 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:47:57,695 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:47:57,695 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:47:57,696 one.py:160 INFO Skipping reformatting value for parameter 'toolchain' | |
| == 2021-04-28 17:47:57,698 filetools.py:1709 INFO Creating directory /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291 (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:57,698 easyblock.py:3579 INFO Dumped easyconfig instance to /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291/PyTorch-1.8.1-foss-2020b.eb | |
| == 2021-04-28 17:47:57,699 filetools.py:1709 INFO Creating directory /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291/easyblocks (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:57,702 filetools.py:2220 INFO /scratch/groups/celgene/software/software/EasyBuild/4.3.4/lib/python3.6/site-packages/easybuild/easyblocks/generic/pythonpackage.py copied to /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291/easyblocks/pythonpackage.py | |
| == 2021-04-28 17:47:57,702 easyblock.py:3559 INFO Dumped easyblock pythonpackage.py required for reproduction to /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291/easyblocks | |
| == 2021-04-28 17:47:57,704 filetools.py:2220 INFO /scratch/groups/celgene/software/software/EasyBuild/4.3.4/lib/python3.6/site-packages/easybuild/easyblocks/p/pytorch.py copied to /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291/easyblocks/pytorch.py | |
| == 2021-04-28 17:47:57,704 easyblock.py:3559 INFO Dumped easyblock pytorch.py required for reproduction to /tmp/easybuild/eb-sgl13w1p/reprod_20210428174757_166291/easyblocks | |
| == 2021-04-28 17:47:57,704 easyblock.py:1774 INFO Number of iterations to perform for central part of installation procedure: 1 | |
| == 2021-04-28 17:47:57,704 build_log.py:265 INFO building and installing PyTorch/1.8.1-foss-2020b... | |
| == 2021-04-28 17:47:57,713 filetools.py:1802 INFO Lock /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock does not exist | |
| == 2021-04-28 17:47:57,713 filetools.py:1743 INFO Creating lock at /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock... | |
| == 2021-04-28 17:47:57,714 filetools.py:1709 INFO Creating directory /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:57,715 filetools.py:1752 INFO Lock created: /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock | |
| == 2021-04-28 17:47:57,715 build_log.py:265 INFO fetching files... | |
| == 2021-04-28 17:47:57,715 easyblock.py:3132 INFO Starting fetch step | |
| == 2021-04-28 17:47:57,715 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:47:57,715 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:47:57,715 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:47:57,715 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/build/PyTorch/1.8.1/foss-2020b', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', installdir='/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:47:57,715 easyblock.py:3138 INFO Running method fetch_step part of step fetch | |
| == 2021-04-28 17:47:57,715 easyblock.py:1883 WARNING Easyconfig does not specify an EasyBuild-version (key 'easybuild_version')! Assuming the latest version | |
| == 2021-04-28 17:47:57,716 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,716 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,717 easyblock.py:749 INFO Found file PyTorch-1.8.1.tar.gz at /scratch/groups/celgene/software/sources/p/PyTorch/PyTorch-1.8.1.tar.gz | |
| == 2021-04-28 17:47:57,719 easyblock.py:430 INFO Added sources: [{'name': 'PyTorch-1.8.1.tar.gz', 'path': '/scratch/groups/celgene/software/sources/p/PyTorch/PyTorch-1.8.1.tar.gz', 'cmd': None, 'checksum': None, 'finalpath': '/dev/shm/build/PyTorch/1.8.1/foss-2020b'}] | |
| == 2021-04-28 17:47:57,719 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,719 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,719 easyblock.py:749 INFO Found file PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch | |
| == 2021-04-28 17:47:57,719 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,719 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,719 easyblock.py:749 INFO Found file PyTorch-1.7.0_avoid-nan-in-test-torch.patch at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_avoid-nan-in-test-torch.patch | |
| == 2021-04-28 17:47:57,719 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,720 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,720 easyblock.py:749 INFO Found file PyTorch-1.7.0_increase-distributed-test-timeout.patch at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_increase-distributed-test-timeout.patch | |
| == 2021-04-28 17:47:57,720 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,720 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,720 easyblock.py:749 INFO Found file PyTorch-1.7.0_disable-dev-shm-test.patch at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch | |
| == 2021-04-28 17:47:57,720 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,720 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,720 easyblock.py:749 INFO Found file PyTorch-1.8.0_fix-noMKL-linear-algebra.patch at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_fix-noMKL-linear-algebra.patch | |
| == 2021-04-28 17:47:57,721 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,721 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,721 easyblock.py:749 INFO Found file PyTorch-1.8.0_correct-skip-tests-decorators.patch at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_correct-skip-tests-decorators.patch | |
| == 2021-04-28 17:47:57,721 easyblock.py:496 INFO Added patches: [{'name': 'PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch', 'path': '/tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch', 'checksum': 'a4208a46cd2098744daaba96cebb96cd91166f8fc616924315e05974bad80c67'}, {'name': 'PyTorch-1.7.0_avoid-nan-in-test-torch.patch', 'path': '/tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_avoid-nan-in-test-torch.patch', 'checksum': 'b899aa94d9e60f11ee75a706563312ccefa9cf432756c470caa8e623991c8f18'}, {'name': 'PyTorch-1.7.0_increase-distributed-test-timeout.patch', 'path': '/tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_increase-distributed-test-timeout.patch', 'checksum': '95abb468a35451fbd0f864ca843f6ad15ff8bfb909c3fd580f65859b26c9691c'}, {'name': 'PyTorch-1.7.0_disable-dev-shm-test.patch', 'path': '/tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch', 'checksum': '622cb1eaeadc06e13128a862d9946bcc1f1edd3d02b259c56a9aecc4d5406b8a'}, {'name': 'PyTorch-1.8.0_fix-noMKL-linear-algebra.patch', 'path': '/tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_fix-noMKL-linear-algebra.patch', 'checksum': 'a1ca9382b0eb333090536633092bab6fa281d26b491bf7b1849117f68ab0730c'}, {'name': 'PyTorch-1.8.0_correct-skip-tests-decorators.patch', 'path': '/tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_correct-skip-tests-decorators.patch', 'checksum': '4b2fe7616217dd6fd12d667cb1439dde58f84bf234fbf3e6026c4665fc697a2e'}] | |
| == 2021-04-28 17:47:57,869 easyblock.py:1934 INFO md5 checksum for /scratch/groups/celgene/software/sources/p/PyTorch/PyTorch-1.8.1.tar.gz: b09ac61ea3d1107a915e066ea6a157cb | |
| == 2021-04-28 17:47:57,938 easyblock.py:1934 INFO sha256 checksum for /scratch/groups/celgene/software/sources/p/PyTorch/PyTorch-1.8.1.tar.gz: 44602d9f685d0fd8675ba64c5f361327ad72f49ac4ab1473ced33c76d6520d2a | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO md5 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch: 3f61f67b1a4142d99ae1f5e9269bf769 | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO sha256 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch: a4208a46cd2098744daaba96cebb96cd91166f8fc616924315e05974bad80c67 | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO md5 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_avoid-nan-in-test-torch.patch: b1befb264e0630c2252b7fd92b8150e7 | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO sha256 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_avoid-nan-in-test-torch.patch: b899aa94d9e60f11ee75a706563312ccefa9cf432756c470caa8e623991c8f18 | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO md5 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_increase-distributed-test-timeout.patch: 38bb91f95e27bfc3a0527d2ebbb3bddf | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO sha256 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_increase-distributed-test-timeout.patch: 95abb468a35451fbd0f864ca843f6ad15ff8bfb909c3fd580f65859b26c9691c | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO md5 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch: 919c3312795aec423708a09f1b891c99 | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO sha256 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch: 622cb1eaeadc06e13128a862d9946bcc1f1edd3d02b259c56a9aecc4d5406b8a | |
| == 2021-04-28 17:47:57,939 easyblock.py:1934 INFO md5 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_fix-noMKL-linear-algebra.patch: b5a66203c2a00dff3c2f66f997acd983 | |
| == 2021-04-28 17:47:57,940 easyblock.py:1934 INFO sha256 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_fix-noMKL-linear-algebra.patch: a1ca9382b0eb333090536633092bab6fa281d26b491bf7b1849117f68ab0730c | |
| == 2021-04-28 17:47:57,940 easyblock.py:1934 INFO md5 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_correct-skip-tests-decorators.patch: f5abe81cc0375166ea114e38c0d5f74b | |
| == 2021-04-28 17:47:57,940 easyblock.py:1934 INFO sha256 checksum for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_correct-skip-tests-decorators.patch: 4b2fe7616217dd6fd12d667cb1439dde58f84bf234fbf3e6026c4665fc697a2e | |
| == 2021-04-28 17:47:57,940 easyblock.py:1969 INFO Checking dirs that need to be created: ['/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', '/scratch/groups/celgene/software/modules/all/PyTorch', '/scratch/groups/celgene/software/modules/devel/PyTorch'] | |
| == 2021-04-28 17:47:57,941 filetools.py:1709 INFO Creating directory /scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:57,945 filetools.py:1709 INFO Creating directory /scratch/groups/celgene/software/modules/all/PyTorch (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:57,948 filetools.py:1709 INFO Creating directory /scratch/groups/celgene/software/modules/devel/PyTorch (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:57,950 tools.py:270 INFO Found location to 'eb' script via $EB_SCRIPT_PATH: /scratch/groups/celgene/software/software/EasyBuild/4.3.4/bin/eb | |
| == 2021-04-28 17:47:57,950 tools.py:284 INFO Also considering installation prefix /scratch/groups/celgene/software/software/EasyBuild/4.3.4 (determined via path to 'eb' script)... | |
| == 2021-04-28 17:47:57,950 easyblock.py:749 INFO Found file PyTorch-check-cpp-extension.py at /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-check-cpp-extension.py | |
| == 2021-04-28 17:47:57,950 build_log.py:265 INFO creating build dir, resetting environment... | |
| == 2021-04-28 17:47:57,951 easyblock.py:3132 INFO Starting ready step | |
| == 2021-04-28 17:47:57,951 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:47:57,951 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:47:57,951 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:47:57,951 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/build/PyTorch/1.8.1/foss-2020b', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', installdir='/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:47:57,951 easyblock.py:3138 INFO Running method check_readiness_step part of step ready | |
| == 2021-04-28 17:47:57,951 easyblock.py:1793 INFO Setting parallelism: 2 | |
| == 2021-04-28 17:47:58,057 easyblock.py:1832 WARNING Loaded modules detected: ['services/s3cmd', 'null', 'use.own', 'utilities/use.dev', 'EasyBuild/4.3.4'] | |
| == 2021-04-28 17:47:58,059 easyblock.py:3138 INFO Running method make_builddir part of step ready | |
| == 2021-04-28 17:47:58,060 filetools.py:1709 INFO Creating directory /dev/shm/build/PyTorch/1.8.1/foss-2020b (parents: True, set_gid: False, sticky: False) | |
| == 2021-04-28 17:47:58,060 easyblock.py:3138 INFO Running method reset_env part of step ready | |
| == 2021-04-28 17:47:58,060 easyblock.py:3138 INFO Running method handle_iterate_opts part of step ready | |
| == 2021-04-28 17:47:58,060 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:47:58,060 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:47:58,061 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:47:58,061 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/build/PyTorch/1.8.1/foss-2020b', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', installdir='/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='2', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:47:58,061 build_log.py:265 INFO unpacking... | |
| == 2021-04-28 17:47:58,061 easyblock.py:3132 INFO Starting source step | |
| == 2021-04-28 17:47:58,061 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:47:58,061 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:47:58,061 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:47:58,061 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/build/PyTorch/1.8.1/foss-2020b', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', installdir='/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='2', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:47:58,062 easyblock.py:3138 INFO Running method checksum_step part of step source | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /scratch/groups/celgene/software/sources/p/PyTorch/PyTorch-1.8.1.tar.gz using None passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch using a4208a46cd2098744daaba96cebb96cd91166f8fc616924315e05974bad80c67 passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_avoid-nan-in-test-torch.patch using b899aa94d9e60f11ee75a706563312ccefa9cf432756c470caa8e623991c8f18 passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_increase-distributed-test-timeout.patch using 95abb468a35451fbd0f864ca843f6ad15ff8bfb909c3fd580f65859b26c9691c passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch using 622cb1eaeadc06e13128a862d9946bcc1f1edd3d02b259c56a9aecc4d5406b8a passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_fix-noMKL-linear-algebra.patch using a1ca9382b0eb333090536633092bab6fa281d26b491bf7b1849117f68ab0730c passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:1985 INFO Checksum verification for /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_correct-skip-tests-decorators.patch using 4b2fe7616217dd6fd12d667cb1439dde58f84bf234fbf3e6026c4665fc697a2e passed. | |
| == 2021-04-28 17:47:58,062 easyblock.py:3138 INFO Running method extract_step part of step source | |
| == 2021-04-28 17:47:58,062 easyblock.py:2072 INFO Unpacking source PyTorch-1.8.1.tar.gz | |
| == 2021-04-28 17:47:58,063 run.py:225 INFO running cmd: tar xzf /scratch/groups/celgene/software/sources/p/PyTorch/PyTorch-1.8.1.tar.gz | |
| == 2021-04-28 17:48:01,621 build_log.py:265 INFO patching... | |
| == 2021-04-28 17:48:01,622 easyblock.py:3132 INFO Starting patch step | |
| == 2021-04-28 17:48:01,622 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:48:01,622 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:48:01,623 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:48:01,623 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/build/PyTorch/1.8.1/foss-2020b', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', installdir='/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='2', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:48:01,623 easyblock.py:3138 INFO Running method patch_step part of step patch | |
| == 2021-04-28 17:48:01,623 easyblock.py:2086 INFO Applying patch PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch | |
| == 2021-04-28 17:48:01,625 run.py:225 INFO running cmd: patch -b -p1 -i /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.6.0_fix-test-dataloader-fixed-affinity.patch | |
| == 2021-04-28 17:48:01,631 easyblock.py:2086 INFO Applying patch PyTorch-1.7.0_avoid-nan-in-test-torch.patch | |
| == 2021-04-28 17:48:01,632 run.py:225 INFO running cmd: patch -b -p1 -i /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_avoid-nan-in-test-torch.patch | |
| == 2021-04-28 17:48:01,637 easyblock.py:2086 INFO Applying patch PyTorch-1.7.0_increase-distributed-test-timeout.patch | |
| == 2021-04-28 17:48:01,638 run.py:225 INFO running cmd: patch -b -p1 -i /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_increase-distributed-test-timeout.patch | |
| == 2021-04-28 17:48:01,641 easyblock.py:2086 INFO Applying patch PyTorch-1.7.0_disable-dev-shm-test.patch | |
| == 2021-04-28 17:48:01,642 run.py:225 INFO running cmd: patch -b -p1 -i /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch | |
| == 2021-04-28 17:48:01,646 easyblock.py:2086 INFO Applying patch PyTorch-1.8.0_fix-noMKL-linear-algebra.patch | |
| == 2021-04-28 17:48:01,648 run.py:225 INFO running cmd: patch -b -p1 -i /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_fix-noMKL-linear-algebra.patch | |
| == 2021-04-28 17:48:01,652 easyblock.py:2086 INFO Applying patch PyTorch-1.8.0_correct-skip-tests-decorators.patch | |
| == 2021-04-28 17:48:01,653 run.py:225 INFO running cmd: patch -b -p0 -i /tmp/easybuild/eb-sgl13w1p/files_pr12347/p/PyTorch/PyTorch-1.8.0_correct-skip-tests-decorators.patch | |
| == 2021-04-28 17:48:01,657 build_log.py:265 INFO preparing... | |
| == 2021-04-28 17:48:01,657 easyblock.py:3132 INFO Starting prepare step | |
| == 2021-04-28 17:48:01,657 easyconfig.py:1613 INFO Generating template values... | |
| == 2021-04-28 17:48:01,658 mpi.py:119 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI' | |
| == 2021-04-28 17:48:01,658 mpi.py:305 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'}) | |
| == 2021-04-28 17:48:01,658 easyconfig.py:1632 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/build/PyTorch/1.8.1/foss-2020b', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', github_account='pytorch', installdir='/scratch/groups/celgene/software/software/PyTorch/1.8.1-foss-2020b', module_name='PyTorch/1.8.1-foss-2020b', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='2', pymajver='3', pyminver='8', pyshortver='3.8', pyver='3.8.6', toolchain_name='foss', toolchain_version='2020b', version='1.8.1', version_major='1', version_major_minor='1.8', version_minor='8', versionprefix='', versionsuffix='' | |
| == 2021-04-28 17:48:01,658 easyblock.py:3138 INFO Running method prepare_step part of step prepare | |
| == 2021-04-28 17:48:01,660 modules.py:606 INFO Checking whether CMake/3.18.4-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,660 modules.py:611 INFO Module CMake/3.18.4-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,660 modules.py:634 INFO Result for existence check of CMake/3.18.4-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,660 modules.py:606 INFO Checking whether hypothesis/5.41.5-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,661 modules.py:614 INFO Module hypothesis/5.41.5-GCCcore-10.2.0 not found in list of available modules, checking via 'module show'... | |
| == 2021-04-28 17:48:01,757 modules.py:627 INFO Module hypothesis/5.41.5-GCCcore-10.2.0 not found via module avail/show, checking whether it is a wrapper | |
| == 2021-04-28 17:48:01,757 modules.py:634 INFO Result for existence check of hypothesis/5.41.5-GCCcore-10.2.0 module: False | |
| == 2021-04-28 17:48:01,757 modules.py:606 INFO Checking whether Ninja/1.10.1-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,757 modules.py:611 INFO Module Ninja/1.10.1-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,757 modules.py:634 INFO Result for existence check of Ninja/1.10.1-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,757 modules.py:606 INFO Checking whether Python/3.8.6-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,757 modules.py:611 INFO Module Python/3.8.6-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,757 modules.py:634 INFO Result for existence check of Python/3.8.6-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,758 modules.py:606 INFO Checking whether protobuf/3.14.0-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,758 modules.py:611 INFO Module protobuf/3.14.0-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,758 modules.py:634 INFO Result for existence check of protobuf/3.14.0-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,758 modules.py:606 INFO Checking whether protobuf-python/3.14.0-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,758 modules.py:611 INFO Module protobuf-python/3.14.0-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,758 modules.py:634 INFO Result for existence check of protobuf-python/3.14.0-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,758 modules.py:606 INFO Checking whether pybind11/2.6.0-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,758 modules.py:611 INFO Module pybind11/2.6.0-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,758 modules.py:634 INFO Result for existence check of pybind11/2.6.0-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,758 modules.py:606 INFO Checking whether SciPy-bundle/2020.11-foss-2020b exists... | |
| == 2021-04-28 17:48:01,758 modules.py:611 INFO Module SciPy-bundle/2020.11-foss-2020b exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,758 modules.py:634 INFO Result for existence check of SciPy-bundle/2020.11-foss-2020b module: True | |
| == 2021-04-28 17:48:01,758 modules.py:606 INFO Checking whether typing-extensions/3.7.4.3-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,758 modules.py:611 INFO Module typing-extensions/3.7.4.3-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,758 modules.py:634 INFO Result for existence check of typing-extensions/3.7.4.3-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,758 modules.py:606 INFO Checking whether PyYAML/5.3.1-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,758 modules.py:614 INFO Module PyYAML/5.3.1-GCCcore-10.2.0 not found in list of available modules, checking via 'module show'... | |
| == 2021-04-28 17:48:01,853 modules.py:627 INFO Module PyYAML/5.3.1-GCCcore-10.2.0 not found via module avail/show, checking whether it is a wrapper | |
| == 2021-04-28 17:48:01,853 modules.py:634 INFO Result for existence check of PyYAML/5.3.1-GCCcore-10.2.0 module: False | |
| == 2021-04-28 17:48:01,853 modules.py:606 INFO Checking whether MPFR/4.1.0-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,853 modules.py:614 INFO Module MPFR/4.1.0-GCCcore-10.2.0 not found in list of available modules, checking via 'module show'... | |
| == 2021-04-28 17:48:01,918 modules.py:627 INFO Module MPFR/4.1.0-GCCcore-10.2.0 not found via module avail/show, checking whether it is a wrapper | |
| == 2021-04-28 17:48:01,919 modules.py:634 INFO Result for existence check of MPFR/4.1.0-GCCcore-10.2.0 module: False | |
| == 2021-04-28 17:48:01,919 modules.py:606 INFO Checking whether GMP/6.2.0-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,919 modules.py:611 INFO Module GMP/6.2.0-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,919 modules.py:634 INFO Result for existence check of GMP/6.2.0-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,919 modules.py:606 INFO Checking whether numactl/2.0.13-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,919 modules.py:611 INFO Module numactl/2.0.13-GCCcore-10.2.0 exists (found in list of available modules) | |
| == 2021-04-28 17:48:01,919 modules.py:634 INFO Result for existence check of numactl/2.0.13-GCCcore-10.2.0 module: True | |
| == 2021-04-28 17:48:01,919 modules.py:606 INFO Checking whether FFmpeg/4.3.1-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,919 modules.py:614 INFO Module FFmpeg/4.3.1-GCCcore-10.2.0 not found in list of available modules, checking via 'module show'... | |
| == 2021-04-28 17:48:01,986 modules.py:627 INFO Module FFmpeg/4.3.1-GCCcore-10.2.0 not found via module avail/show, checking whether it is a wrapper | |
| == 2021-04-28 17:48:01,987 modules.py:634 INFO Result for existence check of FFmpeg/4.3.1-GCCcore-10.2.0 module: False | |
| == 2021-04-28 17:48:01,987 modules.py:606 INFO Checking whether Pillow/8.0.1-GCCcore-10.2.0 exists... | |
| == 2021-04-28 17:48:01,987 modules.py:614 INFO Module Pillow/8.0.1-GCCcore-10.2.0 not found in list of available modules, checking via 'module show'... | |
| == 2021-04-28 17:48:02,080 modules.py:627 INFO Module Pillow/8.0.1-GCCcore-10.2.0 not found via module avail/show, checking whether it is a wrapper | |
| == 2021-04-28 17:48:02,080 modules.py:634 INFO Result for existence check of Pillow/8.0.1-GCCcore-10.2.0 module: False | |
| == 2021-04-28 17:48:02,165 build_log.py:169 ERROR EasyBuild crashed with an error (at easybuild/base/exceptions.py:124 in __init__): Missing modules for dependencies (use --robot?): hypothesis/5.41.5-GCCcore-10.2.0, PyYAML/5.3.1-GCCcore-10.2.0, MPFR/4.1.0-GCCcore-10.2.0, FFmpeg/4.3.1-GCCcore-10.2.0, Pillow/8.0.1-GCCcore-10.2.0 (at easybuild/tools/toolchain/toolchain.py:555 in _check_dependencies) | |
| == 2021-04-28 17:48:02,166 filetools.py:1810 INFO Removing lock /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock... | |
| == 2021-04-28 17:48:02,172 filetools.py:347 INFO Path /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock successfully removed. | |
| == 2021-04-28 17:48:02,172 filetools.py:1814 INFO Lock removed: /scratch/groups/celgene/software/software/.locks/_scratch_groups_celgene_software_software_PyTorch_1.8.1-foss-2020b.lock | |
| == 2021-04-28 17:48:02,172 easyblock.py:3414 WARNING build failed (first 300 chars): Missing modules for dependencies (use --robot?): hypothesis/5.41.5-GCCcore-10.2.0, PyYAML/5.3.1-GCCcore-10.2.0, MPFR/4.1.0-GCCcore-10.2.0, FFmpeg/4.3.1-GCCcore-10.2.0, Pillow/8.0.1-GCCcore-10.2.0 | |
| == 2021-04-28 17:48:02,172 easyblock.py:298 INFO Closing log for application name PyTorch version 1.8.1 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment