Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save lexming/574665f9f8cf86a01ea7980569f46f44 to your computer and use it in GitHub Desktop.
Save lexming/574665f9f8cf86a01ea7980569f46f44 to your computer and use it in GitHub Desktop.
(partial) EasyBuild log for failed build of /tmp/eb-trtm0714/files_pr19666/p/PyTorch/PyTorch-2.1.2-foss-2023a-CUDA-12.1.1.eb (PR(s) #19666)
== 2024-02-15 15:35:37,585 easyblock.py:313 INFO This is EasyBuild 4.9.1.dev0-r769d5e2f3bde7897dd480e24d59852ff89da8659 (framework: 4.9.1.dev0-r769d5e2f3bde7897dd480e24d59852ff89da8659, easyblocks: 4.9.1.dev0-r326cd1a0b335902487e90bc4c3780723176c6c04) on host node253.hydra.os.
== 2024-02-15 15:35:37,585 easyblock.py:319 INFO This is easyblock EB_PyTorch from module easybuild.easyblocks.pytorch (./easybuild/easyblocks/p/pytorch.py)
== 2024-02-15 15:35:37,585 easyblock.py:1056 INFO Build dir set to /user/brussel/101/vsc10122/easybuild/install/broadwell/build/PyTorch/2.1.2/foss-2023a-CUDA-12.1.1
== 2024-02-15 15:35:37,586 easyblock.py:1113 INFO Software install dir set to /user/brussel/101/vsc10122/easybuild/install/broadwell/software/PyTorch/2.1.2-foss-2023a-CUDA-12.1.1
== 2024-02-15 15:35:37,586 easyblock.py:1118 INFO Module install dir set to /user/brussel/101/vsc10122/easybuild/install/broadwell/modules/all
== 2024-02-15 15:35:37,586 easyblock.py:288 INFO Init completed for application name PyTorch version 2.1.2
== 2024-02-15 15:35:37,587 pythonpackage.py:408 INFO Using default value for expected module name (lowercase software name): 'pytorch'
== 2024-02-15 15:35:37,587 pythonpackage.py:441 INFO Using pip with --no-deps option
== 2024-02-15 15:35:37,588 environment.py:93 INFO Environment variable XDG_CACHE_HOME set to /tmp/eb-trtm0714 (previously undefined)
== 2024-02-15 15:35:37,588 pythonpackage.py:458 INFO Using /tmp/eb-trtm0714 as pip cache directory
== 2024-02-15 15:35:37,588 pythonpackage.py:473 INFO Using '%(python)s -m pip install --prefix=%(prefix)s %(installopts)s %(loc)s' as install command
== 2024-02-15 15:35:37,588 easyblock.py:4234 INFO Obtained application instance of for PyTorch (easyblock: None)
== 2024-02-15 15:35:37,589 easyconfig.py:1702 INFO Generating template values...
== 2024-02-15 15:35:37,589 mpi.py:122 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2024-02-15 15:35:37,589 mpi.py:307 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2024-02-15 15:35:37,589 easyconfig.py:1721 INFO Template values: arch='x86_64', bitbucket_account='pytorch', cuda_cc_cmake='80', cuda_cc_semicolon_sep='8.0', cuda_cc_space_sep='8.0', cuda_compute_capabilities='8.0', cuda_sm_comma_sep='sm_80', cuda_sm_space_sep='sm_80', cudamajver='12', cudaminver='1', cudashortver='12.1', cudaver='12.1.1', github_account='pytorch', module_name='PyTorch/2.1.2-foss-2023a-CUDA-12.1.1', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', pymajver='3', pyminver='11', pyshortver='3.11', pyver='3.11.3', sysroot='', toolchain_name='foss', toolchain_version='2023a', version='2.1.2', version_major='2', version_major_minor='2.1', version_minor='1', versionprefix='', versionsuffix='-CUDA-12.1.1'
== 2024-02-15 15:35:37,596 one.py:180 INFO Skipping reformatting value for parameter 'toolchain'
== 2024-02-15 15:35:37,604 filetools.py:1911 INFO Creating directory /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438 (parents: True, set_gid: False, sticky: False)
== 2024-02-15 15:35:37,621 easyblock.py:4488 INFO Dumped easyconfig instance to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/PyTorch-2.1.2-foss-2023a-CUDA-12.1.1.eb
== 2024-02-15 15:35:37,624 filetools.py:1911 INFO Creating directory /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/easyblocks (parents: True, set_gid: False, sticky: False)
== 2024-02-15 15:35:37,626 filetools.py:2424 INFO ./easybuild/easyblocks/p/pytorch.py copied to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/easyblocks/pytorch.py
== 2024-02-15 15:35:37,626 easyblock.py:4468 INFO Dumped easyblock pytorch.py required for reproduction to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/easyblocks
== 2024-02-15 15:35:37,629 filetools.py:2424 INFO ./easybuild/easyblocks/generic/pythonpackage.py copied to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/easyblocks/pythonpackage.py
== 2024-02-15 15:35:37,629 easyblock.py:4468 INFO Dumped easyblock pythonpackage.py required for reproduction to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/easyblocks
== 2024-02-15 15:35:37,631 filetools.py:1911 INFO Creating directory /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/hooks (parents: True, set_gid: False, sticky: False)
== 2024-02-15 15:35:37,704 filetools.py:2424 INFO /user/brussel/101/vsc10122/src/eb_hooks/lib/vsc/eb_hooks/hooks_hydra.py copied to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/hooks/hooks_hydra.py
== 2024-02-15 15:35:37,704 easyblock.py:4500 INFO Dumped hooks file /user/brussel/101/vsc10122/src/eb_hooks/lib/vsc/eb_hooks/hooks_hydra.py which is (potentially) required for reproduction to /user/brussel/101/vsc10122/easybuild/install/broadwell/log/reprod_20240215153537_2877438/hooks/hooks_hydra.py
== 2024-02-15 15:35:37,706 easyblock.py:2239 INFO Number of iterations to perform for central part of installation procedure: 1
== 2024-02-15 15:35:37,707 build_log.py:267 INFO building and installing PyTorch/2.1.2-foss-2023a-CUDA-12.1.1...
== 2024-02-15 15:35:37,709 filetools.py:1966 INFO Lock /user/brussel/101/vsc10122/easybuild/install/broadwell/software/.locks/_user_brussel_101_vsc10122_easybuild_install_broadwell_software_PyTorch_2.1.2-foss-2023a-CUDA-12.1.1.lock exists!
== 2024-02-15 15:35:38,005 build_log.py:171 ERROR EasyBuild crashed with an error (at easybuild/easybuild-framework/easybuild/base/exceptions.py:126 in __init__): Lock /user/brussel/101/vsc10122/easybuild/install/broadwell/software/.locks/_user_brussel_101_vsc10122_easybuild_install_broadwell_software_PyTorch_2.1.2-foss-2023a-CUDA-12.1.1.lock already exists, aborting! (at easybuild/easybuild-framework/easybuild/tools/filetools.py:2002 in check_lock)
== 2024-02-15 15:35:38,006 easyblock.py:4291 WARNING build failed (first 300 chars): Lock /user/brussel/101/vsc10122/easybuild/install/broadwell/software/.locks/_user_brussel_101_vsc10122_easybuild_install_broadwell_software_PyTorch_2.1.2-foss-2023a-CUDA-12.1.1.lock already exists, aborting!
== 2024-02-15 15:35:38,006 easyblock.py:328 INFO Closing log for application name PyTorch version 2.1.2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment