Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created December 21, 2021 13:50
Show Gist options
  • Save bbpbuildbot/cb28bea100b31bc9984f0a7a6954f3b3 to your computer and use it in GitHub Desktop.
Save bbpbuildbot/cb28bea100b31bc9984f0a7a6954f3b3 to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/30092 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#699.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088218:resolve_secrets Resolving secrets
section_end:1640088218:resolve_secrets section_start:1640088218:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor503421346, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112522
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112522
A slurm job will be created with name GL_J112522_PROD_P112_CP4_C5
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140964
job state: PD
job state: PD
job state: R
section_end:1640088222:prepare_executor section_start:1640088222:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088225:prepare_script section_start:1640088225:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088225:get_sources section_start:1640088225:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=273504 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640088254:restore_cache section_start:1640088254:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (112516)...
Runtime platform  arch=amd64 os=linux pid=275273 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112516 responseStatus=200 OK token=RF9a3MuA
section_end:1640088255:download_artifacts section_start:1640088255:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="27bd6c88db277042842987f0c6748ae9ba9e57f3"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..2d18848 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="27bd6c88db277042842987f0c6748ae9ba9e57f3")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+gpu+tests~legacy-unit~report build_type=RelWithDebInfo
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be d5jp63omt63hmfz46ab5b5um2wtosys4
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112522/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112522/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:05:55 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.28 / 0.51 (55.58 %)
Files: 6962
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'd5jp63omt63hmfz46ab5b5um2wtosys4'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit~report+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- d5jp63o coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
==> Installing coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4
==> No binary for coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4 found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-d5jp63
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112522/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112522/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:21:31 2021
Hits: 114 / 117 (97.44 %)
Direct: 98 / 117 (83.76 %)
Preprocessed: 16 / 19 (84.21 %)
Misses: 3
Direct: 19
Preprocessed: 3
Uncacheable: 18
Primary storage:
Hits: 227 / 234 (97.01 %)
Misses: 7
Cache size (GB): 0.28 / 0.51 (55.59 %)
Files: 6968
Uncacheable:
Called for linking: 15
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640089300:step_script section_start:1640089300:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=11637 revision=58ba2b95 version=14.2.0
ccache/: found 7529 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-6
Created cache
section_end:1640089342:archive_cache section_start:1640089342:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=12691 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112522 responseStatus=201 Created token=hpX5gjz8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=12730 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112522 responseStatus=201 Created token=hpX5gjz8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=12767 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112522 responseStatus=201 Created token=hpX5gjz8
section_end:1640089343:upload_artifacts_on_success section_start:1640089343:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640089344:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088218:resolve_secrets Resolving secrets
section_end:1640088218:resolve_secrets section_start:1640088218:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor935440021, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112520
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112520
A slurm job will be created with name GL_J112520_PROD_P112_CP3_C3
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140963
job state: PD
job state: PD
job state: R
section_end:1640088221:prepare_executor section_start:1640088221:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088225:prepare_script section_start:1640088225:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088225:get_sources section_start:1640088225:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=273487 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640088247:restore_cache section_start:1640088247:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (112516)...
Runtime platform  arch=amd64 os=linux pid=274727 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112516 responseStatus=200 OK token=RF9a3MuA
section_end:1640088248:download_artifacts section_start:1640088248:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112520/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112520/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112520/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112520/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112520/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="27bd6c88db277042842987f0c6748ae9ba9e57f3"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..2d18848 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="27bd6c88db277042842987f0c6748ae9ba9e57f3")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112520/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112520/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:05:55 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.28 / 0.51 (55.53 %)
Files: 5557
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'aevgkbdozl3htdtjhrd5w65n3c6mb2jh'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- aevgkbd coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
==> Installing coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh
==> No binary for coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112520/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112520/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:09:18 2021
Hits: 108 / 117 (92.31 %)
Direct: 92 / 118 (77.97 %)
Preprocessed: 16 / 26 (61.54 %)
Misses: 9
Direct: 26
Preprocessed: 10
Uncacheable: 20
Primary storage:
Hits: 215 / 236 (91.10 %)
Misses: 21
Cache size (GB): 0.28 / 0.51 (55.55 %)
Files: 5575
Uncacheable:
Called for linking: 16
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640088562:step_script section_start:1640088562:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=285869 revision=58ba2b95 version=14.2.0
ccache/: found 6136 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-6
Created cache
section_end:1640088585:archive_cache section_start:1640088585:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=287439 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112520 responseStatus=201 Created token=jknnCyrk
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=287479 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112520 responseStatus=201 Created token=jknnCyrk
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=287522 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112520 responseStatus=201 Created token=jknnCyrk
section_end:1640088586:upload_artifacts_on_success section_start:1640088586:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640088587:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640089639:resolve_secrets Resolving secrets
section_end:1640089639:resolve_secrets section_start:1640089639:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor829375667, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112521
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112521
A slurm job will be created with name GL_J112521_PROD_P112_CP2_C1
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 141055
job state: R
section_end:1640089640:prepare_executor section_start:1640089640:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640089642:prepare_script section_start:1640089642:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640089643:get_sources section_start:1640089643:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=22691 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640089651:restore_cache section_start:1640089651:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:gpu (112518)...
Runtime platform  arch=amd64 os=linux pid=23002 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112518 responseStatus=200 OK token=CmWsdAHm
section_end:1640089652:download_artifacts section_start:1640089652:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="27bd6c88db277042842987f0c6748ae9ba9e57f3"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..2d18848 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="27bd6c88db277042842987f0c6748ae9ba9e57f3")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+nmodl+gpu+tests~legacy-unit~report build_type=RelWithDebInfo ^/nswa6573eazhleffns23ijmh436w7top
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be zlwgeoedcsxjuxmsxmqszgt6asxykrym
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112521/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112521/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:28:10 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.28 / 0.51 (55.59 %)
Files: 6968
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'zlwgeoedcsxjuxmsxmqszgt6asxykrym'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+nmodl~report+tests build_type=RelWithDebInfo
[+] ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- zlwgeoe coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] nswa657 ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ccuqt3m ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hg7eomm ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 5ytmph6 ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] uu54yde ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] sujyde4 ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oekgd2o ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hsn2r4n ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-uu54yd
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-5ytmph
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-hsn2r4
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-sujyde
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-hg7eom
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-oekgd2
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-ccuqt3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/nmodl-develop-nswa65
==> Installing coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym
==> No binary for coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-zlwgeo
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112521/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112521/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:49:15 2021
Hits: 86 / 95 (90.53 %)
Direct: 1 / 95 (1.05 %)
Preprocessed: 85 / 94 (90.43 %)
Misses: 9
Direct: 94
Preprocessed: 9
Uncacheable: 15
Primary storage:
Hits: 87 / 190 (45.79 %)
Misses: 103
Cache size (GB): 0.29 / 0.51 (55.93 %)
Files: 7071
Uncacheable:
Called for linking: 12
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640090959:step_script section_start:1640090959:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=52417 revision=58ba2b95 version=14.2.0
ccache/: found 7632 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-6
Created cache
section_end:1640090991:archive_cache section_start:1640090991:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=54004 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112521 responseStatus=201 Created token=NRyyu1VN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=54053 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112521 responseStatus=201 Created token=NRyyu1VN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=54111 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112521 responseStatus=201 Created token=NRyyu1VN
section_end:1640090992:upload_artifacts_on_success section_start:1640090992:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640090993:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640089705:resolve_secrets Resolving secrets
section_end:1640089705:resolve_secrets section_start:1640089705:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor619739373, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112519
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112519
A slurm job will be created with name GL_J112519_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 141058
job state: R
section_end:1640089706:prepare_executor section_start:1640089706:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640089709:prepare_script section_start:1640089709:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640089710:get_sources section_start:1640089710:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=27722 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640089718:restore_cache section_start:1640089718:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:intel (112517)...
Runtime platform  arch=amd64 os=linux pid=28065 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112517 responseStatus=200 OK token=WxfRYkMZ
section_end:1640089719:download_artifacts section_start:1640089719:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112519/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112519/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112519/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112519/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112519/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="27bd6c88db277042842987f0c6748ae9ba9e57f3"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..2d18848 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="27bd6c88db277042842987f0c6748ae9ba9e57f3")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+nmodl+tests~legacy-unit build_type=Debug ^/lqyttqytclxdwwickak7uvjmb6a3au3g
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112519/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112519/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:31:39 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.28 / 0.51 (55.55 %)
Files: 5575
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'cwjs4t3f4wyl5jax3fb2obxbvjopwgn3'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+nmodl+tests build_type=Debug
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- cwjs4t3 coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
==> Installing coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
==> No binary for coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112519/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112519/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:48:09 2021
Hits: 81 / 95 (85.26 %)
Direct: 0 / 96 (0.00 %)
Preprocessed: 81 / 96 (84.38 %)
Misses: 14
Direct: 96
Preprocessed: 15
Uncacheable: 17
Primary storage:
Hits: 81 / 192 (42.19 %)
Misses: 111
Cache size (GB): 0.29 / 0.51 (55.95 %)
Files: 5684
Uncacheable:
Called for linking: 13
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640090895:step_script section_start:1640090895:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=51372 revision=58ba2b95 version=14.2.0
ccache/: found 6245 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-6
Created cache
section_end:1640090925:archive_cache section_start:1640090925:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=51862 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112519 responseStatus=201 Created token=1xDe_fH3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=51892 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112519 responseStatus=201 Created token=1xDe_fH3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=51915 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112519 responseStatus=201 Created token=1xDe_fH3
section_end:1640090926:upload_artifacts_on_success section_start:1640090926:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640090927:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640089351:resolve_secrets Resolving secrets
section_end:1640089351:resolve_secrets section_start:1640089351:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor190070155, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112530
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112530
A slurm job will be created with name GL_J112530_PROD_P112_CP4_C5
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 141051
job state: R
section_end:1640089353:prepare_executor section_start:1640089353:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640089355:prepare_script section_start:1640089355:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640089355:get_sources section_start:1640089355:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=13349 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640089543:restore_cache section_start:1640089543:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (112522)...
Runtime platform  arch=amd64 os=linux pid=16872 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112522 responseStatus=200 OK token=hpX5gjz8
section_end:1640089543:download_artifacts section_start:1640089543:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112530/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112530/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112530/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112530/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112530/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/d5jp63omt63hmfz46ab5b5um2wtosys4^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be vkogqddlipn6wfzq2o4mkbt36t7uknzy
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112530/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112530/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:27:12 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (92.65 %)
Files: 32368
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'vkogqddlipn6wfzq2o4mkbt36t7uknzy'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- vkogqdd neuron@develop%nvhpc@21.9+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] d5jp63o ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nrapte7 ^gettext@0.21%nvhpc@21.9+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] 2ysh2tt ^bzip2@1.0.8%nvhpc@21.9+shared arch=linux-rhel7-x86_64
[^] ibezovc ^libiconv@1.16%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] tnqe7c4 ^libxml2@2.9.10%nvhpc@21.9~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] zxjo677 ^pkgconf@1.7.3%nvhpc@21.9 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l66doh5 ^xz@5.2.5%nvhpc@21.9~pic arch=linux-rhel7-x86_64
[^] elbqaor ^zlib@1.2.11%nvhpc@21.9+optimize+pic+shared arch=linux-rhel7-x86_64
[^] bgo3uwo ^ncurses@6.2%nvhpc@21.9~symlinks+termlib arch=linux-rhel7-x86_64
[^] 3rfyifb ^tar@1.28%nvhpc@21.9 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] o4qjffl ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] oq5gdcc ^py-mpi4py@3.0.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] 4krfyfj ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] yuqhyr2 ^py-setuptools-scm@4.1.2%nvhpc@21.9+toml arch=linux-rhel7-x86_64
[^] bk3d6wo ^py-toml@0.10.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] gzeyuxm ^py-pytest-cov@2.8.1%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] mplwm3p ^py-coverage@5.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfcagzk ^readline@8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-2ysh2tt3lnl2uvfsnbg7krzev3ysdear)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libiconv-1.16-ibezov
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/pkgconf-1.7.3-zxjo67
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/xz-5.2.5-l66doh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-elbqaor47ega2nun5e64w3s4tllg35cq)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-bgo3uwovij7lsxpbsk2cgyoghc3okxkl)
[+] /usr (external tar-1.28-3rfyifbrzrnqstk63f6zfnxe4vf7herg)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kfcagzks7msvsixt2q7vdt2t33xo5rih)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-d5jp63
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libxml2-2.9.10-tnqe7c
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/gettext-0.21-nrapte
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-toml-0.10.0-bk3d6w
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-mpi4py-3.0.3-oq5gdc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-o4qjff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-coverage-5.3-mplwm3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-scm-4.1.2-yuqhyr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-4krfyf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-cov-2.8.1-gzeyux
==> Installing neuron-develop-vkogqddlipn6wfzq2o4mkbt36t7uknzy
==> No binary for neuron-develop-vkogqddlipn6wfzq2o4mkbt36t7uknzy found: installing from source
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:57990]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58070]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58092]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58094]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58166]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58232]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58258]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58274]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58288]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:58332]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60562]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60650]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60722]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60732]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60850]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60894]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32890]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33180]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33402]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33406]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_unpack: unpack error
srun: error: Invalid IO init header version
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33592]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:35176]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:35382]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33842]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
==> neuron: Executing phase: 'install'
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/neuron-develop-vkogqd
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:35776]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:35778]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:34290]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:34292]: Connection reset by peer
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112530/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112530/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 14:06:56 2021
Hits: 517 / 902 (57.32 %)
Direct: 17 / 911 (1.87 %)
Preprocessed: 500 / 888 (56.31 %)
Misses: 385
Direct: 894
Preprocessed: 388
Uncacheable: 135
Primary storage:
Hits: 570 / 1816 (31.39 %)
Misses: 1246
Cache size (GB): 0.45 / 0.51 (88.53 %)
Files: 30738
Cleanups: 10
Uncacheable:
Autoconf compile/link: 7
Called for linking: 112
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640092021:step_script section_start:1640092021:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=108464 revision=58ba2b95 version=14.2.0
ccache/: found 31299 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-6
Created cache
section_end:1640092095:archive_cache section_start:1640092095:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=110538 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112530 responseStatus=201 Created token=xdQWnAYo
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=110596 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112530 responseStatus=201 Created token=xdQWnAYo
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=110623 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112530 responseStatus=201 Created token=xdQWnAYo
section_end:1640092097:upload_artifacts_on_success section_start:1640092097:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640092098:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088592:resolve_secrets Resolving secrets
section_end:1640088592:resolve_secrets section_start:1640088592:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor983971018, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112528
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112528
A slurm job will be created with name GL_J112528_PROD_P112_CP6_C6
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140973
job state: R
section_end:1640088594:prepare_executor section_start:1640088594:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088598:prepare_script section_start:1640088598:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088598:get_sources section_start:1640088598:restore_cache Restoring cache
Checking cache for neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=289180 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-6
Successfully extracted cache
section_end:1640088995:restore_cache section_start:1640088995:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (112520)...
Runtime platform  arch=amd64 os=linux pid=2570 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112520 responseStatus=200 OK token=jknnCyrk
section_end:1640088996:download_artifacts section_start:1640088996:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112528/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112528/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112528/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112528/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112528/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be mvn7s3za436y6xrhbspwpy7pbewubnvm
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112528/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112528/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:22:09 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (91.04 %)
Files: 24771
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'mvn7s3za436y6xrhbspwpy7pbewubnvm'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- mvn7s3z neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] aevgkbd ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
- zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
==> Installing py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk
==> No binary for py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk found: installing from source
==> Warning: Missing a source id for neuron@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/28/280baa8ec489c4f542f8940f9c4c2181f0306a8ee1a54eceba071a449fb870a0.tar.gz
==> py-coverage: Executing phase: 'build'
==> py-coverage: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe
==> No binary for py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/cc/cc6742d8bac45070217169f5f72ceee1e0e55b0221f54bcf24845972d3a47f2b.tar.gz
==> py-pytest-cov: Executing phase: 'build'
==> py-pytest-cov: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
==> Installing neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm
==> No binary for neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm found: installing from source
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59178]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59398]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59498]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59500]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59558]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59644]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:59792]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60004]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60058]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:60062]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_unpack: unpack error
srun: error: Invalid IO init header version
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32854]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32928]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32942]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32944]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32966]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32982]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:32996]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33000]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33016]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33048]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:35726]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33260]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:35904]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33332]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36050]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36054]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36090]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36102]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33630]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33632]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33746]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:33754]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36378]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36510]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36572]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36586]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:36598]: Insane message length
==> neuron: Executing phase: 'install'
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:34094]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-mvn7s3
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112528/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112528/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 14:08:10 2021
Hits: 455 / 906 (50.22 %)
Direct: 17 / 915 (1.86 %)
Preprocessed: 438 / 892 (49.10 %)
Misses: 451
Direct: 898
Preprocessed: 454
Uncacheable: 145
Primary storage:
Hits: 508 / 1824 (27.85 %)
Misses: 1316
Cache size (GB): 0.43 / 0.51 (83.92 %)
Files: 23010
Cleanups: 13
Uncacheable:
Autoconf compile/link: 7
Called for linking: 122
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640092151:step_script section_start:1640092151:archive_cache Saving cache for successful job
Creating cache neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=112019 revision=58ba2b95 version=14.2.0
ccache/: found 23571 matching files and directories
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 140973.5 ON r1i4n32 CANCELLED AT 2021-12-21T14:10:05 DUE TO TIME LIMIT ***
srun: error: r1i4n32: task 0: Terminated
section_end:1640092206:archive_cache ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640090999:resolve_secrets Resolving secrets
section_end:1640090999:resolve_secrets section_start:1640090999:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor800379838, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112529
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112529
A slurm job will be created with name GL_J112529_PROD_P112_CP10_C11
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 141073
job state: PD
job state: PD
job state: R
section_end:1640091002:prepare_executor section_start:1640091002:prepare_script Preparing environment
Running on r1i5n23 via bbpv1.epfl.ch...
section_end:1640091004:prepare_script section_start:1640091004:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640091005:get_sources section_start:1640091005:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=257446 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640091160:restore_cache section_start:1640091160:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (112521)...
Runtime platform  arch=amd64 os=linux pid=263850 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112521 responseStatus=200 OK token=NRyyu1VN
section_end:1640091161:download_artifacts section_start:1640091161:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112529/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112529/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112529/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112529/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112529/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/zlwgeoedcsxjuxmsxmqszgt6asxykrym^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be kxhxq4seozqasdxdnbgni3g566ai7oyd
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112529/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112529/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:53:41 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (92.65 %)
Files: 32368
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'kxhxq4seozqasdxdnbgni3g566ai7oyd'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- kxhxq4s neuron@develop%nvhpc@21.9+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] zlwgeoe ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] nswa657 ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ccuqt3m ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hg7eomm ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 5ytmph6 ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] uu54yde ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] sujyde4 ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oekgd2o ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hsn2r4n ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nrapte7 ^gettext@0.21%nvhpc@21.9+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] 2ysh2tt ^bzip2@1.0.8%nvhpc@21.9+shared arch=linux-rhel7-x86_64
[^] ibezovc ^libiconv@1.16%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] tnqe7c4 ^libxml2@2.9.10%nvhpc@21.9~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] zxjo677 ^pkgconf@1.7.3%nvhpc@21.9 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l66doh5 ^xz@5.2.5%nvhpc@21.9~pic arch=linux-rhel7-x86_64
[^] elbqaor ^zlib@1.2.11%nvhpc@21.9+optimize+pic+shared arch=linux-rhel7-x86_64
[^] bgo3uwo ^ncurses@6.2%nvhpc@21.9~symlinks+termlib arch=linux-rhel7-x86_64
[^] 3rfyifb ^tar@1.28%nvhpc@21.9 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] o4qjffl ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] oq5gdcc ^py-mpi4py@3.0.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] 4krfyfj ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] gzeyuxm ^py-pytest-cov@2.8.1%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] mplwm3p ^py-coverage@5.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfcagzk ^readline@8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-2ysh2tt3lnl2uvfsnbg7krzev3ysdear)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libiconv-1.16-ibezov
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/pkgconf-1.7.3-zxjo67
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/xz-5.2.5-l66doh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-elbqaor47ega2nun5e64w3s4tllg35cq)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-bgo3uwovij7lsxpbsk2cgyoghc3okxkl)
[+] /usr (external tar-1.28-3rfyifbrzrnqstk63f6zfnxe4vf7herg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kfcagzks7msvsixt2q7vdt2t33xo5rih)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-uu54yd
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-5ytmph
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-hsn2r4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-sujyde
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libxml2-2.9.10-tnqe7c
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-oekgd2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-mpi4py-3.0.3-oq5gdc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-hg7eom
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-o4qjff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-coverage-5.3-mplwm3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/gettext-0.21-nrapte
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-ccuqt3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-4krfyf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-cov-2.8.1-gzeyux
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/nmodl-develop-nswa65
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-zlwgeo
==> Installing neuron-develop-kxhxq4seozqasdxdnbgni3g566ai7oyd
==> No binary for neuron-develop-kxhxq4seozqasdxdnbgni3g566ai7oyd found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 141073.4 ON r1i5n23 CANCELLED AT 2021-12-21T14:50:05 DUE TO TIME LIMIT ***
srun: error: r1i5n23: task 0: Terminated
section_end:1640094605:step_script ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640090936:resolve_secrets Resolving secrets
section_end:1640090936:resolve_secrets section_start:1640090936:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor492244462, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112527
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112527
A slurm job will be created with name GL_J112527_PROD_P112_CP9_C10
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 141071
job state: R
section_end:1640090937:prepare_executor section_start:1640090937:prepare_script Preparing environment
Running on r1i5n23 via bbpv1.epfl.ch...
section_end:1640090940:prepare_script section_start:1640090940:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640090941:get_sources section_start:1640090941:restore_cache Restoring cache
Checking cache for neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=253494 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640090969:restore_cache section_start:1640090969:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (112519)...
Runtime platform  arch=amd64 os=linux pid=254950 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112519 responseStatus=200 OK token=1xDe_fH3
section_end:1640090969:download_artifacts section_start:1640090969:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112527/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112527/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112527/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112527/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112527/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be jhigcl7ephcbe47kbyz2znl76v2kaeev
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112527/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112527/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:50:28 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.42 / 0.51 (82.35 %)
Files: 22870
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'jhigcl7ephcbe47kbyz2znl76v2kaeev'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- jhigcl7 neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] cwjs4t3 ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
==> Installing neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev
==> No binary for neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 141071.4 ON r1i5n23 CANCELLED AT 2021-12-21T14:49:05 DUE TO TIME LIMIT ***
srun: error: r1i5n23: task 0: Terminated
section_end:1640094547:step_script ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088217:resolve_secrets Resolving secrets
section_end:1640088217:resolve_secrets section_start:1640088217:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor522135339, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112518
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112518
A slurm job will be created with name GL_J112518_PROD_P112_CP2_C1
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140962
job state: R
section_end:1640088219:prepare_executor section_start:1640088219:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088222:prepare_script section_start:1640088222:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088222:get_sources section_start:1640088222:restore_cache Restoring cache
Checking cache for nmodl-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=273074 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640088232:restore_cache section_start:1640088232:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (112516)...
Runtime platform  arch=amd64 os=linux pid=273986 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112516 responseStatus=200 OK token=RF9a3MuA
section_end:1640088233:download_artifacts section_start:1640088233:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112518/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112518/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112518/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112518/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112518/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%nvhpc~legacy-unit ^bison%gcc^flex%gcc^py-jinja2%gcc^py-sympy%gcc^py-pyyaml%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be nswa6573eazhleffns23ijmh436w7top
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112518/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112518/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:05:47 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.45 / 0.51 (88.40 %)
Files: 1714
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'nswa6573eazhleffns23ijmh436w7top'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%nvhpc~legacy-unit
- ^bison%gcc
- ^flex%gcc
- ^py-jinja2%gcc
- ^py-pyyaml%gcc
- ^py-sympy%gcc
Concretized
--------------------------------
- nswa657 nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
- ccuqt3m ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
- hg7eomm ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- 5ytmph6 ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- uu54yde ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] yuqhyr2 ^py-setuptools-scm@4.1.2%nvhpc@21.9+toml arch=linux-rhel7-x86_64
[^] bk3d6wo ^py-toml@0.10.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
- sujyde4 ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
- oekgd2o ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
- hsn2r4n ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
==> Installing py-mpmath-1.1.0-hsn2r4nbqjhzewaw5soovd2t5ud7cpxi
==> No binary for py-mpmath-1.1.0-hsn2r4nbqjhzewaw5soovd2t5ud7cpxi found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-hsn2r4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
==> Installing py-pyyaml-5.3.1-sujyde4lpezqcdg4rwhbpoaratxzarxk
==> No binary for py-pyyaml-5.3.1-sujyde4lpezqcdg4rwhbpoaratxzarxk found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/b8/b8eac752c5e14d3eca0e6dd9199cd627518cb5ec06add0de9d32baeee6fe645d.tar.gz
==> py-pyyaml: Executing phase: 'build_ext'
==> py-pyyaml: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-sujyde
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
==> Installing py-pytz-2020.1-5ytmph6jauaabucz5ftlb3luonjitpyh
==> No binary for py-pytz-2020.1-5ytmph6jauaabucz5ftlb3luonjitpyh found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/c3/c35965d010ce31b23eeb663ed3cc8c906275d6be1a34393a1d73a41febf4a048.tar.gz
==> py-pytz: Executing phase: 'build'
==> py-pytz: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-5ytmph
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
==> Installing py-markupsafe-1.1.1-uu54yden3pmltnbphrqkavx46jvq7xnu
==> No binary for py-markupsafe-1.1.1-uu54yden3pmltnbphrqkavx46jvq7xnu found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-uu54yd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-toml-0.10.0-bk3d6w
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
==> Installing py-sympy-1.4-oekgd2ou3e7lvizgzw7ztjyx5npcnhjc
==> No binary for py-sympy-1.4-oekgd2ou3e7lvizgzw7ztjyx5npcnhjc found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-oekgd2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
==> Installing py-babel-2.7.0-hg7eommvskkocenyvv7wvashro4vnb2o
==> No binary for py-babel-2.7.0-hg7eommvskkocenyvv7wvashro4vnb2o found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-hg7eom
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-scm-4.1.2-yuqhyr
==> Installing py-jinja2-2.10.3-ccuqt3mppqfwu2gdnafhdw6kj77bmc2e
==> No binary for py-jinja2-2.10.3-ccuqt3mppqfwu2gdnafhdw6kj77bmc2e found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-ccuqt3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
==> Installing nmodl-develop-nswa6573eazhleffns23ijmh436w7top
==> No binary for nmodl-develop-nswa6573eazhleffns23ijmh436w7top found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/nmodl-develop-nswa65
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112518/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112518/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:26:41 2021
Hits: 131 / 135 (97.04 %)
Direct: 33 / 135 (24.44 %)
Preprocessed: 98 / 102 (96.08 %)
Misses: 4
Direct: 102
Preprocessed: 4
Uncacheable: 26
Primary storage:
Hits: 164 / 270 (60.74 %)
Misses: 106
Cache size (GB): 0.45 / 0.51 (88.61 %)
Files: 1720
Uncacheable:
Called for linking: 26
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640089605:step_script section_start:1640089605:archive_cache Saving cache for successful job
Creating cache nmodl-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=19291 revision=58ba2b95 version=14.2.0
ccache/: found 2281 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-nvhpc-6
Created cache
section_end:1640089630:archive_cache section_start:1640089630:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=21253 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112518 responseStatus=201 Created token=CmWsdAHm
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=21307 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112518 responseStatus=201 Created token=CmWsdAHm
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=21382 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112518 responseStatus=201 Created token=CmWsdAHm
section_end:1640089632:upload_artifacts_on_success section_start:1640089632:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640089633:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088217:resolve_secrets Resolving secrets
section_end:1640088217:resolve_secrets section_start:1640088217:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor673135313, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112517
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112517
A slurm job will be created with name GL_J112517_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140961
job state: R
section_end:1640088218:prepare_executor section_start:1640088218:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088222:prepare_script section_start:1640088222:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088222:get_sources section_start:1640088222:restore_cache Restoring cache
Checking cache for nmodl-intel-6...
Runtime platform  arch=amd64 os=linux pid=273044 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640088229:restore_cache section_start:1640088229:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (112516)...
Runtime platform  arch=amd64 os=linux pid=273588 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112516 responseStatus=200 OK token=RF9a3MuA
section_end:1640088230:download_artifacts section_start:1640088230:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112517/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112517/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112517/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112517/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112517/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%intel~legacy-unit
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be lqyttqytclxdwwickak7uvjmb6a3au3g
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112517/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112517/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:05:47 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (91.60 %)
Files: 510
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'lqyttqytclxdwwickak7uvjmb6a3au3g'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%intel~legacy-unit
Concretized
--------------------------------
- lqyttqy nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
- ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
- yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
==> Installing py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2
==> No binary for py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
==> Installing py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw
==> No binary for py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw found: installing from source
==> Fetching https://pypi.io/packages/source/m/more-itertools/more-itertools-8.7.0.tar.gz
==> py-more-itertools: Executing phase: 'build'
==> py-more-itertools: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
==> Installing py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k
==> No binary for py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/3d/3df37372226d6e63e1b1e1eda15c594bca98a22d33a23832a90998faa96bc65e.tar.gz
==> py-wcwidth: Executing phase: 'build'
==> py-wcwidth: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
==> Installing py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724
==> No binary for py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
==> Installing py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw
==> No binary for py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
==> Installing py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7
==> No binary for py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
==> Installing py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt
==> No binary for py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/28/28b924174df7a2fa32c1953825ff29c61e2f5e082343165438812f00d3a7fc47.tar.gz
==> py-packaging: Executing phase: 'build'
==> py-packaging: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
==> Installing py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab
==> No binary for py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
==> Installing py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4
==> No binary for py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/fa/fa5fa1622fa6dd5c030e9cad086fa19ef6a0cf6d7a2d12318e10cb49d6d68f34.tar.gz
==> py-pluggy: Executing phase: 'build'
==> py-pluggy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
==> Installing py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq
==> No binary for py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/dc/dc639b046a6e2cff5bbe40194ad65936d6ba360b52b3c3fe1d08a82dd50b5e53.tar.gz
==> py-py: Executing phase: 'build'
==> py-py: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
==> Installing py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557
==> No binary for py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/1d/1d122e8be54d1a709e56f82e2d85dcba3018313d64647f38a91aec88c239b600.tar.gz
==> py-pytest: Executing phase: 'build'
==> py-pytest: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g
==> No binary for nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112517/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112517/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 13:27:55 2021
Hits: 109 / 135 (80.74 %)
Direct: 26 / 135 (19.26 %)
Preprocessed: 83 / 109 (76.15 %)
Misses: 26
Direct: 109
Preprocessed: 26
Uncacheable: 28
Primary storage:
Hits: 135 / 270 (50.00 %)
Misses: 135
Cache size (GB): 0.46 / 0.51 (90.29 %)
Files: 507
Cleanups: 3
Uncacheable:
Called for linking: 28
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640089676:step_script section_start:1640089676:archive_cache Saving cache for successful job
Creating cache nmodl-intel-6...
Runtime platform  arch=amd64 os=linux pid=25002 revision=58ba2b95 version=14.2.0
ccache/: found 1068 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-intel-6
Created cache
section_end:1640089696:archive_cache section_start:1640089696:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=26770 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112517 responseStatus=201 Created token=WxfRYkMZ
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=26811 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=112517 responseStatus=201 Created token=WxfRYkMZ
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=26841 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112517 responseStatus=201 Created token=WxfRYkMZ
section_end:1640089698:upload_artifacts_on_success section_start:1640089698:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640089698:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088172:resolve_secrets Resolving secrets
section_end:1640088172:resolve_secrets section_start:1640088172:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor906781140, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112516
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112516
A slurm job will be created with name GL_J112516_PROD_P112_CP0_C0
Job parameters: memory=512M, cpus_per_task=1, duration=10:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140960
job state: R
section_end:1640088173:prepare_executor section_start:1640088173:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088176:prepare_script section_start:1640088176:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088176:get_sources section_start:1640088176:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ touch spack_clone_variables.env
$ if [[ "${PARSE_GITHUB_PR_DESCRIPTIONS}" == "true" && "${CI_PIPELINE_SOURCE}" == "external_pull_request_event" ]]; then
$ cat > parse_description.py << END_SCRIPT # collapsed multi-line command
$ cat parse_description.py
from __future__ import print_function
import os
import re
import requests
pr_info = requests.get("https://api.github.com/repos/{}/pulls/{}".format(
os.environ['CI_EXTERNAL_PULL_REQUEST_TARGET_REPOSITORY'],
os.environ['CI_EXTERNAL_PULL_REQUEST_IID']),
headers={'Accept': 'application/vnd.github.v3+json'})
pr_body = pr_info.json()["body"]
# match something like NEURON_BRANCH=foo/bar
pat = re.compile('^([A-Z0-9_]+)_([A-Z]+)=([A-Z0-9\-\_\/]+)$', re.IGNORECASE)
def parse_term(m):
ref_type = m.group(2).lower()
if ref_type not in {'branch', 'tag', 'ref'}: return
print('SPACK_PACKAGE_REF_' + m.group(1).lower() + '=' + ref_type + '="' + m.group(3) + '"')
if pr_body is not None:
for pr_body_line in pr_body.splitlines():
if not pr_body_line.startswith('CI_BRANCHES:'): continue
for config_term in pr_body_line[12:].split(','):
pat.sub(parse_term, config_term)
$ python parse_description.py > spack_clone_variables.env
$ cat spack_clone_variables.env
$ fi
$ echo Using ${PWD} as a working directory common to the whole pipeline...
Using /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112516/_ as a working directory common to the whole pipeline...
$ SPACK_BRANCH_PARSED=$(sed -n -e "s/^SPACK_PACKAGE_REF_spack=branch=\(['\"]\)\([^\1]\+\)\1/\2/p" spack_clone_variables.env)
$ SPACK_BRANCH=${SPACK_BRANCH_PARSED:-$SPACK_BRANCH}
$ echo Checking out the ${SPACK_BRANCH} of Spack...
Checking out the develop of Spack...
$ git clone --depth 1 --single-branch --branch ${SPACK_BRANCH} ${SPACK_URL} spack
Cloning into 'spack'...
Checking out files: 9% (767/7696) Checking out files: 10% (770/7696) Checking out files: 11% (847/7696) Checking out files: 12% (924/7696) Checking out files: 13% (1001/7696) Checking out files: 14% (1078/7696) Checking out files: 15% (1155/7696) Checking out files: 16% (1232/7696) Checking out files: 17% (1309/7696) Checking out files: 17% (1382/7696) Checking out files: 18% (1386/7696) Checking out files: 19% (1463/7696) Checking out files: 20% (1540/7696) Checking out files: 21% (1617/7696) Checking out files: 22% (1694/7696) Checking out files: 23% (1771/7696) Checking out files: 24% (1848/7696) Checking out files: 24% (1864/7696) Checking out files: 25% (1924/7696) Checking out files: 26% (2001/7696) Checking out files: 27% (2078/7696) Checking out files: 28% (2155/7696) Checking out files: 29% (2232/7696) Checking out files: 30% (2309/7696) Checking out files: 31% (2386/7696) Checking out files: 31% (2420/7696) Checking out files: 32% (2463/7696) Checking out files: 33% (2540/7696) Checking out files: 34% (2617/7696) Checking out files: 35% (2694/7696) Checking out files: 36% (2771/7696) Checking out files: 37% (2848/7696) Checking out files: 38% (2925/7696) Checking out files: 38% (2973/7696) Checking out files: 39% (3002/7696) Checking out files: 40% (3079/7696) Checking out files: 41% (3156/7696) Checking out files: 42% (3233/7696) Checking out files: 43% (3310/7696) Checking out files: 44% (3387/7696) Checking out files: 44% (3404/7696) Checking out files: 45% (3464/7696) Checking out files: 46% (3541/7696) Checking out files: 47% (3618/7696) Checking out files: 48% (3695/7696) Checking out files: 49% (3772/7696) Checking out files: 50% (3848/7696) Checking out files: 51% (3925/7696) Checking out files: 51% (3937/7696) Checking out files: 52% (4002/7696) Checking out files: 53% (4079/7696) Checking out files: 54% (4156/7696) Checking out files: 55% (4233/7696) Checking out files: 56% (4310/7696) Checking out files: 57% (4387/7696) Checking out files: 57% (4419/7696) Checking out files: 58% (4464/7696) Checking out files: 59% (4541/7696) Checking out files: 60% (4618/7696) Checking out files: 61% (4695/7696) Checking out files: 61% (4729/7696) Checking out files: 62% (4772/7696) Checking out files: 63% (4849/7696) Checking out files: 64% (4926/7696) Checking out files: 65% (5003/7696) Checking out files: 66% (5080/7696) Checking out files: 67% (5157/7696) Checking out files: 68% (5234/7696) Checking out files: 68% (5293/7696) Checking out files: 69% (5311/7696) Checking out files: 70% (5388/7696) Checking out files: 71% (5465/7696) Checking out files: 72% (5542/7696) Checking out files: 73% (5619/7696) Checking out files: 73% (5690/7696) Checking out files: 74% (5696/7696) Checking out files: 75% (5772/7696) Checking out files: 76% (5849/7696) Checking out files: 77% (5926/7696) Checking out files: 78% (6003/7696) Checking out files: 79% (6080/7696) Checking out files: 79% (6112/7696) Checking out files: 80% (6157/7696) Checking out files: 81% (6234/7696) Checking out files: 82% (6311/7696) Checking out files: 83% (6388/7696) Checking out files: 84% (6465/7696) Checking out files: 85% (6542/7696) Checking out files: 85% (6594/7696) Checking out files: 86% (6619/7696) Checking out files: 87% (6696/7696) Checking out files: 88% (6773/7696) Checking out files: 89% (6850/7696) Checking out files: 90% (6927/7696) Checking out files: 91% (7004/7696) Checking out files: 92% (7081/7696) Checking out files: 93% (7158/7696) Checking out files: 94% (7235/7696) Checking out files: 94% (7263/7696) Checking out files: 95% (7312/7696) Checking out files: 96% (7389/7696) Checking out files: 97% (7466/7696) Checking out files: 98% (7543/7696) Checking out files: 99% (7620/7696) Checking out files: 100% (7696/7696) Checking out files: 100% (7696/7696), done.
$ cp /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/config/*.yaml spack/etc/spack
$ SPACK_ROOT=${PWD}/spack
$ echo "SPACK_ROOT=${SPACK_ROOT}" >> spack_clone_variables.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ spack config --scope site add "config:ccache:true"
$ spack config get config
config:
install_tree:
projections:
all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
root: $spack/opt/spack
build_jobs: 36
ccache: true
template_dirs:
- $spack/share/spack/templates
# Locations where different types of modules should be installed.
module_roots:
tcl: $spack/share/spack/modules
lmod: $spack/share/spack/lmod
build_stage:
- $tempdir/$user/spack-stage
- ~/.spack/stage
# - $spack/var/spack/stage
# Directory in which to run tests and store test results.
# Tests will be stored in directories named by date/time and package
# name/hash.
test_stage: ~/.spack/test
source_cache: $spack/var/spack/cache
misc_cache: ~/.spack/cache
connect_timeout: 10
verify_ssl: true
suppress_gpg_warnings: false
install_missing_compilers: false
checksum: true
dirty: false
build_language: C
locks: true
concretizer: original
db_lock_timeout: 300
package_lock_timeout:
shared_linking: rpath
allow_sgid: true
debug: false
$ echo "SPACK_USE_CCACHE=true" >> spack_clone_variables.env
$ if [[ "${CI_PIPELINE_SOURCE}" == "pipeline" ]]; then
section_end:1640088204:step_script section_start:1640088204:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=271984 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=112516 responseStatus=201 Created token=RF9a3MuA
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=272008 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=112516 responseStatus=201 Created token=RF9a3MuA
section_end:1640088206:upload_artifacts_on_success section_start:1640088206:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640088206:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640089351:resolve_secrets Resolving secrets
section_end:1640089351:resolve_secrets section_start:1640089351:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor694779953, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112526
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112526
A slurm job will be created with name GL_J112526_PROD_P112_CP3_C3
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 141050
job state: R
section_end:1640089352:prepare_executor section_start:1640089352:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640089354:prepare_script section_start:1640089354:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640089354:get_sources section_start:1640089354:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (112522)...
Runtime platform  arch=amd64 os=linux pid=24397 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112522 responseStatus=200 OK token=hpX5gjz8
section_end:1640089355:download_artifacts section_start:1640089355:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i4n32
Build name: Linux-nvc++
Create new tag: 20211221-1223 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #1: cmd_interface_test ..................... Passed 1.08 sec
Start 7: ring_binqueue_TEST
2/18 Test #2: interleave_info_constructor_test ....... Passed 2.28 sec
3/18 Test #3: alignment_test ......................... Passed 2.89 sec
Start 8: ring_multisend_TEST
4/18 Test #4: queuing_test ........................... Passed 4.12 sec
5/18 Test #5: lfp_test ............................... Passed 4.15 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 19.56 sec
Start 10: ring_permute1_TEST
7/18 Test #7: ring_binqueue_TEST ..................... Passed 32.62 sec
Start 11: ring_permute2_TEST
8/18 Test #9: ring_spike_buffer_TEST ................. Passed 29.89 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 31.28 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #10: ring_permute1_TEST ..................... Passed 19.84 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 33.34 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST ..........................***Timeout 1500.04 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4102, Min 229.3477, Avg 229.4004
GPU Memory (MBs) : Used = 1920.000000, Free = 30590.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.4102, Min 229.3477, Avg 229.4004
GPU Memory (MBs) : Used = 1922.000000, Free = 30588.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.6484, Min 229.5898, Avg 229.5972
GPU Memory (MBs) : Used = 1922.000000, Free = 30588.500000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.19 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 229.6758, Min 229.6211, Avg 229.6279
GPU Memory (MBs) : Used = 1922.000000, Free = 30588.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o/tests/integration/ring_gap
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.6758, Min 229.6211, Avg 229.6279
GPU Memory (MBs) : Used = 1922.000000, Free = 30588.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.1797, Min 229.7852, Avg 246.3784
GPU Memory (MBs) : Used = 1590.000000, Free = 30920.500000, Total = 32510.500000
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST .................***Timeout 1500.10 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4141, Min 229.3516, Avg 229.4014
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.5938, Min 229.4062, Avg 229.4316
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.7656, Min 229.5938, Avg 229.6152
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.87 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 229.7930, Min 229.6250, Avg 229.6460
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=true
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o/tests/integration/ring_gap_binqueue
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.7930, Min 229.6250, Avg 229.6460
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.2969, Min 229.7891, Avg 246.3950
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................***Timeout 1500.02 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4141, Min 229.3516, Avg 229.4014
GPU Memory (MBs) : Used = 1886.000000, Free = 30624.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.5938, Min 229.4062, Avg 229.4316
GPU Memory (MBs) : Used = 1888.000000, Free = 30622.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.7656, Min 229.5938, Avg 229.6152
GPU Memory (MBs) : Used = 1922.000000, Free = 30588.500000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.58 seconds
Model size : 93.34 kB
Memory (MBs) : After nrn_setup : Max 229.9609, Min 229.6250, Avg 229.6880
GPU Memory (MBs) : Used = 1844.000000, Free = 30666.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=true
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o/tests/integration/ring_gap_multisend
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.9609, Min 229.6250, Avg 229.6880
GPU Memory (MBs) : Used = 1846.000000, Free = 30664.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.2695, Min 229.7617, Avg 246.3677
GPU Memory (MBs) : Used = 1848.000000, Free = 30662.500000, Total = 32510.500000
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST .................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4141, Min 229.3516, Avg 229.4014
GPU Memory (MBs) : Used = 2462.000000, Free = 30048.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.5938, Min 229.4062, Avg 229.4316
GPU Memory (MBs) : Used = 2462.000000, Free = 30048.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.7656, Min 229.5938, Avg 229.6152
GPU Memory (MBs) : Used = 2462.000000, Free = 30048.500000, Total = 32510.500000
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.46 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 229.7930, Min 229.6250, Avg 229.6460
GPU Memory (MBs) : Used = 2462.000000, Free = 30048.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=1
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112522/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o/tests/integration/ring_gap_permute1
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.7930, Min 229.6250, Avg 229.6460
GPU Memory (MBs) : Used = 2462.000000, Free = 30048.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.2969, Min 229.7891, Avg 246.3950
GPU Memory (MBs) : Used = 2462.000000, Free = 30048.500000, Total = 32510.500000
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_unpack: unpack error
srun: error: Invalid IO init header version
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
16/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 100.31 sec
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48614]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48696]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48762]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48764]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48786]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48894]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48968]: Connection reset by peer
17/18 Test #16: ring_gap_permute2_TEST ................. Passed 348.18 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 343.00 sec
78% tests passed, 4 tests failed out of 18
Total Test time (real) = 1882.48 sec
The following tests FAILED:
12 - ring_gap_TEST (Timeout)
13 - ring_gap_binqueue_TEST (Timeout)
14 - ring_gap_multisend_TEST (Timeout)
15 - ring_gap_permute1_TEST (Timeout)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48982]: Connection reset by peer
srun: error: ldir01u09: task 0: Exited with exit code 1
section_end:1640091278:step_script section_start:1640091278:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=34129 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=112526 responseStatus=201 Created token=6NQEo6dr
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=34161 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=112526 responseStatus=201 Created token=6NQEo6dr
section_end:1640091279:upload_artifacts_on_failure section_start:1640091279:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640091280:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640088592:resolve_secrets Resolving secrets
section_end:1640088592:resolve_secrets section_start:1640088592:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor834040280, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112524
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112524
A slurm job will be created with name GL_J112524_PROD_P112_CP3_C3
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 140972
job state: R
section_end:1640088593:prepare_executor section_start:1640088593:prepare_script Preparing environment
Running on r1i4n32 via bbpv1.epfl.ch...
section_end:1640088598:prepare_script section_start:1640088598:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640088599:get_sources section_start:1640088599:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (112520)...
Runtime platform  arch=amd64 os=linux pid=289342 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112520 responseStatus=200 OK token=jknnCyrk
section_end:1640088601:download_artifacts section_start:1640088601:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i4n32
Build name: Linux-icpc
Create new tag: 20211221-1217 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112520/_/spack-build/spack-stage-coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh/spack-build-aevgkbd
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #1: cmd_interface_test ................. Passed 4.15 sec
2/17 Test #3: alignment_test ..................... Passed 4.48 sec
Start 7: ring_binqueue_TEST
3/17 Test #2: interleave_info_constructor_test ... Passed 4.59 sec
4/17 Test #4: queuing_test ....................... Passed 5.54 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 5.81 sec
6/17 Test #17: reporting_1 ........................ Passed 10.25 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 11.55 sec
Start 10: ring_permute1_TEST
8/17 Test #8: ring_multisend_TEST ................ Passed 8.12 sec
Start 11: ring_permute2_TEST
9/17 Test #7: ring_binqueue_TEST ................. Passed 9.50 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 7.83 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 7.43 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #12: ring_gap_TEST ...................... Passed 9.81 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #11: ring_permute2_TEST ................. Passed 10.07 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 6.68 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 9.38 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 5.30 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 6.10 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 30.21 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640089105:step_script section_start:1640089105:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=8466 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=112524 responseStatus=201 Created token=Bw4keC93
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=8513 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=112524 responseStatus=201 Created token=Bw4keC93
section_end:1640089106:upload_artifacts_on_success section_start:1640089106:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640089107:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640090998:resolve_secrets Resolving secrets
section_end:1640090998:resolve_secrets section_start:1640090998:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor664336300, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112525
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112525
A slurm job will be created with name GL_J112525_PROD_P112_CP2_C1
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 141072
job state: PD
job state: PD
job state: R
section_end:1640091001:prepare_executor section_start:1640091001:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640091003:prepare_script section_start:1640091003:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640091004:get_sources section_start:1640091004:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (112521)...
Runtime platform  arch=amd64 os=linux pid=29858 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112521 responseStatus=200 OK token=NRyyu1VN
section_end:1640091005:download_artifacts section_start:1640091005:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i4n32
Build name: Linux-nvc++
Create new tag: 20211221-1250 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #2: interleave_info_constructor_test ....... Passed 1.86 sec
Start 7: ring_binqueue_TEST
2/18 Test #3: alignment_test ......................... Passed 2.04 sec
3/18 Test #1: cmd_interface_test ..................... Passed 2.23 sec
Start 8: ring_multisend_TEST
4/18 Test #4: queuing_test ........................... Passed 2.48 sec
5/18 Test #5: lfp_test ............................... Passed 2.68 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 5.01 sec
Start 10: ring_permute1_TEST
7/18 Test #7: ring_binqueue_TEST ..................... Passed 45.89 sec
Start 11: ring_permute2_TEST
8/18 Test #9: ring_spike_buffer_TEST ................. Passed 45.40 sec
Start 12: ring_gap_TEST
9/18 Test #10: ring_permute1_TEST ..................... Passed 43.21 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #8: ring_multisend_TEST .................... Passed 46.20 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 18.03 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST ..........................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4258, Min 229.2344, Avg 229.3394
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.4258, Min 229.2344, Avg 229.3394
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.6602, Min 229.5781, Avg 229.5884
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.66 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 229.6797, Min 229.5977, Avg 229.6079
GPU Memory (MBs) : Used = 3178.000000, Free = 29332.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.6797, Min 229.5977, Avg 229.6079
GPU Memory (MBs) : Used = 3178.000000, Free = 29332.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.2773, Min 229.7695, Avg 246.3872
GPU Memory (MBs) : Used = 3182.000000, Free = 29328.500000, Total = 32510.500000
psolve | | t: 0.00 ETA: 0h00m00s psolve | | t: 0.75 ETA: 0h11m01s psolve | | t: 1.75 ETA: 0h10m17s psolve |= | t: 2.63 ETA: 0h09m53s psolve |== | t: 3.63 ETA: 0h09m18s psolve |== | t: 4.63 ETA: 0h08m56s psolve |=== | t: 5.38 ETA: 0h09m05s psolve |=== | t: 6.25 ETA: 0h09m00s psolve |=== | t: 6.75 ETA: 0h09m26s psolve |==== | t: 7.25 ETA: 0h09m48s psolve |==== | t: 7.75 ETA: 0h10m18s psolve |==== | t: 8.25 ETA: 0h10m45s psolve |==== | t: 8.75 ETA: 0h11m07s psolve |===== | t: 9.25 ETA: 0h11m26s psolve |===== | t: 9.62 ETA: 0h11m44s psolve |===== | t: 10.12 ETA: 0h11m59s psolve |===== | t: 10.50 ETA: 0h12m21s psolve |====== | t: 10.75 ETA: 0h12m43s psolve |====== | t: 11.12 ETA: 0h13m02s psolve |====== | t: 11.50 ETA: 0h13m20s psolve |====== | t: 12.12 ETA: 0h13m09s psolve |======= | t: 12.50 ETA: 0h13m18s psolve |======= | t: 13.50 ETA: 0h12m48s psolve |======= | t: 13.87 ETA: 0h13m02s psolve |======== | t: 14.25 ETA: 0h13m14s psolve |======== | t: 14.62 ETA: 0h13m25s psolve |======== | t: 15.00 ETA: 0h13m41s psolve |======== | t: 15.37 ETA: 0h13m51s psolve |======== | t: 15.75 ETA: 0h13m54s psolve |========= | t: 16.00 ETA: 0h14m05s psolve |========= | t: 16.37 ETA: 0h14m12s psolve |========= | t: 16.75 ETA: 0h14m24s psolve |========= | t: 17.12 ETA: 0h14m31s psolve |========= | t: 17.50 ETA: 0h14m36s psolve |========== | t: 17.87 ETA: 0h14m42s psolve |========== | t: 18.25 ETA: 0h14m46s psolve |========== | t: 18.62 ETA: 0h14m46s psolve |========== | t: 19.00 ETA: 0h14m51s psolve |=========== | t: 19.37 ETA: 0h14m54s psolve |=========== | t: 19.75 ETA: 0h14m57s psolve |=========== | t: 20.12 ETA: 0h14m56s psolve |=========== | t: 20.50 ETA: 0h14m59s psolve |=========== | t: 20.87 ETA: 0h15m02s psolve |============ | t: 21.25 ETA: 0h15m00s psolve |============ | t: 21.62 ETA: 0h15m02s psolve |============ | t: 22.00 ETA: 0h15m04s psolve |============ | t: 22.37 ETA: 0h15m02s psolve |============ | t: 22.75 ETA: 0h15m06s psolve |============= | t: 23.12 ETA: 0h15m04s psolve |============= | t: 23.37 ETA: 0h15m08s psolve |============= | t: 23.75 ETA: 0h15m08s psolve |============= | t: 24.12 ETA: 0h15m05s psolve |============= | t: 24.50 ETA: 0h15m06s psolve |============== | t: 24.87 ETA: 0h15m09s psolve |============== | t: 25.25 ETA: 0h15m08s psolve |============== | t: 25.62 ETA: 0h15m08s psolve |============== | t: 26.00 ETA: 0h15m07s psolve |=============== | t: 26.37 ETA: 0h15m07s psolve |=============== | t: 26.75 ETA: 0h15m06s psolve |=============== | t: 27.12 ETA: 0h15m05s psolve |=============== | t: 27.50 ETA: 0h15m04s psolve |=============== | t: 27.87 ETA: 0h15m03s psolve |================ | t: 28.25 ETA: 0h15m01s psolve |================ | t: 28.62 ETA: 0h15m00s psolve |================ | t: 29.00 ETA: 0h14m56s psolve |================ | t: 29.25 ETA: 0h14m57s psolve |================ | t: 29.62 ETA: 0h14m55s psolve |================= | t: 30.00 ETA: 0h14m53s psolve |================= | t: 30.37 ETA: 0h14m51s psolve |================= | t: 30.75 ETA: 0h14m49s psolve |================= | t: 31.12 ETA: 0h14m47s psolve |================= | t: 31.50 ETA: 0h14m45s psolve |================== | t: 31.87 ETA: 0h14m42s psolve |================== | t: 32.25 ETA: 0h14m40s psolve |================== | t: 32.62 ETA: 0h14m37s psolve |================== | t: 32.87 ETA: 0h14m37s psolve |================== | t: 33.25 ETA: 0h14m33s psolve |=================== | t: 33.62 ETA: 0h14m30s psolve |=================== | t: 34.00 ETA: 0h14m27s psolve |=================== | t: 34.37 ETA: 0h14m24s psolve |=================== | t: 35.00 ETA: 0h14m12s psolve |==================== | t: 35.37 ETA: 0h14m09s psolve |==================== | t: 35.75 ETA: 0h14m08s psolve |==================== | t: 36.12 ETA: 0h14m05s psolve |==================== | t: 36.50 ETA: 0h14m00s psolve |==================== | t: 36.75 ETA: 0h13m59s psolve |===================== | t: 37.12 ETA: 0h13m54s psolve |===================== | t: 37.50 ETA: 0h13m51s psolve |===================== | t: 37.88 ETA: 0h13m49s psolve |===================== | t: 38.25 ETA: 0h13m44s psolve |====================== | t: 38.63 ETA: 0h13m41s psolve |====================== | t: 39.00 ETA: 0h13m38s psolve |====================== | t: 39.38 ETA: 0h13m34s psolve |====================== | t: 39.75 ETA: 0h13m30s psolve |====================== | t: 40.13 ETA: 0h13m27s psolve |======================= | t: 40.50 ETA: 0h13m23s psolve |======================= | t: 40.75 ETA: 0h13m22s psolve |======================= | t: 41.13 ETA: 0h13m18s psolve |======================= | t: 41.50 ETA: 0h13m15s psolve |======================= | t: 41.88 ETA: 0h13m09s psolve |======================== | t: 42.25 ETA: 0h13m05s psolve |======================== | t: 42.63 ETA: 0h13m02s psolve |======================== | t: 42.88 ETA: 0h13m00s psolve |======================== | t: 43.25 ETA: 0h12m55s psolve |======================== | t: 43.50 ETA: 0h12m54s psolve |========================= | t: 43.88 ETA: 0h12m48s psolve |========================= | t: 44.13 ETA: 0h12m47s psolve |========================= | t: 44.50 ETA: 0h12m43s psolve |========================= | t: 44.88 ETA: 0h12m39s psolve |========================= | t: 45.25 ETA: 0h12m35s psolve |========================== | t: 45.63 ETA: 0h12m30s psolve |========================== | t: 46.00 ETA: 0h12m26s psolve |========================== | t: 46.38 ETA: 0h12m22s psolve |========================== | t: 46.75 ETA: 0h12m18s psolve |========================== | t: 47.13 ETA: 0h12m13s psolve |=========================== | t: 47.38 ETA: 0h12m12s psolve |=========================== | t: 47.75 ETA: 0h12m07s psolve |=========================== | t: 48.13 ETA: 0h12m03s psolve |=========================== | t: 48.50 ETA: 0h11m57s psolve |=========================== | t: 48.88 ETA: 0h11m53s psolve |============================ | t: 49.25 ETA: 0h11m49s psolve |============================ | t: 49.63 ETA: 0h11m46s psolve |============================ | t: 50.00 ETA: 0h11m41s psolve |============================ | t: 50.25 ETA: 0h11m38s psolve |============================ | t: 50.63 ETA: 0h11m34s psolve |============================= | t: 51.00 ETA: 0h11m28s psolve |============================= | t: 51.38 ETA: 0h11m24s psolve |============================= | t: 51.75 ETA: 0h11m19s psolve |============================= | t: 52.13 ETA: 0h11m14s psolve |============================= | t: 52.50 ETA: 0h11m08s psolve |============================== | t: 52.88 ETA: 0h11m03s psolve |============================== | t: 53.25 ETA: 0h10m59s psolve |============================== | t: 53.63 ETA: 0h10m54s psolve |============================== | t: 54.00 ETA: 0h10m49s psolve |============================== | t: 54.38 ETA: 0h10m44s psolve |=============================== | t: 54.75 ETA: 0h10m38s psolve |=============================== | t: 55.13 ETA: 0h10m34s psolve |=============================== | t: 55.50 ETA: 0h10m29s psolve |=============================== | t: 55.88 ETA: 0h10m24s psolve |================================ | t: 56.25 ETA: 0h10m19s psolve |================================ | t: 56.63 ETA: 0h10m15s psolve |================================ | t: 57.00 ETA: 0h10m10s psolve |================================ | t: 57.38 ETA: 0h10m05s psolve |================================ | t: 57.63 ETA: 0h10m02s psolve |================================= | t: 58.00 ETA: 0h09m58s psolve |================================= | t: 58.38 ETA: 0h09m53s psolve |================================= | t: 58.75 ETA: 0h09m48s psolve |================================= | t: 59.13 ETA: 0h09m42s psolve |================================= | t: 59.50 ETA: 0h09m37s psolve |================================== | t: 59.75 ETA: 0h09m35s psolve |================================== | t: 60.13 ETA: 0h09m30s psolve |================================== | t: 60.38 ETA: 0h09m27s psolve |================================== | t: 60.75 ETA: 0h09m22s psolve |================================== | t: 61.13 ETA: 0h09m17s psolve |=================================== | t: 61.50 ETA: 0h09m12s psolve |=================================== | t: 61.88 ETA: 0h09m07s psolve |=================================== | t: 62.13 ETA: 0h09m04s psolve |=================================== | t: 62.50 ETA: 0h08m59s psolve |=================================== | t: 63.00 ETA: 0h08m50s psolve |==================================== | t: 63.38 ETA: 0h08m45s psolve |==================================== | t: 63.75 ETA: 0h08m40s psolve |==================================== | t: 64.13 ETA: 0h08m35s psolve |==================================== | t: 64.50 ETA: 0h08m30s psolve |==================================== | t: 64.88 ETA: 0h08m25s psolve |===================================== | t: 65.25 ETA: 0h08m20s psolve |===================================== | t: 65.63 ETA: 0h08m15s psolve |===================================== | t: 66.00 ETA: 0h08m09s psolve |===================================== | t: 66.38 ETA: 0h08m04s psolve |===================================== | t: 66.63 ETA: 0h08m01s psolve |====================================== | t: 67.00 ETA: 0h07m56s psolve |====================================== | t: 67.38 ETA: 0h07m51s psolve |====================================== | t: 68.13 ETA: 0h07m38s psolve |====================================== | t: 68.38 ETA: 0h07m35s psolve |======================================= | t: 68.75 ETA: 0h07m30s psolve |======================================= | t: 69.13 ETA: 0h07m24s psolve |======================================= | t: 69.50 ETA: 0h07m19s psolve |======================================= | t: 69.88 ETA: 0h07m14s psolve |======================================== | t: 70.25 ETA: 0h07m08s psolve |======================================== | t: 70.50 ETA: 0h07m05s psolve |======================================== | t: 70.88 ETA: 0h07m00s psolve |======================================== | t: 71.13 ETA: 0h06m57s psolve |======================================== | t: 71.50 ETA: 0h06m52s psolve |======================================== | t: 71.88 ETA: 0h06m46s psolve |========================================= | t: 72.38 ETA: 0h06m39s psolve |========================================= | t: 72.75 ETA: 0h06m34s psolve |========================================= | t: 73.13 ETA: 0h06m28s psolve |========================================= | t: 73.50 ETA: 0h06m23s psolve |========================================== | t: 73.88 ETA: 0h06m18s psolve |========================================== | t: 74.25 ETA: 0h06m13s psolve |========================================== | t: 74.63 ETA: 0h06m07s psolve |========================================== | t: 75.00 ETA: 0h06m02s psolve |========================================== | t: 75.25 ETA: 0h05m59s psolve |=========================================== | t: 75.63 ETA: 0h05m53s psolve |=========================================== | t: 76.00 ETA: 0h05m48s psolve |=========================================== | t: 76.38 ETA: 0h05m43s psolve |=========================================== | t: 76.75 ETA: 0h05m37s psolve |=========================================== | t: 77.13 ETA: 0h05m32s psolve |============================================ | t: 77.38 ETA: 0h05m28s psolve |============================================ | t: 77.88 ETA: 0h05m21s psolve |============================================ | t: 78.25 ETA: 0h05m15s psolve |============================================ | t: 78.63 ETA: 0h05m10s psolve |============================================= | t: 79.00 ETA: 0h05m05s psolve |============================================= | t: 79.38 ETA: 0h04m59s psolve |============================================= | t: 79.75 ETA: 0h04m54s psolve |============================================= | t: 80.13 ETA: 0h04m49s psolve |============================================= | t: 80.50 ETA: 0h04m43s psolve |============================================== | t: 80.88 ETA: 0h04m38s psolve |============================================== | t: 81.25 ETA: 0h04m33s psolve |============================================== | t: 81.75 ETA: 0h04m25s psolve |============================================== | t: 82.13 ETA: 0h04m20s psolve |=============================================== | t: 82.50 ETA: 0h04m14s psolve |=============================================== | t: 82.88 ETA: 0h04m09s psolve |=============================================== | t: 83.25 ETA: 0h04m04s psolve |=============================================== | t: 83.63 ETA: 0h03m58s psolve |=============================================== | t: 84.00 ETA: 0h03m53s psolve |================================================ | t: 84.38 ETA: 0h03m47s psolve |================================================ | t: 84.63 ETA: 0h03m44s psolve |================================================ | t: 85.00 ETA: 0h03m39s psolve |================================================ | t: 85.38 ETA: 0h03m33s psolve |================================================ | t: 85.75 ETA: 0h03m28s psolve |================================================= | t: 86.25 ETA: 0h03m20s psolve |================================================= | t: 86.50 ETA: 0h03m17s psolve |================================================= | t: 86.88 ETA: 0h03m11s psolve |================================================= | t: 87.25 ETA: 0h03m06s psolve |================================================= | t: 87.63 ETA: 0h03m00s psolve |================================================== | t: 88.00 ETA: 0h02m55s psolve |================================================== | t: 88.25 ETA: 0h02m52s psolve |================================================== | t: 88.63 ETA: 0h02m46s psolve |================================================== | t: 89.00 ETA: 0h02m41s psolve |================================================== | t: 89.38 ETA: 0h02m35s psolve |=================================================== | t: 89.75 ETA: 0h02m30s psolve |=================================================== | t: 90.13 ETA: 0h02m24s psolve |=================================================== | t: 90.50 ETA: 0h02m19s psolve |=================================================== | t: 90.88 ETA: 0h02m13s psolve |==================================================== | t: 91.25 ETA: 0h02m08s psolve |==================================================== | t: 91.63 ETA: 0h02m02s psolve |==================================================== | t: 92.00 ETA: 0h01m57s psolve |==================================================== | t: 92.38 ETA: 0h01m52s psolve |==================================================== | t: 92.75 ETA: 0h01m46s psolve |===================================================== | t: 93.13 ETA: 0h01m41s psolve |===================================================== | t: 93.50 ETA: 0h01m35s psolve |===================================================== | t: 93.88 ETA: 0h01m30s psolve |===================================================== | t: 94.25 ETA: 0h01m24s psolve |===================================================== | t: 94.63 ETA: 0h01m19s psolve |====================================================== | t: 95.00 ETA: 0h01m13s psolve |====================================================== | t: 95.75 ETA: 0h01m02s psolve |====================================================== | t: 96.13 ETA: 0h00m56s psolve |======================================================= | t: 96.50 ETA: 0h00m51s psolve |======================================================= | t: 96.88 ETA: 0h00m45s psolve |======================================================= | t: 97.13 ETA: 0h00m42s psolve |======================================================= | t: 97.50 ETA: 0h00m36s psolve |======================================================= | t: 97.88 ETA: 0h00m31s psolve |======================================================== | t: 98.50 ETA: 0h00m21s psolve |======================================================== | t: 98.88 ETA: 0h00m16s psolve |======================================================== | t: 99.25 ETA: 0h00m11s psolve |======================================================== | t: 99.50 ETA: 0h00m07s psolve |======================================================== | t: 99.88 ETA: 0h00m01s psolve |=========================================================| t: 100.00 ETA: 0h24m29s
Solver Time : 1469.04
Simulation Statistics
Number of cells: 20
Number of compartments: 804
Number of presyns: 21
Number of input presyns: 0
Number of synapses: 1
Number of point processes: 81
Number of transfer sources: 40
Number of transfer targets: 40
Number of spikes: 20
Number of spikes with non negative gid-s: 20
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST .................***Timeout 1500.08 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4883, Min 229.2305, Avg 229.3467
GPU Memory (MBs) : Used = 2162.000000, Free = 30348.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.4883, Min 229.2305, Avg 229.3467
GPU Memory (MBs) : Used = 2162.000000, Free = 30348.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.6562, Min 229.5781, Avg 229.5879
GPU Memory (MBs) : Used = 2162.000000, Free = 30348.500000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.01 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 229.6758, Min 229.5977, Avg 229.6074
GPU Memory (MBs) : Used = 2162.000000, Free = 30348.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=true
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap_binqueue
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.6758, Min 229.5977, Avg 229.6074
GPU Memory (MBs) : Used = 2162.000000, Free = 30348.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.3008, Min 229.7695, Avg 246.3970
GPU Memory (MBs) : Used = 2166.000000, Free = 30344.500000, Total = 32510.500000
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................***Timeout 1500.04 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4883, Min 229.2344, Avg 229.3472
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.4883, Min 229.2344, Avg 229.3472
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.6562, Min 229.5781, Avg 229.5879
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.33 seconds
Model size : 93.34 kB
Memory (MBs) : After nrn_setup : Max 229.8477, Min 229.5977, Avg 229.6504
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=true
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap_multisend
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.8477, Min 229.5977, Avg 229.6504
GPU Memory (MBs) : Used = 3174.000000, Free = 29336.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.3008, Min 229.7656, Avg 246.3848
GPU Memory (MBs) : Used = 3182.000000, Free = 29328.500000, Total = 32510.500000
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST .................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 27bd6c88 (2021-12-21 11:30:07 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 229.4883, Min 229.2344, Avg 229.3472
GPU Memory (MBs) : Used = 3792.000000, Free = 28718.500000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 229.4883, Min 229.2344, Avg 229.3472
GPU Memory (MBs) : Used = 3792.000000, Free = 28718.500000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 229.6562, Min 229.5781, Avg 229.5879
GPU Memory (MBs) : Used = 3792.000000, Free = 28718.500000, Total = 32510.500000
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.50 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 229.6758, Min 229.5977, Avg 229.6074
GPU Memory (MBs) : Used = 3792.000000, Free = 28718.500000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=1
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112521/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap_permute1
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 229.6758, Min 229.5977, Avg 229.6074
GPU Memory (MBs) : Used = 3792.000000, Free = 28718.500000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 296.2422, Min 229.7695, Avg 246.3823
GPU Memory (MBs) : Used = 3796.000000, Free = 28714.500000, Total = 32510.500000
16/18 Test #16: ring_gap_permute2_TEST ................. Passed 63.63 sec
17/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 69.48 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 69.67 sec
78% tests passed, 4 tests failed out of 18
Total Test time (real) = 1618.17 sec
The following tests FAILED:
12 - ring_gap_TEST (Timeout)
13 - ring_gap_binqueue_TEST (Timeout)
14 - ring_gap_multisend_TEST (Timeout)
15 - ring_gap_permute1_TEST (Timeout)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: ldir01u09: task 0: Exited with exit code 1
section_end:1640092658:step_script section_start:1640092658:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=51370 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=112525 responseStatus=201 Created token=zy2qiXqU
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=51401 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=112525 responseStatus=201 Created token=zy2qiXqU
section_end:1640092661:upload_artifacts_on_failure section_start:1640092661:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640092662:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640090935:resolve_secrets Resolving secrets
section_end:1640090935:resolve_secrets section_start:1640090935:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor545892444, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112523
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112523
A slurm job will be created with name GL_J112523_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 141070
job state: R
section_end:1640090936:prepare_executor section_start:1640090936:prepare_script Preparing environment
Running on r1i5n23 via bbpv1.epfl.ch...
section_end:1640090940:prepare_script section_start:1640090940:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640090941:get_sources section_start:1640090941:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (112519)...
Runtime platform  arch=amd64 os=linux pid=253563 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112519 responseStatus=200 OK token=1xDe_fH3
section_end:1640090942:download_artifacts section_start:1640090942:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:46798]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47096]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47482]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47488]: Connection reset by peer
Site: r1i4n32
Build name: Linux-icpc
Create new tag: 20211221-1250 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112519/_/spack-build/spack-stage-coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3/spack-build-cwjs4t3
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47552]: Connection reset by peer
1/17 Test #2: interleave_info_constructor_test ... Passed 3.00 sec
2/17 Test #3: alignment_test ..................... Passed 3.49 sec
Start 7: ring_binqueue_TEST
3/17 Test #4: queuing_test ....................... Passed 3.83 sec
4/17 Test #1: cmd_interface_test ................. Passed 4.01 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 5.09 sec
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47668]: Connection reset by peer
6/17 Test #17: reporting_1 ........................ Passed 8.62 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 9.43 sec
Start 10: ring_permute1_TEST
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47762]: Connection reset by peer
8/17 Test #7: ring_binqueue_TEST ................. Passed 12.03 sec
Start 11: ring_permute2_TEST
9/17 Test #8: ring_multisend_TEST ................ Passed 11.36 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 7.61 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 7.25 sec
Start 14: ring_gap_multisend_TEST
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:47888]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:48622]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:49620]: Insane message length
12/17 Test #11: ring_permute2_TEST ................. Passed 37.65 sec
Start 15: ring_gap_permute1_TEST
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_unpack: unpack error
srun: error: Invalid IO init header version
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37466]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37482]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37496]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37498]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37518]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37552]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37580]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37594]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37608]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:37614]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56068]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38078]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56262]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38150]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56362]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56364]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56388]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56390]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56394]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38440]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38442]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38546]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38556]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56830]: Connection reset by peer
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56838]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56854]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:56856]: Insane message length
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:38896]: Connection reset by peer
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: io_init_msg_read_from_fd: reading slurm_io_init_msg failed: Connection reset by peer
srun: error: failed reading io init message
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:39208]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:39210]: Insane message length
srun: error: eio_message_socket_accept: slurm_receive_msg[10.80.3.19:39212]: Insane message length
13/17 Test #13: ring_gap_binqueue_TEST ............. Passed 1139.58 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #14: ring_gap_multisend_TEST ............ Passed 1170.88 sec
15/17 Test #12: ring_gap_TEST ...................... Passed 1197.51 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 1168.36 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 65.82 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 1222.15 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640092243:step_script section_start:1640092243:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=297959 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=112523 responseStatus=201 Created token=5AxrV9jB
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=297990 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=112523 responseStatus=201 Created token=5AxrV9jB
section_end:1640092245:upload_artifacts_on_success section_start:1640092245:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640092246:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640092102:resolve_secrets Resolving secrets
section_end:1640092102:resolve_secrets section_start:1640092102:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor209136998, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30092, build ref 27bd6c88db277042842987f0c6748ae9ba9e57f3, job ID 112534
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30092/J112534
A slurm job will be created with name GL_J112534_PROD_P112_CP1_C2
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 141233
job state: R
section_end:1640092104:prepare_executor section_start:1640092104:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640092104:prepare_script section_start:1640092104:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640092105:get_sources section_start:1640092105:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:gpu (112530)...
Runtime platform  arch=amd64 os=linux pid=38007 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=112530 responseStatus=200 OK token=xdQWnAYo
section_end:1640092106:download_artifacts section_start:1640092106:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i4n32
Build name: Linux-nvc++
Create new tag: 20211221-1309 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30092/J112530/_/spack-build/spack-stage-neuron-develop-vkogqddlipn6wfzq2o4mkbt36t7uknzy/spack-build-vkogqdd
Start 48: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 52: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 69: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 73: testcorenrn_deriv::coreneuron_cpu_offline::preparation
1/162 Test #69: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 2.59 sec
Start 87: testcorenrn_patstim::coreneuron_gpu_offline::preparation
2/162 Test #59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 2.63 sec
Start 125: testcorenrn_conc::coreneuron_gpu_offline::preparation
3/162 Test #63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.68 sec
Start 129: testcorenrn_conc::coreneuron_cpu_offline::preparation
4/162 Test #73: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.69 sec
Start 135: testcorenrn_kin::coreneuron_gpu_offline::preparation
5/162 Test #52: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 4.28 sec
Start 79: testcorenrn_gf::coreneuron_gpu_offline::preparation
6/162 Test #48: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 4.35 sec
Start 83: testcorenrn_gf::coreneuron_cpu_offline::preparation
7/162 Test #87: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 1.77 sec
Start 139: testcorenrn_kin::coreneuron_cpu_offline::preparation
8/162 Test #125: testcorenrn_conc::coreneuron_gpu_offline::preparation .............. Passed 1.82 sec
Start 44: external_ringtest::neuron
9/162 Test #129: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 1.80 sec
Start 55: testcorenrn_bbcore::neuron
10/162 Test #135: testcorenrn_kin::coreneuron_gpu_offline::preparation ............... Passed 1.82 sec
Start 56: testcorenrn_bbcore::coreneuron_gpu_online
11/162 Test #139: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 1.92 sec
Start 57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
12/162 Test #79: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 2.14 sec
Start 89: testcorenrn_patstim::coreneuron_cpu_offline::preparation
13/162 Test #44: external_ringtest::neuron .......................................... Passed 2.07 sec
Start 58: testcorenrn_bbcore::coreneuron_gpu_offline
14/162 Test #83: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 2.35 sec
Start 95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
15/162 Test #55: testcorenrn_bbcore::neuron ......................................... Passed 2.21 sec
Start 60: testcorenrn_bbcore::coreneuron_cpu_online
16/162 Test #56: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 3.03 sec
Start 61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
17/162 Test #89: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 1.93 sec
Start 99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
18/162 Test #95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 2.32 sec
Start 115: testcorenrn_watch::coreneuron_gpu_offline::preparation
19/162 Test #58: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 3.33 sec
Start 62: testcorenrn_bbcore::coreneuron_cpu_offline
20/162 Test #99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 2.25 sec
Start 119: testcorenrn_watch::coreneuron_cpu_offline::preparation
21/162 Test #60: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 3.98 sec
Start 65: testcorenrn_deriv::neuron
22/162 Test #115: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 2.53 sec
Start 45: external_ringtest::neuron_mpi
23/162 Test #57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 5.47 sec
Start 66: testcorenrn_deriv::coreneuron_gpu_online
24/162 Test #62: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 1.97 sec
Start 67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
25/162 Test #61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 4.30 sec
Start 68: testcorenrn_deriv::coreneuron_gpu_offline
26/162 Test #119: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 1.60 sec
Start 46: external_ringtest::coreneuron_cpu_mpi
27/162 Test #65: testcorenrn_deriv::neuron .......................................... Passed 1.53 sec
Start 70: testcorenrn_deriv::coreneuron_cpu_online
28/162 Test #70: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 4.46 sec
Start 71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
29/162 Test #68: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 6.19 sec
Start 72: testcorenrn_deriv::coreneuron_cpu_offline
30/162 Test #45: external_ringtest::neuron_mpi ...................................... Passed 6.89 sec
Start 47: external_ringtest::coreneuron_cpu_mpi_offline
31/162 Test #66: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 7.52 sec
Start 86: testcorenrn_patstim::coreneuron_gpu_offline
32/162 Test #67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 7.49 sec
Start 121: testcorenrn_conc::neuron
33/162 Test #121: testcorenrn_conc::neuron ........................................... Passed 1.56 sec
Start 122: testcorenrn_conc::coreneuron_gpu_online
34/162 Test #71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 4.47 sec
Start 123: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate
35/162 Test #46: external_ringtest::coreneuron_cpu_mpi .............................. Passed 9.00 sec
Start 50: external_ringtest::coreneuron_gpu_mpi
36/162 Test #72: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 3.23 sec
Start 124: testcorenrn_conc::coreneuron_gpu_offline
37/162 Test #47: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 4.04 sec
Start 51: external_ringtest::coreneuron_gpu_mpi_offline
38/162 Test #86: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 3.39 sec
Start 126: testcorenrn_conc::coreneuron_cpu_online
39/162 Test #124: testcorenrn_conc::coreneuron_gpu_offline ........................... Passed 6.92 sec
Start 127: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
40/162 Test #122: testcorenrn_conc::coreneuron_gpu_online ............................ Passed 7.35 sec
Start 128: testcorenrn_conc::coreneuron_cpu_offline
41/162 Test #123: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate ........... Passed 7.78 sec
Start 131: testcorenrn_kin::neuron
42/162 Test #126: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 7.69 sec
Start 132: testcorenrn_kin::coreneuron_gpu_online
43/162 Test #128: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 2.41 sec
Start 133: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate
44/162 Test #131: testcorenrn_kin::neuron ............................................ Passed 1.83 sec
Start 134: testcorenrn_kin::coreneuron_gpu_offline
45/162 Test #51: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 10.74 sec
Start 75: testcorenrn_gf::neuron
46/162 Test #50: external_ringtest::coreneuron_gpu_mpi .............................. Passed 12.68 sec
Start 76: testcorenrn_gf::coreneuron_gpu_online
47/162 Test #127: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 5.80 sec
Start 136: testcorenrn_kin::coreneuron_cpu_online
48/162 Test #134: testcorenrn_kin::coreneuron_gpu_offline ............................ Passed 6.15 sec
Start 137: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
49/162 Test #132: testcorenrn_kin::coreneuron_gpu_online ............................. Passed 6.96 sec
Start 138: testcorenrn_kin::coreneuron_cpu_offline
50/162 Test #136: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 4.05 sec
Start 144: channel_benchmark_hippo::neuron
51/162 Test #75: testcorenrn_gf::neuron ............................................. Passed 4.93 sec
Start 77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
52/162 Test #133: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate ............ Passed 7.56 sec
Start 145: channel_benchmark_hippo::coreneuron_gpu_online
53/162 Test #138: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 2.15 sec
Start 146: channel_benchmark_hippo::coreneuron_gpu_filemode
54/162 Test #137: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 4.10 sec
Start 147: channel_benchmark_hippo::coreneuron_cpu_online
55/162 Test #76: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 15.25 sec
Start 78: testcorenrn_gf::coreneuron_gpu_offline
56/162 Test #77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 31.42 sec
Start 80: testcorenrn_gf::coreneuron_cpu_online
57/162 Test #78: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 24.08 sec
Start 81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
58/162 Test #80: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 23.42 sec
Start 82: testcorenrn_gf::coreneuron_cpu_offline
59/162 Test #81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 28.02 sec
Start 85: testcorenrn_patstim::neuron
60/162 Test #85: testcorenrn_patstim::neuron ........................................ Passed 3.43 sec
Start 88: testcorenrn_patstim::coreneuron_cpu_offline
61/162 Test #82: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 15.20 sec
Start 91: testcorenrn_vecplay::neuron
62/162 Test #91: testcorenrn_vecplay::neuron ........................................ Passed 2.93 sec
Start 92: testcorenrn_vecplay::coreneuron_gpu_online
63/162 Test #88: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 10.78 sec
Start 93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
64/162 Test #144: channel_benchmark_hippo::neuron .................................... Passed 85.94 sec
Start 148: channel_benchmark_hippo::coreneuron_cpu_filemode
65/162 Test #145: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 85.92 sec
Start 150: channel_benchmark_sscx::neuron
66/162 Test #92: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 32.74 sec
Start 94: testcorenrn_vecplay::coreneuron_gpu_offline
67/162 Test #146: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 108.30 sec
Start 151: channel_benchmark_sscx::coreneuron_gpu_online
68/162 Test #147: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 117.00 sec
Start 152: channel_benchmark_sscx::coreneuron_gpu_filemode
69/162 Test #93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 46.74 sec
Start 96: testcorenrn_vecplay::coreneuron_cpu_online
70/162 Test #94: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 42.16 sec
Start 97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
71/162 Test #96: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 25.32 sec
Start 98: testcorenrn_vecplay::coreneuron_cpu_offline
72/162 Test #150: channel_benchmark_sscx::neuron ..................................... Passed 70.11 sec
Start 153: channel_benchmark_sscx::coreneuron_cpu_online
73/162 Test #98: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 27.13 sec
Start 111: testcorenrn_watch::neuron
74/162 Test #148: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 92.75 sec
Start 154: channel_benchmark_sscx::coreneuron_cpu_filemode
75/162 Test #111: testcorenrn_watch::neuron .......................................... Passed 2.50 sec
Start 112: testcorenrn_watch::coreneuron_gpu_online
76/162 Test #97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 31.62 sec
Start 113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
77/162 Test #151: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 78.51 sec
Start 1: testneuron
78/162 Test #1: testneuron ......................................................... Passed 0.06 sec
Start 2: ringtest
79/162 Test #2: ringtest ........................................................... Passed 0.33 sec
Start 3: connect_dend
80/162 Test #3: connect_dend ....................................................... Passed 0.15 sec
Start 4: pynrn_tests::basic_tests
81/162 Test #152: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 69.89 sec
Start 5: rxdmod_tests::rxd_tests
82/162 Test #112: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 17.43 sec
Start 114: testcorenrn_watch::coreneuron_gpu_offline
83/162 Test #4: pynrn_tests::basic_tests ........................................... Passed 8.93 sec
Start 6: rxdmod_tests::rxd_mpi_tests
84/162 Test #113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 24.44 sec
Start 116: testcorenrn_watch::coreneuron_cpu_online
85/162 Test #114: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 18.08 sec
Start 117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
86/162 Test #153: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 58.45 sec
Start 7: parallel_tests
87/162 Test #116: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 11.40 sec
Start 118: testcorenrn_watch::coreneuron_cpu_offline
88/162 Test #7: parallel_tests ..................................................... Passed 7.40 sec
Start 8: parallel_partrans
89/162 Test #8: parallel_partrans .................................................. Passed 3.67 sec
Start 9: parallel_bas
90/162 Test #118: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 10.53 sec
Start 141: testcorenrn_netstimdirect::direct_netstimdirect
91/162 Test #117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 14.79 sec
Start 142: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
92/162 Test #154: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 54.27 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
93/162 Test #9: parallel_bas ....................................................... Passed 8.55 sec
Start 11: coreneuron_modtests::direct_py_cpu
94/162 Test #141: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 10.08 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
Start 13: coreneuron_modtests::spikes_py_cpu
95/162 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 4.51 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
96/162 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 3.40 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
97/162 Test #142: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 9.07 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
Start 17: coreneuron_modtests::test_units_py_cpu
98/162 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 3.99 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
99/162 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 2.81 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
100/162 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 5.53 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
101/162 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 4.39 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
102/162 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 5.36 sec
Start 25: coreneuron_modtests::direct_py_gpu
103/162 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 4.46 sec
Start 26: coreneuron_modtests::direct_hoc_gpu
104/162 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 6.67 sec
Start 27: coreneuron_modtests::spikes_py_gpu
105/162 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 4.48 sec
Start 28: coreneuron_modtests::spikes_file_mode_py_gpu
106/162 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 4.16 sec
Start 29: coreneuron_modtests::fast_imem_py_gpu
107/162 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 10.84 sec
Start 30: coreneuron_modtests::datareturn_py_gpu
108/162 Test #29: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 4.30 sec
Start 31: coreneuron_modtests::test_units_py_gpu
109/162 Test #25: coreneuron_modtests::direct_py_gpu ................................. Passed 8.56 sec
Start 32: coreneuron_modtests::test_netmove_py_gpu
110/162 Test #26: coreneuron_modtests::direct_hoc_gpu ................................ Passed 6.67 sec
Start 33: coreneuron_modtests::test_watchrange_py_gpu
111/162 Test #28: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 9.03 sec
Start 34: coreneuron_modtests::test_psolve_py_gpu
112/162 Test #27: coreneuron_modtests::spikes_py_gpu ................................. Passed 10.41 sec
Start 35: coreneuron_modtests::test_natrans_py_gpu
113/162 Test #31: coreneuron_modtests::test_units_py_gpu ............................. Passed 5.64 sec
Start 39: external_nrntest
114/162 Test #33: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 6.21 sec
Start 64: testcorenrn_bbcore::compare_results
115/162 Test #64: testcorenrn_bbcore::compare_results ................................ Passed 0.07 sec
Start 74: testcorenrn_deriv::compare_results
116/162 Test #74: testcorenrn_deriv::compare_results ................................. Passed 0.06 sec
Start 84: testcorenrn_gf::compare_results
117/162 Test #84: testcorenrn_gf::compare_results .................................... Passed 0.06 sec
Start 90: testcorenrn_patstim::compare_results
118/162 Test #90: testcorenrn_patstim::compare_results ............................... Passed 0.06 sec
Start 100: testcorenrn_vecplay::compare_results
119/162 Test #100: testcorenrn_vecplay::compare_results ............................... Passed 0.06 sec
Start 120: testcorenrn_watch::compare_results
120/162 Test #120: testcorenrn_watch::compare_results ................................. Passed 0.06 sec
Start 130: testcorenrn_conc::compare_results
121/162 Test #130: testcorenrn_conc::compare_results .................................. Passed 0.06 sec
Start 140: testcorenrn_kin::compare_results
122/162 Test #140: testcorenrn_kin::compare_results ................................... Passed 0.07 sec
Start 143: testcorenrn_netstimdirect::compare_results
123/162 Test #143: testcorenrn_netstimdirect::compare_results ......................... Passed 0.06 sec
Start 149: channel_benchmark_hippo::compare_results
124/162 Test #149: channel_benchmark_hippo::compare_results ........................... Passed 0.07 sec
Start 155: channel_benchmark_sscx::compare_results
125/162 Test #155: channel_benchmark_sscx::compare_results ............................ Passed 0.14 sec
126/162 Test #35: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 3.17 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
127/162 Test #34: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 4.18 sec
128/162 Test #30: coreneuron_modtests::datareturn_py_gpu ............................. Passed 11.70 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
129/162 Test #32: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 12.45 sec
130/162 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 5.16 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
131/162 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 9.18 sec
Start 36: coreneuron_modtests::spikes_mpi_py_gpu
132/162 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 9.43 sec
Start 37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
133/162 Test #36: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 12.71 sec
Start 38: coreneuron_modtests::inputpresyn_py_gpu
134/162 Test #37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 15.00 sec
135/162 Test #38: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 12.61 sec
Start 105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
136/162 Test #105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 9.76 sec
Start 109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
137/162 Test #109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 3.44 sec
Start 157: olfactory-bulb-3d::neuron::preparation
138/162 Test #157: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.02 sec
Start 159: olfactory-bulb-3d::coreneuron_gpu_online::preparation
139/162 Test #159: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.02 sec
Start 161: olfactory-bulb-3d::coreneuron_cpu_online::preparation
140/162 Test #161: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.02 sec
Start 40: reduced_dentate::neuron
141/162 Test #40: reduced_dentate::neuron ............................................ Passed 51.26 sec
Start 41: reduced_dentate::coreneuron_cpu
142/162 Test #39: external_nrntest ................................................... Passed 128.06 sec
143/162 Test #41: reduced_dentate::coreneuron_cpu .................................... Passed 46.24 sec
Start 42: reduced_dentate::coreneuron_gpu
144/162 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 249.75 sec
145/162 Test #42: reduced_dentate::coreneuron_gpu .................................... Passed 64.55 sec
Start 49: external_ringtest::coreneuron_cpu_mpi_threads
Start 43: reduced_dentate::compare_results
146/162 Test #43: reduced_dentate::compare_results ................................... Passed 0.06 sec
147/162 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 271.33 sec
148/162 Test #49: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 3.06 sec
Start 53: external_ringtest::coreneuron_gpu_mpi_threads
149/162 Test #53: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 8.56 sec
Start 101: testcorenrn_vecevent::neuron
Start 102: testcorenrn_vecevent::coreneuron_gpu_online
150/162 Test #101: testcorenrn_vecevent::neuron ....................................... Passed 2.46 sec
Start 103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
151/162 Test #102: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 12.24 sec
Start 104: testcorenrn_vecevent::coreneuron_gpu_offline
152/162 Test #103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 10.57 sec
Start 106: testcorenrn_vecevent::coreneuron_cpu_online
153/162 Test #104: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 6.95 sec
Start 107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
154/162 Test #106: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 7.40 sec
Start 108: testcorenrn_vecevent::coreneuron_cpu_offline
155/162 Test #108: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 7.53 sec
Start 156: olfactory-bulb-3d::neuron
156/162 Test #107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 9.31 sec
Start 158: olfactory-bulb-3d::coreneuron_gpu_online
157/162 Test #158: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 90.15 sec
Start 160: olfactory-bulb-3d::coreneuron_cpu_online
158/162 Test #156: olfactory-bulb-3d::neuron .......................................... Passed 94.68 sec
Start 54: external_ringtest::compare_results
Start 110: testcorenrn_vecevent::compare_results
159/162 Test #110: testcorenrn_vecevent::compare_results .............................. Passed 0.09 sec
160/162 Test #54: external_ringtest::compare_results ................................. Passed 0.10 sec
161/162 Test #160: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 40.08 sec
Start 162: olfactory-bulb-3d::compare_results
162/162 Test #162: olfactory-bulb-3d::compare_results ................................. Passed 0.24 sec
100% tests passed, 0 tests failed out of 162
Total Test time (real) = 677.32 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640092825:step_script section_start:1640092825:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=52680 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=112534 responseStatus=201 Created token=6aJNzfy4
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=52710 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=112534 responseStatus=201 Created token=6aJNzfy4
section_end:1640092826:upload_artifacts_on_success section_start:1640092826:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640092827:cleanup_file_variables Job succeeded
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment