Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created November 29, 2021 15:46
Show Gist options
  • Save bbpbuildbot/4ca75d573c01aece64423a8f2343a0c5 to your computer and use it in GitHub Desktop.
Save bbpbuildbot/4ca75d573c01aece64423a8f2343a0c5 to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/27109 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#699.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197472:resolve_secrets Resolving secrets
section_end:1638197472:resolve_secrets section_start:1638197472:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor547083115, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99606
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99606
A slurm job will be created with name GL_J99606_PROD_P112_CP4_C5
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94188
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638197485:prepare_executor section_start:1638197485:prepare_script Preparing environment
Running on r1i5n19 via bbpv1.epfl.ch...
section_end:1638197487:prepare_script section_start:1638197487:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197487:get_sources section_start:1638197487:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=158498 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-5
Successfully extracted cache
section_end:1638197512:restore_cache section_start:1638197512:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (99600)...
Runtime platform  arch=amd64 os=linux pid=158731 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99600 responseStatus=200 OK token=3MyLTc3i
section_end:1638197513:download_artifacts section_start:1638197513:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="d86aefa82808e5df00dcbd3c88d9893994c7f531"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..dbfb69d 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="d86aefa82808e5df00dcbd3c88d9893994c7f531")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+gpu+tests~legacy-unit~report build_type=RelWithDebInfo
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be d5jp63omt63hmfz46ab5b5um2wtosys4
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99606/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99606/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:52:39 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (92.10 %)
Files: 18760
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'd5jp63omt63hmfz46ab5b5um2wtosys4'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit~report+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- d5jp63o coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
==> Installing coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4
==> No binary for coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4 found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-d5jp63
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99606/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99606/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:54:10 2021
Hits: 114 / 117 (97.44 %)
Direct: 98 / 117 (83.76 %)
Preprocessed: 16 / 19 (84.21 %)
Misses: 3
Direct: 19
Preprocessed: 3
Uncacheable: 18
Primary storage:
Hits: 227 / 234 (97.01 %)
Misses: 7
Cache size (GB): 0.47 / 0.51 (92.10 %)
Files: 18755
Cleanups: 4
Uncacheable:
Called for linking: 15
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638197651:step_script section_start:1638197651:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=163574 revision=58ba2b95 version=14.2.0
ccache/: found 19316 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-5
Created cache
section_end:1638197676:archive_cache section_start:1638197676:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=164528 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99606 responseStatus=201 Created token=yGMmnvvw
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=164553 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99606 responseStatus=201 Created token=yGMmnvvw
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=164576 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99606 responseStatus=201 Created token=yGMmnvvw
section_end:1638197677:upload_artifacts_on_success section_start:1638197677:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638197678:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197472:resolve_secrets Resolving secrets
section_end:1638197472:resolve_secrets section_start:1638197472:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor764248337, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99604
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99604
A slurm job will be created with name GL_J99604_PROD_P112_CP3_C4
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94187
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638197485:prepare_executor section_start:1638197485:prepare_script Preparing environment
Running on r1i5n20 via bbpv1.epfl.ch...
section_end:1638197487:prepare_script section_start:1638197487:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197487:get_sources section_start:1638197487:restore_cache Restoring cache
Checking cache for coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=109696 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Successfully extracted cache
section_end:1638197511:restore_cache section_start:1638197511:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (99600)...
Runtime platform  arch=amd64 os=linux pid=110260 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99600 responseStatus=200 OK token=3MyLTc3i
section_end:1638197512:download_artifacts section_start:1638197512:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99604/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99604/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99604/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99604/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99604/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="d86aefa82808e5df00dcbd3c88d9893994c7f531"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..dbfb69d 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="d86aefa82808e5df00dcbd3c88d9893994c7f531")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99604/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99604/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:52:39 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.42 / 0.51 (81.46 %)
Files: 13203
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'aevgkbdozl3htdtjhrd5w65n3c6mb2jh'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- aevgkbd coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
==> Installing coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh
==> No binary for coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99604/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99604/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:53:54 2021
Hits: 108 / 117 (92.31 %)
Direct: 92 / 118 (77.97 %)
Preprocessed: 16 / 26 (61.54 %)
Misses: 9
Direct: 26
Preprocessed: 10
Uncacheable: 20
Primary storage:
Hits: 215 / 236 (91.10 %)
Misses: 21
Cache size (GB): 0.42 / 0.51 (81.48 %)
Files: 13221
Uncacheable:
Called for linking: 16
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638197635:step_script section_start:1638197635:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=115635 revision=58ba2b95 version=14.2.0
ccache/: found 13782 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Created cache
section_end:1638197657:archive_cache section_start:1638197657:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=115904 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99604 responseStatus=201 Created token=ENV9BvMs
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=115926 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99604 responseStatus=201 Created token=ENV9BvMs
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=115950 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99604 responseStatus=201 Created token=ENV9BvMs
section_end:1638197658:upload_artifacts_on_success section_start:1638197658:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638197659:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198386:resolve_secrets Resolving secrets
section_end:1638198386:resolve_secrets section_start:1638198386:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor057960951, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99605
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99605
A slurm job will be created with name GL_J99605_PROD_P112_CP1_C3
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94300
job state: PD
job state: R
section_end:1638198389:prepare_executor section_start:1638198389:prepare_script Preparing environment
Running on r1i5n19 via bbpv1.epfl.ch...
section_end:1638198391:prepare_script section_start:1638198391:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198391:get_sources section_start:1638198391:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=202653 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-5
Successfully extracted cache
section_end:1638198415:restore_cache section_start:1638198415:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:gpu (99602)...
Runtime platform  arch=amd64 os=linux pid=203168 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99602 responseStatus=200 OK token=4jJhKejs
section_end:1638198416:download_artifacts section_start:1638198416:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="d86aefa82808e5df00dcbd3c88d9893994c7f531"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..dbfb69d 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="d86aefa82808e5df00dcbd3c88d9893994c7f531")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+nmodl+gpu+tests~legacy-unit~report build_type=RelWithDebInfo ^/nswa6573eazhleffns23ijmh436w7top
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be zlwgeoedcsxjuxmsxmqszgt6asxykrym
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99605/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99605/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:07:34 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (92.10 %)
Files: 18755
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'zlwgeoedcsxjuxmsxmqszgt6asxykrym'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+nmodl~report+tests build_type=RelWithDebInfo
[+] ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- zlwgeoe coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] nswa657 ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ccuqt3m ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hg7eomm ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 5ytmph6 ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] uu54yde ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] sujyde4 ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oekgd2o ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hsn2r4n ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-uu54yd
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-hsn2r4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-5ytmph
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-sujyde
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-oekgd2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-hg7eom
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-ccuqt3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/nmodl-develop-nswa65
==> Installing coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym
==> No binary for coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-zlwgeo
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99605/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99605/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:14:09 2021
Hits: 86 / 95 (90.53 %)
Direct: 1 / 95 (1.05 %)
Preprocessed: 85 / 94 (90.43 %)
Misses: 9
Direct: 94
Preprocessed: 9
Uncacheable: 15
Primary storage:
Hits: 87 / 190 (45.79 %)
Misses: 103
Cache size (GB): 0.47 / 0.51 (92.35 %)
Files: 18828
Cleanups: 6
Uncacheable:
Called for linking: 12
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638198850:step_script section_start:1638198850:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=223829 revision=58ba2b95 version=14.2.0
ccache/: found 19389 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-5
Created cache
section_end:1638198879:archive_cache section_start:1638198879:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=224708 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99605 responseStatus=201 Created token=MwkCnxEx
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=224737 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99605 responseStatus=201 Created token=MwkCnxEx
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=224770 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99605 responseStatus=201 Created token=MwkCnxEx
section_end:1638198880:upload_artifacts_on_success section_start:1638198880:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198881:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198404:resolve_secrets Resolving secrets
section_end:1638198404:resolve_secrets section_start:1638198404:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor162549767, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99603
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99603
A slurm job will be created with name GL_J99603_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94301
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638198409:prepare_executor section_start:1638198409:prepare_script Preparing environment
Running on r1i4n0 via bbpv1.epfl.ch...
section_end:1638198411:prepare_script section_start:1638198411:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198412:get_sources section_start:1638198412:restore_cache Restoring cache
Checking cache for coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=285847 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Successfully extracted cache
section_end:1638198428:restore_cache section_start:1638198428:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:intel (99601)...
Runtime platform  arch=amd64 os=linux pid=285992 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99601 responseStatus=200 OK token=MX5ySE1h
section_end:1638198429:download_artifacts section_start:1638198429:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99603/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99603/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99603/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99603/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99603/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="d86aefa82808e5df00dcbd3c88d9893994c7f531"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index a4e7814..dbfb69d 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="d86aefa82808e5df00dcbd3c88d9893994c7f531")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+nmodl+tests~legacy-unit build_type=Debug ^/lqyttqytclxdwwickak7uvjmb6a3au3g
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99603/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99603/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:07:41 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.42 / 0.51 (81.48 %)
Files: 13221
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'cwjs4t3f4wyl5jax3fb2obxbvjopwgn3'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+nmodl+tests build_type=Debug
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- cwjs4t3 coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
==> Installing coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
==> No binary for coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99603/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99603/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:10:01 2021
Hits: 81 / 95 (85.26 %)
Direct: 0 / 96 (0.00 %)
Preprocessed: 81 / 96 (84.38 %)
Misses: 14
Direct: 96
Preprocessed: 15
Uncacheable: 17
Primary storage:
Hits: 81 / 192 (42.19 %)
Misses: 111
Cache size (GB): 0.42 / 0.51 (81.86 %)
Files: 13330
Uncacheable:
Called for linking: 13
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638198602:step_script section_start:1638198602:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=288577 revision=58ba2b95 version=14.2.0
ccache/: found 13891 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-5
Created cache
section_end:1638198623:archive_cache section_start:1638198623:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=288678 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99603 responseStatus=201 Created token=USoRFWfN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=288700 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99603 responseStatus=201 Created token=USoRFWfN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=288723 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99603 responseStatus=201 Created token=USoRFWfN
section_end:1638198625:upload_artifacts_on_success section_start:1638198625:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198626:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197685:resolve_secrets Resolving secrets
section_end:1638197685:resolve_secrets section_start:1638197685:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor556975565, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99614
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99614
A slurm job will be created with name GL_J99614_PROD_P112_CP6_C8
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94198
job state: R
section_end:1638197686:prepare_executor section_start:1638197686:prepare_script Preparing environment
Running on r1i5n19 via bbpv1.epfl.ch...
section_end:1638197688:prepare_script section_start:1638197688:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197688:get_sources section_start:1638197688:restore_cache Restoring cache
Checking cache for neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=165507 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1638197721:restore_cache section_start:1638197721:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (99606)...
Runtime platform  arch=amd64 os=linux pid=168176 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99606 responseStatus=200 OK token=yGMmnvvw
section_end:1638197722:download_artifacts section_start:1638197722:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99614/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99614/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99614/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99614/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99614/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/d5jp63omt63hmfz46ab5b5um2wtosys4^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be vkogqddlipn6wfzq2o4mkbt36t7uknzy
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99614/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99614/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:56:01 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.50 / 0.51 (97.03 %)
Files: 34673
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'vkogqddlipn6wfzq2o4mkbt36t7uknzy'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- vkogqdd neuron@develop%nvhpc@21.9+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] d5jp63o ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nrapte7 ^gettext@0.21%nvhpc@21.9+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] 2ysh2tt ^bzip2@1.0.8%nvhpc@21.9+shared arch=linux-rhel7-x86_64
[^] ibezovc ^libiconv@1.16%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] tnqe7c4 ^libxml2@2.9.10%nvhpc@21.9~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] zxjo677 ^pkgconf@1.7.3%nvhpc@21.9 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l66doh5 ^xz@5.2.5%nvhpc@21.9~pic arch=linux-rhel7-x86_64
[^] elbqaor ^zlib@1.2.11%nvhpc@21.9+optimize+pic+shared arch=linux-rhel7-x86_64
[^] bgo3uwo ^ncurses@6.2%nvhpc@21.9~symlinks+termlib arch=linux-rhel7-x86_64
[^] 3rfyifb ^tar@1.28%nvhpc@21.9 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] o4qjffl ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] oq5gdcc ^py-mpi4py@3.0.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] 4krfyfj ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] yuqhyr2 ^py-setuptools-scm@4.1.2%nvhpc@21.9+toml arch=linux-rhel7-x86_64
[^] bk3d6wo ^py-toml@0.10.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] gzeyuxm ^py-pytest-cov@2.8.1%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] mplwm3p ^py-coverage@5.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfcagzk ^readline@8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-2ysh2tt3lnl2uvfsnbg7krzev3ysdear)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libiconv-1.16-ibezov
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/pkgconf-1.7.3-zxjo67
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/xz-5.2.5-l66doh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-elbqaor47ega2nun5e64w3s4tllg35cq)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-bgo3uwovij7lsxpbsk2cgyoghc3okxkl)
[+] /usr (external tar-1.28-3rfyifbrzrnqstk63f6zfnxe4vf7herg)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kfcagzks7msvsixt2q7vdt2t33xo5rih)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-d5jp63
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libxml2-2.9.10-tnqe7c
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/gettext-0.21-nrapte
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-mpi4py-3.0.3-oq5gdc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-o4qjff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-coverage-5.3-mplwm3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-toml-0.10.0-bk3d6w
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-4krfyf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-scm-4.1.2-yuqhyr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-cov-2.8.1-gzeyux
==> Installing neuron-develop-vkogqddlipn6wfzq2o4mkbt36t7uknzy
==> No binary for neuron-develop-vkogqddlipn6wfzq2o4mkbt36t7uknzy found: installing from source
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/neuron-develop-vkogqd
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99614/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99614/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:06:56 2021
Hits: 526 / 901 (58.38 %)
Direct: 12 / 910 (1.32 %)
Preprocessed: 514 / 892 (57.62 %)
Misses: 375
Direct: 898
Preprocessed: 378
Uncacheable: 134
Primary storage:
Hits: 572 / 1814 (31.53 %)
Misses: 1242
Cache size (GB): 0.50 / 0.51 (97.68 %)
Files: 34851
Cleanups: 13
Uncacheable:
Autoconf compile/link: 7
Called for linking: 111
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638198417:step_script section_start:1638198417:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=203552 revision=58ba2b95 version=14.2.0
ccache/: found 35412 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-5
Created cache
section_end:1638198454:archive_cache section_start:1638198454:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=205436 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99614 responseStatus=201 Created token=YXbDhcCk
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=205460 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99614 responseStatus=201 Created token=YXbDhcCk
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=205485 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99614 responseStatus=201 Created token=YXbDhcCk
section_end:1638198456:upload_artifacts_on_success section_start:1638198456:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198456:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197664:resolve_secrets Resolving secrets
section_end:1638197664:resolve_secrets section_start:1638197664:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor137070967, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99612
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99612
A slurm job will be created with name GL_J99612_PROD_P112_CP5_C7
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94195
job state: R
section_end:1638197665:prepare_executor section_start:1638197665:prepare_script Preparing environment
Running on r1i5n20 via bbpv1.epfl.ch...
section_end:1638197667:prepare_script section_start:1638197667:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197668:get_sources section_start:1638197668:restore_cache Restoring cache
Checking cache for neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=116577 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1638197694:restore_cache section_start:1638197694:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (99604)...
Runtime platform  arch=amd64 os=linux pid=117168 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99604 responseStatus=200 OK token=ENV9BvMs
section_end:1638197695:download_artifacts section_start:1638197695:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99612/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99612/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99612/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99612/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99612/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be mvn7s3za436y6xrhbspwpy7pbewubnvm
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99612/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99612/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:55:34 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.48 / 0.51 (93.84 %)
Files: 26421
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'mvn7s3za436y6xrhbspwpy7pbewubnvm'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- mvn7s3z neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] aevgkbd ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
- zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
==> Installing py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk
==> No binary for py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk found: installing from source
==> Warning: Missing a source id for neuron@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/28/280baa8ec489c4f542f8940f9c4c2181f0306a8ee1a54eceba071a449fb870a0.tar.gz
==> py-coverage: Executing phase: 'build'
==> py-coverage: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe
==> No binary for py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/cc/cc6742d8bac45070217169f5f72ceee1e0e55b0221f54bcf24845972d3a47f2b.tar.gz
==> py-pytest-cov: Executing phase: 'build'
==> py-pytest-cov: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
==> Installing neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm
==> No binary for neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm found: installing from source
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-mvn7s3
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99612/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99612/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:07:37 2021
Hits: 452 / 903 (50.06 %)
Direct: 14 / 912 (1.54 %)
Preprocessed: 438 / 892 (49.10 %)
Misses: 451
Direct: 898
Preprocessed: 454
Uncacheable: 144
Primary storage:
Hits: 503 / 1818 (27.67 %)
Misses: 1315
Cache size (GB): 0.47 / 0.51 (90.94 %)
Files: 25541
Cleanups: 12
Uncacheable:
Autoconf compile/link: 7
Called for linking: 121
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638198458:step_script section_start:1638198458:archive_cache Saving cache for successful job
Creating cache neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=149102 revision=58ba2b95 version=14.2.0
ccache/: found 26102 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-5
Created cache
section_end:1638198488:archive_cache section_start:1638198488:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=149210 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99612 responseStatus=201 Created token=4HmtcF3z
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=149235 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99612 responseStatus=201 Created token=4HmtcF3z
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=149258 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99612 responseStatus=201 Created token=4HmtcF3z
section_end:1638198489:upload_artifacts_on_success section_start:1638198489:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198490:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198885:resolve_secrets Resolving secrets
section_end:1638198885:resolve_secrets section_start:1638198885:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor116781813, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99613
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99613
A slurm job will be created with name GL_J99613_PROD_P112_CP7_C14
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94326
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638198899:prepare_executor section_start:1638198899:prepare_script Preparing environment
Running on r1i5n19 via bbpv1.epfl.ch...
section_end:1638198901:prepare_script section_start:1638198901:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198902:get_sources section_start:1638198902:restore_cache Restoring cache
Checking cache for neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=225924 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-5
Successfully extracted cache
section_end:1638198937:restore_cache section_start:1638198937:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (99605)...
Runtime platform  arch=amd64 os=linux pid=226470 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99605 responseStatus=200 OK token=MwkCnxEx
section_end:1638198938:download_artifacts section_start:1638198938:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99613/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99613/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99613/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99613/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99613/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/zlwgeoedcsxjuxmsxmqszgt6asxykrym^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be kxhxq4seozqasdxdnbgni3g566ai7oyd
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99613/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99613/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:16:15 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.50 / 0.51 (97.68 %)
Files: 34851
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'kxhxq4seozqasdxdnbgni3g566ai7oyd'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- kxhxq4s neuron@develop%nvhpc@21.9+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] zlwgeoe ^coreneuron@develop%nvhpc@21.9~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] jjxvkgg ^boost@1.73.0%nvhpc@21.9+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] nbtppas ^cuda@11.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] x64zuwg ^hpe-mpi@2.25.hmpt%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] nswa657 ^nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ccuqt3m ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hg7eomm ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 5ytmph6 ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] uu54yde ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] sujyde4 ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oekgd2o ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] hsn2r4n ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nrapte7 ^gettext@0.21%nvhpc@21.9+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] 2ysh2tt ^bzip2@1.0.8%nvhpc@21.9+shared arch=linux-rhel7-x86_64
[^] ibezovc ^libiconv@1.16%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] tnqe7c4 ^libxml2@2.9.10%nvhpc@21.9~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] zxjo677 ^pkgconf@1.7.3%nvhpc@21.9 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l66doh5 ^xz@5.2.5%nvhpc@21.9~pic arch=linux-rhel7-x86_64
[^] elbqaor ^zlib@1.2.11%nvhpc@21.9+optimize+pic+shared arch=linux-rhel7-x86_64
[^] bgo3uwo ^ncurses@6.2%nvhpc@21.9~symlinks+termlib arch=linux-rhel7-x86_64
[^] 3rfyifb ^tar@1.28%nvhpc@21.9 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] o4qjffl ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] oq5gdcc ^py-mpi4py@3.0.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[+] 4krfyfj ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] gzeyuxm ^py-pytest-cov@2.8.1%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] mplwm3p ^py-coverage@5.3%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfcagzk ^readline@8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-jjxvkgghuqodteqzd72lafa2xfxz24dh)
==> cuda@11.4.2 : has external module in ['cuda/11.4.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.4.2-amtb6x (external cuda-11.4.2-nbtppaslouhuyhs6zerdalvlcfjchwrp)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-x64zuwghhre5idfwdiqzak5ynxfem2aj)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-2ysh2tt3lnl2uvfsnbg7krzev3ysdear)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libiconv-1.16-ibezov
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/pkgconf-1.7.3-zxjo67
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/xz-5.2.5-l66doh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-elbqaor47ega2nun5e64w3s4tllg35cq)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-bgo3uwovij7lsxpbsk2cgyoghc3okxkl)
[+] /usr (external tar-1.28-3rfyifbrzrnqstk63f6zfnxe4vf7herg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kfcagzks7msvsixt2q7vdt2t33xo5rih)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-hsn2r4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-5ytmph
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-uu54yd
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-sujyde
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/libxml2-2.9.10-tnqe7c
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-coverage-5.3-mplwm3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-o4qjff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-mpi4py-3.0.3-oq5gdc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-oekgd2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-hg7eom
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/gettext-0.21-nrapte
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-4krfyf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-ccuqt3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-cov-2.8.1-gzeyux
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/nmodl-develop-nswa65
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/coreneuron-develop-zlwgeo
==> Installing neuron-develop-kxhxq4seozqasdxdnbgni3g566ai7oyd
==> No binary for neuron-develop-kxhxq4seozqasdxdnbgni3g566ai7oyd found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/neuron-develop-kxhxq4
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99613/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99613/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:27:30 2021
Hits: 527 / 899 (58.62 %)
Direct: 11 / 908 (1.21 %)
Preprocessed: 516 / 891 (57.91 %)
Misses: 372
Direct: 897
Preprocessed: 375
Uncacheable: 135
Primary storage:
Hits: 540 / 1810 (29.83 %)
Misses: 1270
Cache size (GB): 0.50 / 0.51 (98.29 %)
Files: 35052
Cleanups: 14
Uncacheable:
Autoconf compile/link: 7
Called for linking: 112
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638199651:step_script section_start:1638199651:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=263113 revision=58ba2b95 version=14.2.0
ccache/: found 35613 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-5
Created cache
section_end:1638199686:archive_cache section_start:1638199686:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=263263 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99613 responseStatus=201 Created token=-dKbWSDM
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=263291 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99613 responseStatus=201 Created token=-dKbWSDM
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=263321 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99613 responseStatus=201 Created token=-dKbWSDM
section_end:1638199688:upload_artifacts_on_success section_start:1638199688:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638199689:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198636:resolve_secrets Resolving secrets
section_end:1638198636:resolve_secrets section_start:1638198636:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor633710135, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99611
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99611
A slurm job will be created with name GL_J99611_PROD_P112_CP6_C7
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94310
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638198655:prepare_executor section_start:1638198655:prepare_script Preparing environment
Running on r1i5n20 via bbpv1.epfl.ch...
section_end:1638198659:prepare_script section_start:1638198659:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198660:get_sources section_start:1638198660:restore_cache Restoring cache
Checking cache for neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=150070 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-5
Successfully extracted cache
section_end:1638198687:restore_cache section_start:1638198687:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (99603)...
Runtime platform  arch=amd64 os=linux pid=150609 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99603 responseStatus=200 OK token=USoRFWfN
section_end:1638198687:download_artifacts section_start:1638198687:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99611/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99611/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99611/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99611/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99611/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be jhigcl7ephcbe47kbyz2znl76v2kaeev
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99611/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99611/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:12:02 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (90.94 %)
Files: 25541
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'jhigcl7ephcbe47kbyz2znl76v2kaeev'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- jhigcl7 neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] cwjs4t3 ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
==> Installing neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev
==> No binary for neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-jhigcl
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99611/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99611/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:20:39 2021
Hits: 454 / 902 (50.33 %)
Direct: 10 / 911 (1.10 %)
Preprocessed: 444 / 895 (49.61 %)
Misses: 448
Direct: 901
Preprocessed: 451
Uncacheable: 144
Primary storage:
Hits: 466 / 1816 (25.66 %)
Misses: 1350
Cache size (GB): 0.44 / 0.51 (85.64 %)
Files: 23673
Cleanups: 11
Uncacheable:
Autoconf compile/link: 7
Called for linking: 121
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638199240:step_script section_start:1638199240:archive_cache Saving cache for successful job
Creating cache neuron-intel-5...
Runtime platform  arch=amd64 os=linux pid=177126 revision=58ba2b95 version=14.2.0
ccache/: found 24234 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-5
Created cache
section_end:1638199268:archive_cache section_start:1638199268:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=177206 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99611 responseStatus=201 Created token=_qejfGV2
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=177227 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99611 responseStatus=201 Created token=_qejfGV2
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=177251 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99611 responseStatus=201 Created token=_qejfGV2
section_end:1638199270:upload_artifacts_on_success section_start:1638199270:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638199270:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197472:resolve_secrets Resolving secrets
section_end:1638197472:resolve_secrets section_start:1638197472:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor586583367, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99602
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99602
A slurm job will be created with name GL_J99602_PROD_P112_CP2_C3
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94186
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638197484:prepare_executor section_start:1638197484:prepare_script Preparing environment
Running on r1i5n20 via bbpv1.epfl.ch...
section_end:1638197487:prepare_script section_start:1638197487:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197487:get_sources section_start:1638197487:restore_cache Restoring cache
Checking cache for nmodl-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=109675 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-nvhpc-5
Successfully extracted cache
section_end:1638197506:restore_cache section_start:1638197506:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (99600)...
Runtime platform  arch=amd64 os=linux pid=109770 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99600 responseStatus=200 OK token=3MyLTc3i
section_end:1638197507:download_artifacts section_start:1638197507:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99602/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99602/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99602/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99602/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99602/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%nvhpc~legacy-unit ^bison%gcc^flex%gcc^py-jinja2%gcc^py-sympy%gcc^py-pyyaml%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be nswa6573eazhleffns23ijmh436w7top
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99602/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99602/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:52:32 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (92.24 %)
Files: 1747
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'nswa6573eazhleffns23ijmh436w7top'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%nvhpc~legacy-unit
- ^bison%gcc
- ^flex%gcc
- ^py-jinja2%gcc
- ^py-pyyaml%gcc
- ^py-sympy%gcc
Concretized
--------------------------------
- nswa657 nmodl@develop%nvhpc@21.9~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- mz42odj ^bison@3.6.4%nvhpc@21.9 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- lpu6i7p ^cmake@3.15.7%nvhpc@21.9~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- nlmxfru ^flex@2.6.4%nvhpc@21.9+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- avc6rx5 ^ninja@1.10.2%nvhpc@21.9 arch=linux-rhel7-x86_64
- ccuqt3m ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
- hg7eomm ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- 5ytmph6 ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 7bw7pw5 ^py-setuptools@50.3.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ni2y6im ^python@3.8.3%nvhpc@21.9+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- uu54yde ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] rndnnfg ^py-pytest@5.3.4%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] iugmk34 ^py-attrs@20.3.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kfhiued ^py-more-itertools@8.7.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] 43elgth ^py-packaging@19.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] kcc57g2 ^py-pyparsing@2.4.2%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] qctdzu4 ^py-six@1.16.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] npfkk2d ^py-pluggy@0.13.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] yuqhyr2 ^py-setuptools-scm@4.1.2%nvhpc@21.9+toml arch=linux-rhel7-x86_64
[^] bk3d6wo ^py-toml@0.10.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] ybqmc22 ^py-py@1.8.0%nvhpc@21.9 arch=linux-rhel7-x86_64
[^] afmj4ex ^py-wcwidth@0.1.7%nvhpc@21.9 arch=linux-rhel7-x86_64
- sujyde4 ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
- oekgd2o ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
- hsn2r4n ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-mz42odjxwfev23mgclgpgkustsebup72)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-lpu6i7pkviopkugggid2tave7uyd6y2j)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-nlmxfrujm6vsjou3blvzzwtcyjkloybu)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-avc6rx55mmu6uajw24ije7oqw7ge6r3w)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-ni2y6imbyi6y34r36orewroy7viqedhy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-50.3.2-7bw7pw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-six-1.16.0-qctdzu
==> Installing py-mpmath-1.1.0-hsn2r4nbqjhzewaw5soovd2t5ud7cpxi
==> No binary for py-mpmath-1.1.0-hsn2r4nbqjhzewaw5soovd2t5ud7cpxi found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-hsn2r4
==> Installing py-pyyaml-5.3.1-sujyde4lpezqcdg4rwhbpoaratxzarxk
==> No binary for py-pyyaml-5.3.1-sujyde4lpezqcdg4rwhbpoaratxzarxk found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/b8/b8eac752c5e14d3eca0e6dd9199cd627518cb5ec06add0de9d32baeee6fe645d.tar.gz
==> py-pyyaml: Executing phase: 'build_ext'
==> py-pyyaml: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-sujyde
==> Installing py-pytz-2020.1-5ytmph6jauaabucz5ftlb3luonjitpyh
==> No binary for py-pytz-2020.1-5ytmph6jauaabucz5ftlb3luonjitpyh found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/c3/c35965d010ce31b23eeb663ed3cc8c906275d6be1a34393a1d73a41febf4a048.tar.gz
==> py-pytz: Executing phase: 'build'
==> py-pytz: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-5ytmph
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-toml-0.10.0-bk3d6w
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-wcwidth-0.1.7-afmj4e
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pyparsing-2.4.2-kcc57g
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-more-itertools-8.7.0-kfhiue
==> Installing py-markupsafe-1.1.1-uu54yden3pmltnbphrqkavx46jvq7xnu
==> No binary for py-markupsafe-1.1.1-uu54yden3pmltnbphrqkavx46jvq7xnu found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-uu54yd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-attrs-20.3.0-iugmk3
==> Installing py-sympy-1.4-oekgd2ou3e7lvizgzw7ztjyx5npcnhjc
==> No binary for py-sympy-1.4-oekgd2ou3e7lvizgzw7ztjyx5npcnhjc found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-oekgd2
==> Installing py-babel-2.7.0-hg7eommvskkocenyvv7wvashro4vnb2o
==> No binary for py-babel-2.7.0-hg7eommvskkocenyvv7wvashro4vnb2o found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-hg7eom
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-setuptools-scm-4.1.2-yuqhyr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-packaging-19.2-43elgt
==> Installing py-jinja2-2.10.3-ccuqt3mppqfwu2gdnafhdw6kj77bmc2e
==> No binary for py-jinja2-2.10.3-ccuqt3mppqfwu2gdnafhdw6kj77bmc2e found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-ccuqt3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pluggy-0.13.0-npfkk2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-py-1.8.0-ybqmc2
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.9/py-pytest-5.3.4-rndnnf
==> Installing nmodl-develop-nswa6573eazhleffns23ijmh436w7top
==> No binary for nmodl-develop-nswa6573eazhleffns23ijmh436w7top found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.9/nmodl-develop-nswa65
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99602/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99602/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:05:45 2021
Hits: 64 / 135 (47.41 %)
Direct: 33 / 135 (24.44 %)
Preprocessed: 31 / 102 (30.39 %)
Misses: 71
Direct: 102
Preprocessed: 71
Uncacheable: 26
Primary storage:
Hits: 97 / 270 (35.93 %)
Misses: 173
Cache size (GB): 0.48 / 0.51 (92.96 %)
Files: 1764
Cleanups: 9
Uncacheable:
Called for linking: 26
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638198354:step_script section_start:1638198354:archive_cache Saving cache for successful job
Creating cache nmodl-nvhpc-5...
Runtime platform  arch=amd64 os=linux pid=145131 revision=58ba2b95 version=14.2.0
ccache/: found 2325 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-nvhpc-5
Created cache
section_end:1638198377:archive_cache section_start:1638198377:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=145724 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99602 responseStatus=201 Created token=4jJhKejs
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=145765 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99602 responseStatus=201 Created token=4jJhKejs
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=145790 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99602 responseStatus=201 Created token=4jJhKejs
section_end:1638198379:upload_artifacts_on_success section_start:1638198379:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198379:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197471:resolve_secrets Resolving secrets
section_end:1638197471:resolve_secrets section_start:1638197471:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor214193037, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99601
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99601
A slurm job will be created with name GL_J99601_PROD_P112_CP0_C1
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94185
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638197485:prepare_executor section_start:1638197485:prepare_script Preparing environment
Running on r1i4n0 via bbpv1.epfl.ch...
section_end:1638197487:prepare_script section_start:1638197487:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197487:get_sources section_start:1638197487:restore_cache Restoring cache
Checking cache for nmodl-intel-5...
Runtime platform  arch=amd64 os=linux pid=279111 revision=58ba2b95 version=14.2.0
Downloading cache.zip from https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-intel-5
Successfully extracted cache
section_end:1638197503:restore_cache section_start:1638197503:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (99600)...
Runtime platform  arch=amd64 os=linux pid=279181 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99600 responseStatus=200 OK token=3MyLTc3i
section_end:1638197504:download_artifacts section_start:1638197504:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99601/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99601/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99601/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99601/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99601/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%intel~legacy-unit
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be lqyttqytclxdwwickak7uvjmb6a3au3g
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99601/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99601/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 15:52:28 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.48 / 0.51 (94.57 %)
Files: 658
$ fi
$ module load unstable git gcc
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'lqyttqytclxdwwickak7uvjmb6a3au3g'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%intel~legacy-unit
Concretized
--------------------------------
- lqyttqy nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
- ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
- yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
==> Installing py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2
==> No binary for py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
==> Installing py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724
==> No binary for py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
==> Installing py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k
==> No binary for py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/3d/3df37372226d6e63e1b1e1eda15c594bca98a22d33a23832a90998faa96bc65e.tar.gz
==> py-wcwidth: Executing phase: 'build'
==> py-wcwidth: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
==> Installing py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw
==> No binary for py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw found: installing from source
==> Fetching https://pypi.io/packages/source/m/more-itertools/more-itertools-8.7.0.tar.gz
==> py-more-itertools: Executing phase: 'build'
==> py-more-itertools: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
==> Installing py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw
==> No binary for py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
==> Installing py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt
==> No binary for py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/28/28b924174df7a2fa32c1953825ff29c61e2f5e082343165438812f00d3a7fc47.tar.gz
==> py-packaging: Executing phase: 'build'
==> py-packaging: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
==> Installing py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7
==> No binary for py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
==> Installing py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4
==> No binary for py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/fa/fa5fa1622fa6dd5c030e9cad086fa19ef6a0cf6d7a2d12318e10cb49d6d68f34.tar.gz
==> py-pluggy: Executing phase: 'build'
==> py-pluggy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
==> Installing py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq
==> No binary for py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/dc/dc639b046a6e2cff5bbe40194ad65936d6ba360b52b3c3fe1d08a82dd50b5e53.tar.gz
==> py-py: Executing phase: 'build'
==> py-py: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
==> Installing py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab
==> No binary for py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
==> Installing py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557
==> No binary for py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/1d/1d122e8be54d1a709e56f82e2d85dcba3018313d64647f38a91aec88c239b600.tar.gz
==> py-pytest: Executing phase: 'build'
==> py-pytest: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g
==> No binary for nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99601/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99601/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Mon Nov 29 16:06:11 2021
Hits: 70 / 144 (48.61 %)
Direct: 52 / 144 (36.11 %)
Preprocessed: 18 / 92 (19.57 %)
Misses: 74
Direct: 92
Preprocessed: 74
Uncacheable: 44
Primary storage:
Hits: 188 / 288 (65.28 %)
Misses: 100
Cache size (GB): 0.47 / 0.51 (91.54 %)
Files: 639
Cleanups: 14
Uncacheable:
Called for linking: 44
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1638198372:step_script section_start:1638198372:archive_cache Saving cache for successful job
Creating cache nmodl-intel-5...
Runtime platform  arch=amd64 os=linux pid=285294 revision=58ba2b95 version=14.2.0
ccache/: found 1200 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-intel-5
Created cache
section_end:1638198393:archive_cache section_start:1638198393:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=285447 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99601 responseStatus=201 Created token=MX5ySE1h
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=285469 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=99601 responseStatus=201 Created token=MX5ySE1h
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=285491 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99601 responseStatus=201 Created token=MX5ySE1h
section_end:1638198395:upload_artifacts_on_success section_start:1638198395:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198395:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197429:resolve_secrets Resolving secrets
section_end:1638197429:resolve_secrets section_start:1638197429:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor551431165, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99600
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99600
A slurm job will be created with name GL_J99600_PROD_P112_CP0_C1
Job parameters: memory=512M, cpus_per_task=1, duration=10:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94183
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638197443:prepare_executor section_start:1638197443:prepare_script Preparing environment
Running on r1i4n0 via bbpv1.epfl.ch...
section_end:1638197445:prepare_script section_start:1638197445:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197446:get_sources section_start:1638197446:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ touch spack_clone_variables.env
$ if [[ "${PARSE_GITHUB_PR_DESCRIPTIONS}" == "true" && "${CI_PIPELINE_SOURCE}" == "external_pull_request_event" ]]; then
$ cat > parse_description.py << END_SCRIPT # collapsed multi-line command
$ cat parse_description.py
from __future__ import print_function
import os
import re
import requests
pr_info = requests.get("https://api.github.com/repos/{}/pulls/{}".format(
os.environ['CI_EXTERNAL_PULL_REQUEST_TARGET_REPOSITORY'],
os.environ['CI_EXTERNAL_PULL_REQUEST_IID']),
headers={'Accept': 'application/vnd.github.v3+json'})
pr_body = pr_info.json()["body"]
# match something like NEURON_BRANCH=foo/bar
pat = re.compile('^([A-Z0-9_]+)_([A-Z]+)=([A-Z0-9\-\_\/]+)$', re.IGNORECASE)
def parse_term(m):
ref_type = m.group(2).lower()
if ref_type not in {'branch', 'tag', 'ref'}: return
print('SPACK_PACKAGE_REF_' + m.group(1).lower() + '=' + ref_type + '="' + m.group(3) + '"')
if pr_body is not None:
for pr_body_line in pr_body.splitlines():
if not pr_body_line.startswith('CI_BRANCHES:'): continue
for config_term in pr_body_line[12:].split(','):
pat.sub(parse_term, config_term)
$ python parse_description.py > spack_clone_variables.env
$ cat spack_clone_variables.env
$ fi
$ echo Using ${PWD} as a working directory common to the whole pipeline...
Using /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99600/_ as a working directory common to the whole pipeline...
$ SPACK_BRANCH_PARSED=$(sed -n -e "s/^SPACK_PACKAGE_REF_spack=branch=\(['\"]\)\([^\1]\+\)\1/\2/p" spack_clone_variables.env)
$ SPACK_BRANCH=${SPACK_BRANCH_PARSED:-$SPACK_BRANCH}
$ echo Checking out the ${SPACK_BRANCH} of Spack...
Checking out the develop of Spack...
$ git clone --depth 1 --single-branch --branch ${SPACK_BRANCH} ${SPACK_URL} spack
Cloning into 'spack'...
Checking out files: 24% (1901/7697) Checking out files: 25% (1925/7697) Checking out files: 26% (2002/7697) Checking out files: 27% (2079/7697) Checking out files: 28% (2156/7697) Checking out files: 29% (2233/7697) Checking out files: 30% (2310/7697) Checking out files: 31% (2387/7697) Checking out files: 32% (2464/7697) Checking out files: 33% (2541/7697) Checking out files: 34% (2617/7697) Checking out files: 35% (2694/7697) Checking out files: 36% (2771/7697) Checking out files: 37% (2848/7697) Checking out files: 38% (2925/7697) Checking out files: 39% (3002/7697) Checking out files: 40% (3079/7697) Checking out files: 41% (3156/7697) Checking out files: 42% (3233/7697) Checking out files: 43% (3310/7697) Checking out files: 44% (3387/7697) Checking out files: 44% (3455/7697) Checking out files: 45% (3464/7697) Checking out files: 46% (3541/7697) Checking out files: 47% (3618/7697) Checking out files: 48% (3695/7697) Checking out files: 49% (3772/7697) Checking out files: 50% (3849/7697) Checking out files: 51% (3926/7697) Checking out files: 52% (4003/7697) Checking out files: 53% (4080/7697) Checking out files: 54% (4157/7697) Checking out files: 55% (4234/7697) Checking out files: 56% (4311/7697) Checking out files: 57% (4388/7697) Checking out files: 58% (4465/7697) Checking out files: 59% (4542/7697) Checking out files: 60% (4619/7697) Checking out files: 61% (4696/7697) Checking out files: 62% (4773/7697) Checking out files: 62% (4793/7697) Checking out files: 63% (4850/7697) Checking out files: 64% (4927/7697) Checking out files: 65% (5004/7697) Checking out files: 66% (5081/7697) Checking out files: 67% (5157/7697) Checking out files: 68% (5234/7697) Checking out files: 69% (5311/7697) Checking out files: 70% (5388/7697) Checking out files: 71% (5465/7697) Checking out files: 72% (5542/7697) Checking out files: 73% (5619/7697) Checking out files: 73% (5647/7697) Checking out files: 74% (5696/7697) Checking out files: 75% (5773/7697) Checking out files: 76% (5850/7697) Checking out files: 77% (5927/7697) Checking out files: 78% (6004/7697) Checking out files: 79% (6081/7697) Checking out files: 80% (6158/7697) Checking out files: 81% (6235/7697) Checking out files: 82% (6312/7697) Checking out files: 83% (6389/7697) Checking out files: 84% (6466/7697) Checking out files: 85% (6543/7697) Checking out files: 86% (6620/7697) Checking out files: 87% (6697/7697) Checking out files: 87% (6714/7697) Checking out files: 88% (6774/7697) Checking out files: 89% (6851/7697) Checking out files: 90% (6928/7697) Checking out files: 91% (7005/7697) Checking out files: 92% (7082/7697) Checking out files: 93% (7159/7697) Checking out files: 94% (7236/7697) Checking out files: 95% (7313/7697) Checking out files: 96% (7390/7697) Checking out files: 97% (7467/7697) Checking out files: 98% (7544/7697) Checking out files: 99% (7621/7697) Checking out files: 99% (7631/7697) Checking out files: 100% (7697/7697) Checking out files: 100% (7697/7697), done.
$ cp /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/config/*.yaml spack/etc/spack
$ SPACK_ROOT=${PWD}/spack
$ echo "SPACK_ROOT=${SPACK_ROOT}" >> spack_clone_variables.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ spack config --scope site add "config:ccache:true"
$ spack config get config
config:
install_tree:
projections:
all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
root: $spack/opt/spack
build_jobs: 36
ccache: true
template_dirs:
- $spack/share/spack/templates
# Locations where different types of modules should be installed.
module_roots:
tcl: $spack/share/spack/modules
lmod: $spack/share/spack/lmod
build_stage:
- $tempdir/$user/spack-stage
- ~/.spack/stage
# - $spack/var/spack/stage
# Directory in which to run tests and store test results.
# Tests will be stored in directories named by date/time and package
# name/hash.
test_stage: ~/.spack/test
source_cache: $spack/var/spack/cache
misc_cache: ~/.spack/cache
connect_timeout: 10
verify_ssl: true
suppress_gpg_warnings: false
install_missing_compilers: false
checksum: true
dirty: false
build_language: C
locks: true
concretizer: original
db_lock_timeout: 300
package_lock_timeout:
shared_linking: rpath
allow_sgid: true
debug: false
$ echo "SPACK_USE_CCACHE=true" >> spack_clone_variables.env
$ if [[ "${CI_PIPELINE_SOURCE}" == "pipeline" ]]; then
section_end:1638197460:step_script section_start:1638197460:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=278644 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=99600 responseStatus=201 Created token=3MyLTc3i
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=278658 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=99600 responseStatus=201 Created token=3MyLTc3i
section_end:1638197461:upload_artifacts_on_success section_start:1638197461:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638197462:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197684:resolve_secrets Resolving secrets
section_end:1638197684:resolve_secrets section_start:1638197684:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor254411683, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99610
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99610
A slurm job will be created with name GL_J99610_PROD_P112_CP4_C5
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 94197
job state: R
section_end:1638197686:prepare_executor section_start:1638197686:prepare_script Preparing environment
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1638197691:prepare_script section_start:1638197691:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197692:get_sources section_start:1638197692:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (99606)...
Runtime platform  arch=amd64 os=linux pid=23903 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99606 responseStatus=200 OK token=yGMmnvvw
section_end:1638197693:download_artifacts section_start:1638197693:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n19
Build name: Linux-nvc++
Create new tag: 20211129-1456 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #2: interleave_info_constructor_test ....... Passed 1.33 sec
Start 7: ring_binqueue_TEST
2/18 Test #1: cmd_interface_test ..................... Passed 1.51 sec
3/18 Test #3: alignment_test ......................... Passed 1.64 sec
Start 8: ring_multisend_TEST
4/18 Test #4: queuing_test ........................... Passed 1.78 sec
5/18 Test #5: lfp_test ............................... Passed 2.00 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 37.75 sec
Start 10: ring_permute1_TEST
7/18 Test #9: ring_spike_buffer_TEST ................. Passed 50.55 sec
Start 11: ring_permute2_TEST
8/18 Test #7: ring_binqueue_TEST ..................... Passed 51.45 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 51.37 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #10: ring_permute1_TEST ..................... Passed 20.23 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 69.43 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST ..........................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 d86aefa (2021-11-29 15:44:45 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 212.9805, Min 212.7891, Avg 212.8164
Memory (MBs) : After MPI_Init : Max 212.9805, Min 212.7891, Avg 212.8164
Memory (MBs) : Before nrn_setup : Max 213.1836, Min 213.0625, Avg 213.0776
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.73 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 213.3906, Min 213.0859, Avg 213.1465
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o/tests/integration/ring_gap
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 213.3906, Min 213.0859, Avg 213.1465
Memory (MBs) : After nrn_finitialize : Max 279.7188, Min 213.2500, Avg 229.8535
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST .................***Timeout 1500.14 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 d86aefa (2021-11-29 15:44:45 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 212.9805, Min 212.7891, Avg 212.8159
Memory (MBs) : After MPI_Init : Max 212.9805, Min 212.7891, Avg 212.8159
Memory (MBs) : Before nrn_setup : Max 213.1758, Min 213.0703, Avg 213.0835
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.23 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 213.3828, Min 213.0938, Avg 213.1528
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=true
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99606/_/spack-build/spack-stage-coreneuron-develop-d5jp63omt63hmfz46ab5b5um2wtosys4/spack-build-d5jp63o/tests/integration/ring_gap_binqueue
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 213.3828, Min 213.0938, Avg 213.1528
Memory (MBs) : After nrn_finitialize : Max 279.7031, Min 213.2617, Avg 229.8608
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................ Passed 1497.82 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST ................. Passed 1487.82 sec
16/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 72.93 sec
17/18 Test #16: ring_gap_permute2_TEST ................. Passed 195.62 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 192.76 sec
89% tests passed, 2 tests failed out of 18
Total Test time (real) = 1748.60 sec
The following tests FAILED:
12 - ring_gap_TEST (Timeout)
13 - ring_gap_binqueue_TEST (Timeout)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: ldir01u13: task 0: Exited with exit code 1
section_end:1638199519:step_script section_start:1638199519:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=48506 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99610 responseStatus=201 Created token=ErALjQ7g
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=48537 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99610 responseStatus=201 Created token=ErALjQ7g
section_end:1638199520:upload_artifacts_on_failure section_start:1638199520:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638199521:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638197663:resolve_secrets Resolving secrets
section_end:1638197663:resolve_secrets section_start:1638197663:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor375811133, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99608
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99608
A slurm job will be created with name GL_J99608_PROD_P112_CP3_C4
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94194
job state: R
section_end:1638197665:prepare_executor section_start:1638197665:prepare_script Preparing environment
Running on r1i5n19 via bbpv1.epfl.ch...
section_end:1638197668:prepare_script section_start:1638197668:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638197669:get_sources section_start:1638197669:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (99604)...
Runtime platform  arch=amd64 os=linux pid=164074 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99604 responseStatus=200 OK token=ENV9BvMs
section_end:1638197670:download_artifacts section_start:1638197670:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n20
Build name: Linux-icpc
Create new tag: 20211129-1455 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99604/_/spack-build/spack-stage-coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh/spack-build-aevgkbd
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #1: cmd_interface_test ................. Passed 2.03 sec
2/17 Test #3: alignment_test ..................... Passed 2.49 sec
Start 7: ring_binqueue_TEST
3/17 Test #4: queuing_test ....................... Passed 2.69 sec
4/17 Test #2: interleave_info_constructor_test ... Passed 2.90 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 3.08 sec
6/17 Test #17: reporting_1 ........................ Passed 6.82 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 7.61 sec
Start 10: ring_permute1_TEST
8/17 Test #8: ring_multisend_TEST ................ Passed 5.04 sec
Start 11: ring_permute2_TEST
9/17 Test #7: ring_binqueue_TEST ................. Passed 6.47 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 3.09 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 2.65 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 2.61 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #13: ring_gap_binqueue_TEST ............. Passed 6.07 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #14: ring_gap_multisend_TEST ............ Passed 1293.58 sec
15/17 Test #12: ring_gap_TEST ...................... Passed 1375.77 sec
16/17 Test #16: ring_gap_permute2_TEST ............. Passed 1404.38 sec
17/17 Test #15: ring_gap_permute1_TEST ............. Passed 1409.97 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 1420.57 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1638199128:step_script section_start:1638199128:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=235484 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99608 responseStatus=201 Created token=9yDXSE6a
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=235523 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99608 responseStatus=201 Created token=9yDXSE6a
section_end:1638199130:upload_artifacts_on_success section_start:1638199130:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638199131:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198884:resolve_secrets Resolving secrets
section_end:1638198884:resolve_secrets section_start:1638198884:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor021192331, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99609
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99609
A slurm job will be created with name GL_J99609_PROD_P112_CP1_C3
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 94325
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638198899:prepare_executor section_start:1638198899:prepare_script Preparing environment
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1638198908:prepare_script section_start:1638198908:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198909:get_sources section_start:1638198909:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (99605)...
Runtime platform  arch=amd64 os=linux pid=42837 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99605 responseStatus=200 OK token=MwkCnxEx
section_end:1638198910:download_artifacts section_start:1638198910:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n19
Build name: Linux-nvc++
Create new tag: 20211129-1515 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #1: cmd_interface_test ..................... Passed 1.54 sec
Start 7: ring_binqueue_TEST
2/18 Test #4: queuing_test ........................... Passed 1.68 sec
3/18 Test #2: interleave_info_constructor_test ....... Passed 1.84 sec
Start 8: ring_multisend_TEST
4/18 Test #3: alignment_test ......................... Passed 2.02 sec
5/18 Test #5: lfp_test ............................... Passed 2.30 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 16.25 sec
Start 10: ring_permute1_TEST
7/18 Test #7: ring_binqueue_TEST ..................... Passed 33.13 sec
Start 11: ring_permute2_TEST
8/18 Test #9: ring_spike_buffer_TEST ................. Passed 33.33 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 33.93 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #10: ring_permute1_TEST ..................... Passed 24.00 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 52.59 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST ..........................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 d86aefa (2021-11-29 15:44:45 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 212.8672, Min 212.6797, Avg 212.7065
Memory (MBs) : After MPI_Init : Max 212.8672, Min 212.6797, Avg 212.7065
Memory (MBs) : Before nrn_setup : Max 213.1914, Min 213.0625, Avg 213.0786
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.43 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 213.2109, Min 213.0820, Avg 213.0981
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 213.3945, Min 213.0820, Avg 213.1436
Memory (MBs) : After nrn_finitialize : Max 279.7930, Min 213.2539, Avg 229.8755
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST .................***Timeout 1500.09 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 d86aefa (2021-11-29 15:44:45 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 212.8711, Min 212.6797, Avg 212.7070
Memory (MBs) : After MPI_Init : Max 212.8711, Min 212.6797, Avg 212.7070
Memory (MBs) : Before nrn_setup : Max 213.1797, Min 213.0586, Avg 213.0737
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.60 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 213.1992, Min 213.0781, Avg 213.0933
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=true
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap_binqueue
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 213.3828, Min 213.0781, Avg 213.1387
Memory (MBs) : After nrn_finitialize : Max 279.7891, Min 213.2500, Avg 229.8711
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 d86aefa (2021-11-29 15:44:45 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 212.8711, Min 212.6797, Avg 212.7070
Memory (MBs) : After MPI_Init : Max 212.8711, Min 212.6797, Avg 212.7070
Memory (MBs) : Before nrn_setup : Max 213.1797, Min 213.0586, Avg 213.0737
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 2.89 seconds
Model size : 93.34 kB
Memory (MBs) : After nrn_setup : Max 213.3711, Min 213.0781, Avg 213.1362
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=true
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap_multisend
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 213.3711, Min 213.0781, Avg 213.1362
Memory (MBs) : After nrn_finitialize : Max 279.7695, Min 213.2383, Avg 229.8599
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST .................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 d86aefa (2021-11-29 15:44:45 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 212.8906, Min 212.6797, Avg 212.7095
Memory (MBs) : After MPI_Init : Max 212.8906, Min 212.6797, Avg 212.7095
Memory (MBs) : Before nrn_setup : Max 213.1797, Min 213.0586, Avg 213.0737
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.32 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 213.1992, Min 213.0781, Avg 213.0933
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=1
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99605/_/spack-build/spack-stage-coreneuron-develop-zlwgeoedcsxjuxmsxmqszgt6asxykrym/spack-build-zlwgeoe/tests/integration/ring_gap_permute1
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 213.3828, Min 213.0781, Avg 213.1387
Memory (MBs) : After nrn_finitialize : Max 279.6250, Min 213.1016, Avg 229.7202
16/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 90.59 sec
17/18 Test #16: ring_gap_permute2_TEST ................. Passed 288.46 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 283.88 sec
78% tests passed, 4 tests failed out of 18
Total Test time (real) = 1824.23 sec
The following tests FAILED:
12 - ring_gap_TEST (Timeout)
13 - ring_gap_binqueue_TEST (Timeout)
14 - ring_gap_multisend_TEST (Timeout)
15 - ring_gap_permute1_TEST (Timeout)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: ldir01u13: task 0: Exited with exit code 1
section_end:1638200768:step_script section_start:1638200768:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=63422 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99609 responseStatus=201 Created token=No9AVDKd
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=63452 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99609 responseStatus=201 Created token=No9AVDKd
section_end:1638200769:upload_artifacts_on_failure section_start:1638200769:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638200770:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198636:resolve_secrets Resolving secrets
section_end:1638198636:resolve_secrets section_start:1638198636:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor663482621, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99607
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99607
A slurm job will be created with name GL_J99607_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94309
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638198656:prepare_executor section_start:1638198656:prepare_script Preparing environment
Running on r1i5n20 via bbpv1.epfl.ch...
section_end:1638198659:prepare_script section_start:1638198659:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198660:get_sources section_start:1638198660:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (99603)...
Runtime platform  arch=amd64 os=linux pid=150133 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99603 responseStatus=200 OK token=USoRFWfN
section_end:1638198661:download_artifacts section_start:1638198661:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i4n0
Build name: Linux-icpc
Create new tag: 20211129-1511 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99603/_/spack-build/spack-stage-coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3/spack-build-cwjs4t3
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #3: alignment_test ..................... Passed 2.31 sec
2/17 Test #2: interleave_info_constructor_test ... Passed 2.57 sec
Start 7: ring_binqueue_TEST
3/17 Test #1: cmd_interface_test ................. Passed 2.71 sec
4/17 Test #4: queuing_test ....................... Passed 2.76 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 2.92 sec
6/17 Test #17: reporting_1 ........................ Passed 6.00 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 6.21 sec
Start 10: ring_permute1_TEST
8/17 Test #7: ring_binqueue_TEST ................. Passed 4.76 sec
Start 11: ring_permute2_TEST
9/17 Test #8: ring_multisend_TEST ................ Passed 5.04 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 2.30 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 2.89 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 8.40 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #15: ring_gap_permute1_TEST ............. Passed 1330.20 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #12: ring_gap_TEST ...................... Passed 1423.17 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 1465.90 sec
16/17 Test #13: ring_gap_binqueue_TEST ............. Passed 1474.56 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 136.88 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 1483.01 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1638200186:step_script section_start:1638200186:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=196772 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99607 responseStatus=201 Created token=t7xJ9VBQ
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=196820 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99607 responseStatus=201 Created token=t7xJ9VBQ
section_end:1638200188:upload_artifacts_on_success section_start:1638200188:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638200189:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198462:resolve_secrets Resolving secrets
section_end:1638198462:resolve_secrets section_start:1638198462:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor079341918, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99618
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99618
A slurm job will be created with name GL_J99618_PROD_P112_CP2_C2
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 94303
job state: R
section_end:1638198463:prepare_executor section_start:1638198463:prepare_script Preparing environment
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1638198464:prepare_script section_start:1638198464:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198465:get_sources section_start:1638198465:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:gpu (99614)...
Runtime platform  arch=amd64 os=linux pid=32838 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99614 responseStatus=200 OK token=YXbDhcCk
section_end:1638198466:download_artifacts section_start:1638198466:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n19
Build name: Linux-nvc++
Create new tag: 20211129-1508 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99614/_/spack-build/spack-stage-neuron-develop-vkogqddlipn6wfzq2o4mkbt36t7uknzy/spack-build-vkogqdd
Start 48: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 52: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 69: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 73: testcorenrn_deriv::coreneuron_cpu_offline::preparation
1/162 Test #59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 2.43 sec
Start 87: testcorenrn_patstim::coreneuron_gpu_offline::preparation
2/162 Test #63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.47 sec
Start 125: testcorenrn_conc::coreneuron_gpu_offline::preparation
3/162 Test #69: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 2.52 sec
Start 129: testcorenrn_conc::coreneuron_cpu_offline::preparation
4/162 Test #73: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.54 sec
Start 135: testcorenrn_kin::coreneuron_gpu_offline::preparation
5/162 Test #48: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 3.86 sec
Start 79: testcorenrn_gf::coreneuron_gpu_offline::preparation
6/162 Test #52: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 3.90 sec
Start 83: testcorenrn_gf::coreneuron_cpu_offline::preparation
7/162 Test #87: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 1.74 sec
Start 139: testcorenrn_kin::coreneuron_cpu_offline::preparation
8/162 Test #125: testcorenrn_conc::coreneuron_gpu_offline::preparation .............. Passed 1.73 sec
Start 44: external_ringtest::neuron
9/162 Test #129: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 1.70 sec
Start 55: testcorenrn_bbcore::neuron
10/162 Test #135: testcorenrn_kin::coreneuron_gpu_offline::preparation ............... Passed 1.70 sec
Start 56: testcorenrn_bbcore::coreneuron_gpu_online
11/162 Test #79: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 1.84 sec
Start 89: testcorenrn_patstim::coreneuron_cpu_offline::preparation
12/162 Test #83: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 1.84 sec
Start 95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
13/162 Test #44: external_ringtest::neuron .......................................... Passed 1.56 sec
Start 57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
14/162 Test #55: testcorenrn_bbcore::neuron ......................................... Passed 1.83 sec
Start 58: testcorenrn_bbcore::coreneuron_gpu_offline
15/162 Test #139: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 1.89 sec
Start 60: testcorenrn_bbcore::coreneuron_cpu_online
16/162 Test #56: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 2.65 sec
Start 61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
17/162 Test #89: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 1.77 sec
Start 99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
18/162 Test #95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 1.86 sec
Start 115: testcorenrn_watch::coreneuron_gpu_offline::preparation
19/162 Test #60: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 3.22 sec
Start 62: testcorenrn_bbcore::coreneuron_cpu_offline
20/162 Test #58: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 3.28 sec
Start 65: testcorenrn_deriv::neuron
21/162 Test #57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 3.92 sec
Start 66: testcorenrn_deriv::coreneuron_gpu_online
22/162 Test #99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 2.89 sec
Start 119: testcorenrn_watch::coreneuron_cpu_offline::preparation
23/162 Test #115: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 3.03 sec
Start 45: external_ringtest::neuron_mpi
24/162 Test #61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 4.24 sec
Start 67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
25/162 Test #62: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 1.85 sec
Start 68: testcorenrn_deriv::coreneuron_gpu_offline
26/162 Test #65: testcorenrn_deriv::neuron .......................................... Passed 1.88 sec
Start 70: testcorenrn_deriv::coreneuron_cpu_online
27/162 Test #119: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 2.29 sec
Start 46: external_ringtest::coreneuron_cpu_mpi
28/162 Test #66: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 3.53 sec
Start 71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
29/162 Test #70: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 3.34 sec
Start 72: testcorenrn_deriv::coreneuron_cpu_offline
30/162 Test #68: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 4.19 sec
Start 86: testcorenrn_patstim::coreneuron_gpu_offline
31/162 Test #67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 4.99 sec
Start 121: testcorenrn_conc::neuron
32/162 Test #72: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 1.80 sec
Start 122: testcorenrn_conc::coreneuron_gpu_online
33/162 Test #71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 4.24 sec
Start 123: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate
34/162 Test #121: testcorenrn_conc::neuron ........................................... Passed 1.85 sec
Start 124: testcorenrn_conc::coreneuron_gpu_offline
35/162 Test #86: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 2.66 sec
Start 126: testcorenrn_conc::coreneuron_cpu_online
36/162 Test #122: testcorenrn_conc::coreneuron_gpu_online ............................ Passed 5.20 sec
Start 127: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
37/162 Test #126: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 4.44 sec
Start 128: testcorenrn_conc::coreneuron_cpu_offline
38/162 Test #45: external_ringtest::neuron_mpi ...................................... Passed 12.56 sec
Start 47: external_ringtest::coreneuron_cpu_mpi_offline
39/162 Test #124: testcorenrn_conc::coreneuron_gpu_offline ........................... Passed 5.57 sec
Start 131: testcorenrn_kin::neuron
40/162 Test #123: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate ........... Passed 6.57 sec
Start 132: testcorenrn_kin::coreneuron_gpu_online
41/162 Test #128: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 2.33 sec
Start 133: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate
42/162 Test #131: testcorenrn_kin::neuron ............................................ Passed 1.85 sec
Start 134: testcorenrn_kin::coreneuron_gpu_offline
43/162 Test #127: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 4.01 sec
Start 136: testcorenrn_kin::coreneuron_cpu_online
44/162 Test #46: external_ringtest::coreneuron_cpu_mpi .............................. Passed 13.10 sec
Start 49: external_ringtest::coreneuron_cpu_mpi_threads
45/162 Test #47: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 3.82 sec
Start 50: external_ringtest::coreneuron_gpu_mpi
46/162 Test #132: testcorenrn_kin::coreneuron_gpu_online ............................. Passed 4.59 sec
Start 137: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
47/162 Test #136: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 3.81 sec
Start 138: testcorenrn_kin::coreneuron_cpu_offline
48/162 Test #134: testcorenrn_kin::coreneuron_gpu_offline ............................ Passed 5.52 sec
Start 144: channel_benchmark_hippo::neuron
49/162 Test #133: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate ............ Passed 6.26 sec
Start 145: channel_benchmark_hippo::coreneuron_gpu_online
50/162 Test #138: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 8.28 sec
Start 146: channel_benchmark_hippo::coreneuron_gpu_filemode
51/162 Test #49: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 12.57 sec
Start 51: external_ringtest::coreneuron_gpu_mpi_offline
52/162 Test #137: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 10.65 sec
Start 147: channel_benchmark_hippo::coreneuron_cpu_online
53/162 Test #50: external_ringtest::coreneuron_gpu_mpi .............................. Passed 20.31 sec
Start 53: external_ringtest::coreneuron_gpu_mpi_threads
54/162 Test #51: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 18.62 sec
Start 75: testcorenrn_gf::neuron
55/162 Test #75: testcorenrn_gf::neuron ............................................. Passed 6.27 sec
Start 76: testcorenrn_gf::coreneuron_gpu_online
56/162 Test #53: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 29.97 sec
Start 77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
57/162 Test #76: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 23.23 sec
Start 78: testcorenrn_gf::coreneuron_gpu_offline
58/162 Test #78: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 20.46 sec
Start 80: testcorenrn_gf::coreneuron_cpu_online
59/162 Test #77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 30.36 sec
Start 81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
60/162 Test #145: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 85.15 sec
Start 148: channel_benchmark_hippo::coreneuron_cpu_filemode
61/162 Test #144: channel_benchmark_hippo::neuron .................................... Passed 90.74 sec
Start 150: channel_benchmark_sscx::neuron
62/162 Test #80: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 18.49 sec
Start 82: testcorenrn_gf::coreneuron_cpu_offline
63/162 Test #146: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 90.88 sec
Start 151: channel_benchmark_sscx::coreneuron_gpu_online
64/162 Test #81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 22.54 sec
Start 85: testcorenrn_patstim::neuron
65/162 Test #147: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 92.51 sec
Start 152: channel_benchmark_sscx::coreneuron_gpu_filemode
66/162 Test #85: testcorenrn_patstim::neuron ........................................ Passed 3.52 sec
Start 88: testcorenrn_patstim::coreneuron_cpu_offline
67/162 Test #82: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 8.43 sec
Start 91: testcorenrn_vecplay::neuron
68/162 Test #91: testcorenrn_vecplay::neuron ........................................ Passed 2.58 sec
Start 92: testcorenrn_vecplay::coreneuron_gpu_online
69/162 Test #88: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 12.95 sec
Start 93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
70/162 Test #92: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 25.50 sec
Start 94: testcorenrn_vecplay::coreneuron_gpu_offline
71/162 Test #93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 30.27 sec
Start 96: testcorenrn_vecplay::coreneuron_cpu_online
72/162 Test #94: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 18.68 sec
Start 97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
73/162 Test #96: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 19.73 sec
Start 98: testcorenrn_vecplay::coreneuron_cpu_offline
74/162 Test #97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 22.98 sec
Start 111: testcorenrn_watch::neuron
75/162 Test #98: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 8.94 sec
Start 112: testcorenrn_watch::coreneuron_gpu_online
76/162 Test #111: testcorenrn_watch::neuron .......................................... Passed 3.37 sec
Start 113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
77/162 Test #148: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 91.49 sec
Start 153: channel_benchmark_sscx::coreneuron_cpu_online
78/162 Test #151: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 85.18 sec
Start 154: channel_benchmark_sscx::coreneuron_cpu_filemode
79/162 Test #150: channel_benchmark_sscx::neuron ..................................... Passed 92.13 sec
Start 1: testneuron
80/162 Test #1: testneuron ......................................................... Passed 0.06 sec
Start 2: ringtest
81/162 Test #2: ringtest ........................................................... Passed 0.27 sec
Start 3: connect_dend
82/162 Test #3: connect_dend ....................................................... Passed 0.15 sec
Start 4: pynrn_tests::basic_tests
83/162 Test #152: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 83.32 sec
Start 5: rxdmod_tests::rxd_tests
84/162 Test #112: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 14.43 sec
Start 114: testcorenrn_watch::coreneuron_gpu_offline
85/162 Test #4: pynrn_tests::basic_tests ........................................... Passed 8.42 sec
Start 6: rxdmod_tests::rxd_mpi_tests
86/162 Test #113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 20.63 sec
Start 116: testcorenrn_watch::coreneuron_cpu_online
87/162 Test #114: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 13.28 sec
Start 117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
88/162 Test #116: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 19.27 sec
Start 118: testcorenrn_watch::coreneuron_cpu_offline
89/162 Test #117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 16.80 sec
Start 141: testcorenrn_netstimdirect::direct_netstimdirect
90/162 Test #118: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 10.40 sec
Start 142: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
91/162 Test #141: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 12.43 sec
Start 7: parallel_tests
Start 8: parallel_partrans
92/162 Test #153: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 55.00 sec
Start 9: parallel_bas
93/162 Test #154: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 50.77 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
94/162 Test #142: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 7.83 sec
Start 11: coreneuron_modtests::direct_py_cpu
Start 12: coreneuron_modtests::direct_hoc_cpu
95/162 Test #8: parallel_partrans .................................................. Passed 6.12 sec
Start 13: coreneuron_modtests::spikes_py_cpu
96/162 Test #7: parallel_tests ..................................................... Passed 6.23 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
97/162 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 5.73 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
98/162 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 7.31 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
99/162 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 6.84 sec
Start 17: coreneuron_modtests::test_units_py_cpu
100/162 Test #9: parallel_bas ....................................................... Passed 10.29 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
101/162 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 2.59 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
102/162 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 5.51 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
103/162 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 6.21 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
104/162 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 3.89 sec
Start 25: coreneuron_modtests::direct_py_gpu
105/162 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 6.06 sec
Start 26: coreneuron_modtests::direct_hoc_gpu
106/162 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 4.60 sec
Start 27: coreneuron_modtests::spikes_py_gpu
107/162 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 3.95 sec
Start 28: coreneuron_modtests::spikes_file_mode_py_gpu
108/162 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 4.63 sec
Start 29: coreneuron_modtests::fast_imem_py_gpu
109/162 Test #29: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 2.33 sec
Start 30: coreneuron_modtests::datareturn_py_gpu
110/162 Test #25: coreneuron_modtests::direct_py_gpu ................................. Passed 5.90 sec
Start 31: coreneuron_modtests::test_units_py_gpu
111/162 Test #26: coreneuron_modtests::direct_hoc_gpu ................................ Passed 4.06 sec
Start 32: coreneuron_modtests::test_netmove_py_gpu
112/162 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 9.66 sec
Start 33: coreneuron_modtests::test_watchrange_py_gpu
113/162 Test #28: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 5.37 sec
Start 34: coreneuron_modtests::test_psolve_py_gpu
114/162 Test #27: coreneuron_modtests::spikes_py_gpu ................................. Passed 8.01 sec
Start 35: coreneuron_modtests::test_natrans_py_gpu
115/162 Test #31: coreneuron_modtests::test_units_py_gpu ............................. Passed 4.69 sec
Start 39: external_nrntest
116/162 Test #33: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 6.88 sec
Start 54: external_ringtest::compare_results
117/162 Test #54: external_ringtest::compare_results ................................. Passed 0.33 sec
Start 64: testcorenrn_bbcore::compare_results
118/162 Test #64: testcorenrn_bbcore::compare_results ................................ Passed 0.19 sec
Start 74: testcorenrn_deriv::compare_results
119/162 Test #74: testcorenrn_deriv::compare_results ................................. Passed 0.15 sec
Start 84: testcorenrn_gf::compare_results
120/162 Test #84: testcorenrn_gf::compare_results .................................... Passed 0.19 sec
Start 90: testcorenrn_patstim::compare_results
121/162 Test #90: testcorenrn_patstim::compare_results ............................... Passed 0.08 sec
Start 100: testcorenrn_vecplay::compare_results
122/162 Test #100: testcorenrn_vecplay::compare_results ............................... Passed 0.06 sec
Start 120: testcorenrn_watch::compare_results
123/162 Test #120: testcorenrn_watch::compare_results ................................. Passed 0.06 sec
Start 130: testcorenrn_conc::compare_results
124/162 Test #130: testcorenrn_conc::compare_results .................................. Passed 0.08 sec
Start 140: testcorenrn_kin::compare_results
125/162 Test #140: testcorenrn_kin::compare_results ................................... Passed 0.10 sec
Start 143: testcorenrn_netstimdirect::compare_results
126/162 Test #143: testcorenrn_netstimdirect::compare_results ......................... Passed 0.10 sec
Start 149: channel_benchmark_hippo::compare_results
127/162 Test #149: channel_benchmark_hippo::compare_results ........................... Passed 0.06 sec
Start 155: channel_benchmark_sscx::compare_results
128/162 Test #155: channel_benchmark_sscx::compare_results ............................ Passed 0.13 sec
129/162 Test #34: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 7.34 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
130/162 Test #35: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 6.24 sec
131/162 Test #30: coreneuron_modtests::datareturn_py_gpu ............................. Passed 12.93 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
132/162 Test #32: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 13.13 sec
133/162 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 3.95 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
134/162 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 8.59 sec
Start 36: coreneuron_modtests::spikes_mpi_py_gpu
135/162 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 7.46 sec
Start 37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
136/162 Test #37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 9.32 sec
Start 38: coreneuron_modtests::inputpresyn_py_gpu
137/162 Test #36: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 9.75 sec
138/162 Test #38: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 13.37 sec
Start 105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
139/162 Test #105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 3.61 sec
Start 109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
140/162 Test #109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 3.61 sec
Start 157: olfactory-bulb-3d::neuron::preparation
141/162 Test #157: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.02 sec
Start 159: olfactory-bulb-3d::coreneuron_gpu_online::preparation
142/162 Test #159: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.02 sec
Start 161: olfactory-bulb-3d::coreneuron_cpu_online::preparation
143/162 Test #161: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.02 sec
Start 40: reduced_dentate::neuron
144/162 Test #40: reduced_dentate::neuron ............................................ Passed 32.04 sec
Start 41: reduced_dentate::coreneuron_cpu
145/162 Test #39: external_nrntest ................................................... Passed 154.03 sec
146/162 Test #41: reduced_dentate::coreneuron_cpu .................................... Passed 97.17 sec
Start 42: reduced_dentate::coreneuron_gpu
147/162 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 255.23 sec
148/162 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 271.89 sec
Start 101: testcorenrn_vecevent::neuron
149/162 Test #101: testcorenrn_vecevent::neuron ....................................... Passed 1.78 sec
Start 102: testcorenrn_vecevent::coreneuron_gpu_online
150/162 Test #42: reduced_dentate::coreneuron_gpu .................................... Passed 48.31 sec
Start 103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
151/162 Test #102: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 15.03 sec
Start 104: testcorenrn_vecevent::coreneuron_gpu_offline
152/162 Test #103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 4.66 sec
Start 106: testcorenrn_vecevent::coreneuron_cpu_online
153/162 Test #104: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 4.72 sec
Start 107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
154/162 Test #106: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 5.58 sec
Start 108: testcorenrn_vecevent::coreneuron_cpu_offline
155/162 Test #107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 5.88 sec
Start 156: olfactory-bulb-3d::neuron
156/162 Test #108: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 2.19 sec
Start 158: olfactory-bulb-3d::coreneuron_gpu_online
157/162 Test #158: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 72.16 sec
Start 160: olfactory-bulb-3d::coreneuron_cpu_online
158/162 Test #156: olfactory-bulb-3d::neuron .......................................... Passed 90.73 sec
Start 43: reduced_dentate::compare_results
Start 110: testcorenrn_vecevent::compare_results
159/162 Test #43: reduced_dentate::compare_results ................................... Passed 0.09 sec
160/162 Test #110: testcorenrn_vecevent::compare_results .............................. Passed 0.09 sec
161/162 Test #160: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 44.97 sec
Start 162: olfactory-bulb-3d::compare_results
162/162 Test #162: olfactory-bulb-3d::compare_results ................................. Passed 0.24 sec
100% tests passed, 0 tests failed out of 162
Total Test time (real) = 640.44 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1638199140:step_script section_start:1638199140:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=47076 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99618 responseStatus=201 Created token=R2YPfyWW
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=47108 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99618 responseStatus=201 Created token=R2YPfyWW
section_end:1638199141:upload_artifacts_on_success section_start:1638199141:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638199142:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638198495:resolve_secrets Resolving secrets
section_end:1638198495:resolve_secrets section_start:1638198495:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor705909446, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99616
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99616
A slurm job will be created with name GL_J99616_PROD_P112_CP5_C6
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94304
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638198510:prepare_executor section_start:1638198510:prepare_script Preparing environment
Running on r1i5n19 via bbpv1.epfl.ch...
section_end:1638198513:prepare_script section_start:1638198513:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638198514:get_sources section_start:1638198514:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:intel (99612)...
Runtime platform  arch=amd64 os=linux pid=208417 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99612 responseStatus=200 OK token=4HmtcF3z
section_end:1638198515:download_artifacts section_start:1638198515:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n20
Build name: Linux-icpc
Create new tag: 20211129-1509 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99612/_/spack-build/spack-stage-neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm/spack-build-mvn7s3z
Start 33: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 46: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 52: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_patstim::coreneuron_cpu_offline::preparation
1/103 Test #46: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.35 sec
Start 80: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/103 Test #40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.41 sec
Start 86: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/103 Test #52: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 2.61 sec
Start 62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
4/103 Test #56: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 2.67 sec
Start 74: testcorenrn_watch::coreneuron_cpu_offline::preparation
5/103 Test #33: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 3.30 sec
Start 29: external_ringtest::neuron
Start 36: testcorenrn_bbcore::neuron
6/103 Test #80: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 1.63 sec
Start 37: testcorenrn_bbcore::coreneuron_cpu_online
7/103 Test #86: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 1.66 sec
Start 38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
8/103 Test #62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 1.95 sec
Start 30: external_ringtest::neuron_mpi
9/103 Test #74: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 1.93 sec
Start 31: external_ringtest::coreneuron_cpu_mpi
10/103 Test #36: testcorenrn_bbcore::neuron ......................................... Passed 1.63 sec
Start 39: testcorenrn_bbcore::coreneuron_cpu_offline
11/103 Test #29: external_ringtest::neuron .......................................... Passed 1.93 sec
Start 42: testcorenrn_deriv::neuron
12/103 Test #37: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 2.08 sec
Start 43: testcorenrn_deriv::coreneuron_cpu_online
13/103 Test #39: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 1.91 sec
Start 44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
14/103 Test #38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 2.93 sec
Start 45: testcorenrn_deriv::coreneuron_cpu_offline
15/103 Test #42: testcorenrn_deriv::neuron .......................................... Passed 2.13 sec
Start 76: testcorenrn_conc::neuron
16/103 Test #45: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 1.59 sec
Start 77: testcorenrn_conc::coreneuron_cpu_online
17/103 Test #76: testcorenrn_conc::neuron ........................................... Passed 2.22 sec
Start 78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
18/103 Test #43: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 3.99 sec
Start 79: testcorenrn_conc::coreneuron_cpu_offline
19/103 Test #44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 4.22 sec
Start 82: testcorenrn_kin::neuron
20/103 Test #30: external_ringtest::neuron_mpi ...................................... Passed 6.76 sec
Start 32: external_ringtest::coreneuron_cpu_mpi_offline
21/103 Test #79: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 1.63 sec
Start 83: testcorenrn_kin::coreneuron_cpu_online
22/103 Test #31: external_ringtest::coreneuron_cpu_mpi .............................. Passed 7.15 sec
Start 34: external_ringtest::coreneuron_cpu_mpi_threads
23/103 Test #77: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 3.35 sec
Start 84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
24/103 Test #78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 3.05 sec
Start 85: testcorenrn_kin::coreneuron_cpu_offline
25/103 Test #82: testcorenrn_kin::neuron ............................................ Passed 1.62 sec
Start 91: channel_benchmark_hippo::neuron
26/103 Test #32: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 2.77 sec
Start 48: testcorenrn_gf::neuron
27/103 Test #83: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 2.79 sec
Start 92: channel_benchmark_hippo::coreneuron_cpu_online
28/103 Test #85: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 1.95 sec
Start 93: channel_benchmark_hippo::coreneuron_cpu_filemode
29/103 Test #84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 3.53 sec
Start 95: channel_benchmark_sscx::neuron
30/103 Test #34: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 5.82 sec
Start 49: testcorenrn_gf::coreneuron_cpu_online
31/103 Test #48: testcorenrn_gf::neuron ............................................. Passed 6.64 sec
Start 50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
32/103 Test #49: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 10.90 sec
Start 51: testcorenrn_gf::coreneuron_cpu_offline
33/103 Test #51: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 6.36 sec
Start 54: testcorenrn_patstim::neuron
34/103 Test #50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 17.76 sec
Start 55: testcorenrn_patstim::coreneuron_cpu_offline
35/103 Test #54: testcorenrn_patstim::neuron ........................................ Passed 3.71 sec
Start 58: testcorenrn_vecplay::neuron
36/103 Test #55: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 2.30 sec
Start 59: testcorenrn_vecplay::coreneuron_cpu_online
37/103 Test #58: testcorenrn_vecplay::neuron ........................................ Passed 3.67 sec
Start 60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
38/103 Test #59: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 6.55 sec
Start 61: testcorenrn_vecplay::coreneuron_cpu_offline
39/103 Test #61: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 4.47 sec
Start 70: testcorenrn_watch::neuron
40/103 Test #60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 14.20 sec
Start 71: testcorenrn_watch::coreneuron_cpu_online
41/103 Test #70: testcorenrn_watch::neuron .......................................... Passed 5.04 sec
Start 72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
42/103 Test #71: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 6.71 sec
Start 73: testcorenrn_watch::coreneuron_cpu_offline
43/103 Test #73: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 3.35 sec
Start 88: testcorenrn_netstimdirect::direct_netstimdirect
44/103 Test #72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 11.33 sec
Start 89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
45/103 Test #88: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 6.65 sec
Start 96: channel_benchmark_sscx::coreneuron_cpu_online
Start 97: channel_benchmark_sscx::coreneuron_cpu_filemode
46/103 Test #89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 19.28 sec
Start 1: testneuron
Start 2: ringtest
47/103 Test #1: testneuron ......................................................... Passed 0.09 sec
Start 3: connect_dend
48/103 Test #3: connect_dend ....................................................... Passed 0.18 sec
Start 4: pynrn_tests::basic_tests
49/103 Test #2: ringtest ........................................................... Passed 0.33 sec
Start 5: rxdmod_tests::rxd_tests
50/103 Test #4: pynrn_tests::basic_tests ........................................... Passed 7.22 sec
Start 6: rxdmod_tests::rxd_mpi_tests
51/103 Test #95: channel_benchmark_sscx::neuron ..................................... Passed 125.72 sec
Start 7: parallel_tests
52/103 Test #91: channel_benchmark_hippo::neuron .................................... Passed 133.31 sec
Start 8: parallel_partrans
53/103 Test #92: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 133.46 sec
Start 9: parallel_bas
54/103 Test #93: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 137.51 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
55/103 Test #8: parallel_partrans .................................................. Passed 9.14 sec
Start 11: coreneuron_modtests::direct_py_cpu
56/103 Test #7: parallel_tests ..................................................... Passed 19.08 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
57/103 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 5.36 sec
Start 13: coreneuron_modtests::spikes_py_cpu
58/103 Test #9: parallel_bas ....................................................... Passed 23.71 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
59/103 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 23.39 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
60/103 Test #96: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 111.84 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
61/103 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 30.33 sec
Start 17: coreneuron_modtests::test_units_py_cpu
62/103 Test #97: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 112.52 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
63/103 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 20.95 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
64/103 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 15.83 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
65/103 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 12.58 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
66/103 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 6.57 sec
Start 25: external_nrntest
67/103 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 10.12 sec
Start 35: external_ringtest::compare_results
68/103 Test #35: external_ringtest::compare_results ................................. Passed 1.06 sec
Start 41: testcorenrn_bbcore::compare_results
69/103 Test #41: testcorenrn_bbcore::compare_results ................................ Passed 0.85 sec
Start 47: testcorenrn_deriv::compare_results
70/103 Test #47: testcorenrn_deriv::compare_results ................................. Passed 0.59 sec
Start 53: testcorenrn_gf::compare_results
71/103 Test #53: testcorenrn_gf::compare_results .................................... Passed 0.39 sec
Start 57: testcorenrn_patstim::compare_results
72/103 Test #57: testcorenrn_patstim::compare_results ............................... Passed 0.66 sec
Start 63: testcorenrn_vecplay::compare_results
73/103 Test #63: testcorenrn_vecplay::compare_results ............................... Passed 0.59 sec
Start 75: testcorenrn_watch::compare_results
74/103 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 14.19 sec
Start 81: testcorenrn_conc::compare_results
75/103 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 15.15 sec
Start 87: testcorenrn_kin::compare_results
76/103 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 13.77 sec
Start 90: testcorenrn_netstimdirect::compare_results
77/103 Test #75: testcorenrn_watch::compare_results ................................. Passed 1.64 sec
Start 94: channel_benchmark_hippo::compare_results
78/103 Test #81: testcorenrn_conc::compare_results .................................. Passed 0.94 sec
Start 98: channel_benchmark_sscx::compare_results
79/103 Test #87: testcorenrn_kin::compare_results ................................... Passed 1.12 sec
80/103 Test #90: testcorenrn_netstimdirect::compare_results ......................... Passed 0.85 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
81/103 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 14.05 sec
82/103 Test #98: channel_benchmark_sscx::compare_results ............................ Passed 0.55 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
83/103 Test #94: channel_benchmark_hippo::compare_results ........................... Passed 0.84 sec
84/103 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 7.57 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
85/103 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 7.42 sec
86/103 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 123.42 sec
Start 68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
87/103 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 2.39 sec
88/103 Test #68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 2.16 sec
Start 100: olfactory-bulb-3d::neuron::preparation
89/103 Test #100: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.03 sec
Start 102: olfactory-bulb-3d::coreneuron_cpu_online::preparation
90/103 Test #102: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.03 sec
Start 26: reduced_dentate::neuron
91/103 Test #26: reduced_dentate::neuron ............................................ Passed 11.85 sec
Start 27: reduced_dentate::coreneuron_cpu
92/103 Test #27: reduced_dentate::coreneuron_cpu .................................... Passed 15.79 sec
Start 64: testcorenrn_vecevent::neuron
Start 28: reduced_dentate::compare_results
93/103 Test #28: reduced_dentate::compare_results ................................... Passed 0.08 sec
94/103 Test #64: testcorenrn_vecevent::neuron ....................................... Passed 6.57 sec
Start 65: testcorenrn_vecevent::coreneuron_cpu_online
95/103 Test #65: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 12.77 sec
Start 66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
96/103 Test #66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 7.25 sec
Start 67: testcorenrn_vecevent::coreneuron_cpu_offline
97/103 Test #67: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 1.78 sec
Start 99: olfactory-bulb-3d::neuron
Start 69: testcorenrn_vecevent::compare_results
98/103 Test #69: testcorenrn_vecevent::compare_results .............................. Passed 0.59 sec
99/103 Test #25: external_nrntest ................................................... Passed 156.05 sec
100/103 Test #99: olfactory-bulb-3d::neuron .......................................... Passed 78.82 sec
Start 101: olfactory-bulb-3d::coreneuron_cpu_online
101/103 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 263.55 sec
102/103 Test #101: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 47.60 sec
Start 103: olfactory-bulb-3d::compare_results
103/103 Test #103: olfactory-bulb-3d::compare_results ................................. Passed 0.27 sec
100% tests passed, 0 tests failed out of 103
Total Test time (real) = 396.29 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1638198951:step_script section_start:1638198951:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=227838 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99616 responseStatus=201 Created token=_BPXxAvX
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=227871 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99616 responseStatus=201 Created token=_BPXxAvX
section_end:1638198952:upload_artifacts_on_success section_start:1638198952:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638198953:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638199695:resolve_secrets Resolving secrets
section_end:1638199695:resolve_secrets section_start:1638199695:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor658631828, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99617
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99617
A slurm job will be created with name GL_J99617_PROD_P112_CP4_C5
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 94348
job state: R
section_end:1638199696:prepare_executor section_start:1638199696:prepare_script Preparing environment
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1638199701:prepare_script section_start:1638199701:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638199702:get_sources section_start:1638199702:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl:gpu (99613)...
Runtime platform  arch=amd64 os=linux pid=49132 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99613 responseStatus=200 OK token=-dKbWSDM
section_end:1638199702:download_artifacts section_start:1638199702:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n19
Build name: Linux-nvc++
Create new tag: 20211129-1529 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99613/_/spack-build/spack-stage-neuron-develop-kxhxq4seozqasdxdnbgni3g566ai7oyd/spack-build-kxhxq4s
Start 48: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 52: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 69: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 73: testcorenrn_deriv::coreneuron_cpu_offline::preparation
1/142 Test #73: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.44 sec
Start 87: testcorenrn_patstim::coreneuron_gpu_offline::preparation
2/142 Test #59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 2.46 sec
Start 44: external_ringtest::neuron
3/142 Test #69: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 2.48 sec
Start 55: testcorenrn_bbcore::neuron
4/142 Test #63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.52 sec
Start 56: testcorenrn_bbcore::coreneuron_gpu_online
5/142 Test #44: external_ringtest::neuron .......................................... Passed 1.52 sec
Start 57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
6/142 Test #87: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 1.82 sec
Start 58: testcorenrn_bbcore::coreneuron_gpu_offline
7/142 Test #48: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 4.63 sec
Start 79: testcorenrn_gf::coreneuron_gpu_offline::preparation
8/142 Test #55: testcorenrn_bbcore::neuron ......................................... Passed 3.44 sec
Start 60: testcorenrn_bbcore::coreneuron_cpu_online
9/142 Test #52: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 6.10 sec
Start 83: testcorenrn_gf::coreneuron_cpu_offline::preparation
10/142 Test #56: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 4.08 sec
Start 61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
11/142 Test #79: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 2.15 sec
Start 89: testcorenrn_patstim::coreneuron_cpu_offline::preparation
12/142 Test #58: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 2.77 sec
Start 62: testcorenrn_bbcore::coreneuron_cpu_offline
13/142 Test #57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 3.86 sec
Start 65: testcorenrn_deriv::neuron
14/142 Test #62: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 2.14 sec
Start 66: testcorenrn_deriv::coreneuron_gpu_online
15/142 Test #65: testcorenrn_deriv::neuron .......................................... Passed 2.57 sec
Start 67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
16/142 Test #61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 3.97 sec
Start 68: testcorenrn_deriv::coreneuron_gpu_offline
17/142 Test #68: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 5.19 sec
Start 70: testcorenrn_deriv::coreneuron_cpu_online
18/142 Test #66: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 7.67 sec
Start 71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
19/142 Test #67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 6.91 sec
Start 72: testcorenrn_deriv::coreneuron_cpu_offline
20/142 Test #89: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 11.57 sec
Start 95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
21/142 Test #72: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 2.04 sec
Start 86: testcorenrn_patstim::coreneuron_gpu_offline
22/142 Test #70: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 3.97 sec
Start 124: channel_benchmark_hippo::neuron
23/142 Test #83: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 14.76 sec
Start 99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
24/142 Test #95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 2.58 sec
Start 115: testcorenrn_watch::coreneuron_gpu_offline::preparation
25/142 Test #71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 4.10 sec
Start 125: channel_benchmark_hippo::coreneuron_gpu_online
26/142 Test #60: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 16.15 sec
Start 126: channel_benchmark_hippo::coreneuron_gpu_filemode
27/142 Test #86: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 2.77 sec
Start 127: channel_benchmark_hippo::coreneuron_cpu_online
28/142 Test #99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 2.44 sec
Start 119: testcorenrn_watch::coreneuron_cpu_offline::preparation
29/142 Test #115: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 2.49 sec
Start 45: external_ringtest::neuron_mpi
30/142 Test #119: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 2.54 sec
Start 46: external_ringtest::coreneuron_cpu_mpi
31/142 Test #45: external_ringtest::neuron_mpi ...................................... Passed 9.88 sec
Start 47: external_ringtest::coreneuron_cpu_mpi_offline
32/142 Test #46: external_ringtest::coreneuron_cpu_mpi .............................. Passed 18.86 sec
Start 49: external_ringtest::coreneuron_cpu_mpi_threads
33/142 Test #47: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 12.55 sec
Start 50: external_ringtest::coreneuron_gpu_mpi
34/142 Test #49: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 20.84 sec
Start 51: external_ringtest::coreneuron_gpu_mpi_offline
35/142 Test #50: external_ringtest::coreneuron_gpu_mpi .............................. Passed 28.22 sec
Start 53: external_ringtest::coreneuron_gpu_mpi_threads
36/142 Test #51: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 18.61 sec
Start 75: testcorenrn_gf::neuron
37/142 Test #75: testcorenrn_gf::neuron ............................................. Passed 6.07 sec
Start 76: testcorenrn_gf::coreneuron_gpu_online
38/142 Test #53: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 30.99 sec
Start 77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
39/142 Test #125: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 88.88 sec
Start 128: channel_benchmark_hippo::coreneuron_cpu_filemode
40/142 Test #126: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 88.31 sec
Start 130: channel_benchmark_sscx::neuron
41/142 Test #76: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 21.89 sec
Start 78: testcorenrn_gf::coreneuron_gpu_offline
42/142 Test #124: channel_benchmark_hippo::neuron .................................... Passed 94.07 sec
Start 131: channel_benchmark_sscx::coreneuron_gpu_online
43/142 Test #127: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 92.89 sec
Start 132: channel_benchmark_sscx::coreneuron_gpu_filemode
44/142 Test #77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 21.93 sec
Start 80: testcorenrn_gf::coreneuron_cpu_online
45/142 Test #78: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 19.26 sec
Start 81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
46/142 Test #80: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 12.29 sec
Start 82: testcorenrn_gf::coreneuron_cpu_offline
47/142 Test #82: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 14.84 sec
Start 85: testcorenrn_patstim::neuron
48/142 Test #85: testcorenrn_patstim::neuron ........................................ Passed 3.40 sec
Start 88: testcorenrn_patstim::coreneuron_cpu_offline
49/142 Test #81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 26.32 sec
Start 91: testcorenrn_vecplay::neuron
50/142 Test #91: testcorenrn_vecplay::neuron ........................................ Passed 2.74 sec
Start 92: testcorenrn_vecplay::coreneuron_gpu_online
51/142 Test #88: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 13.99 sec
Start 93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
52/142 Test #92: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 25.47 sec
Start 94: testcorenrn_vecplay::coreneuron_gpu_offline
53/142 Test #93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 24.03 sec
Start 96: testcorenrn_vecplay::coreneuron_cpu_online
54/142 Test #130: channel_benchmark_sscx::neuron ..................................... Passed 86.68 sec
Start 133: channel_benchmark_sscx::coreneuron_cpu_online
55/142 Test #131: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 89.11 sec
Start 134: channel_benchmark_sscx::coreneuron_cpu_filemode
56/142 Test #132: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 88.11 sec
Start 1: testneuron
57/142 Test #94: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 17.29 sec
Start 97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
58/142 Test #1: testneuron ......................................................... Passed 0.06 sec
Start 2: ringtest
59/142 Test #128: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 93.61 sec
Start 3: connect_dend
60/142 Test #2: ringtest ........................................................... Passed 0.28 sec
Start 4: pynrn_tests::basic_tests
61/142 Test #3: connect_dend ....................................................... Passed 0.32 sec
Start 5: rxdmod_tests::rxd_tests
62/142 Test #96: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 13.26 sec
Start 98: testcorenrn_vecplay::coreneuron_cpu_offline
63/142 Test #4: pynrn_tests::basic_tests ........................................... Passed 8.99 sec
Start 6: rxdmod_tests::rxd_mpi_tests
64/142 Test #97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 13.11 sec
Start 111: testcorenrn_watch::neuron
65/142 Test #98: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 9.49 sec
Start 112: testcorenrn_watch::coreneuron_gpu_online
66/142 Test #111: testcorenrn_watch::neuron .......................................... Passed 2.92 sec
Start 113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
67/142 Test #112: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 16.07 sec
Start 114: testcorenrn_watch::coreneuron_gpu_offline
68/142 Test #113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 21.59 sec
Start 116: testcorenrn_watch::coreneuron_cpu_online
69/142 Test #114: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 13.46 sec
Start 117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
70/142 Test #133: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 51.34 sec
Start 7: parallel_tests
71/142 Test #134: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 45.52 sec
Start 8: parallel_partrans
72/142 Test #116: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 9.49 sec
Start 118: testcorenrn_watch::coreneuron_cpu_offline
73/142 Test #117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 4.98 sec
Start 121: testcorenrn_netstimdirect::direct_netstimdirect
74/142 Test #8: parallel_partrans .................................................. Passed 4.70 sec
Start 9: parallel_bas
75/142 Test #7: parallel_tests ..................................................... Passed 5.16 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
76/142 Test #118: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 4.99 sec
Start 122: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
77/142 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 5.19 sec
Start 11: coreneuron_modtests::direct_py_cpu
78/142 Test #9: parallel_bas ....................................................... Passed 6.55 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
79/142 Test #121: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 9.97 sec
Start 13: coreneuron_modtests::spikes_py_cpu
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
80/142 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 3.16 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
81/142 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 4.32 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
82/142 Test #122: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 9.63 sec
Start 17: coreneuron_modtests::test_units_py_cpu
Start 18: coreneuron_modtests::test_netmove_py_cpu
83/142 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 2.12 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
84/142 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 4.46 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
85/142 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 5.14 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
86/142 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 5.37 sec
Start 25: coreneuron_modtests::direct_py_gpu
87/142 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 4.25 sec
Start 26: coreneuron_modtests::direct_hoc_gpu
88/142 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 4.97 sec
Start 27: coreneuron_modtests::spikes_py_gpu
89/142 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 4.85 sec
Start 28: coreneuron_modtests::spikes_file_mode_py_gpu
90/142 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 4.39 sec
Start 29: coreneuron_modtests::fast_imem_py_gpu
91/142 Test #26: coreneuron_modtests::direct_hoc_gpu ................................ Passed 4.23 sec
Start 30: coreneuron_modtests::datareturn_py_gpu
92/142 Test #29: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 2.47 sec
Start 31: coreneuron_modtests::test_units_py_gpu
93/142 Test #25: coreneuron_modtests::direct_py_gpu ................................. Passed 6.34 sec
Start 32: coreneuron_modtests::test_netmove_py_gpu
94/142 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 10.20 sec
Start 33: coreneuron_modtests::test_watchrange_py_gpu
95/142 Test #27: coreneuron_modtests::spikes_py_gpu ................................. Passed 6.95 sec
Start 34: coreneuron_modtests::test_psolve_py_gpu
96/142 Test #28: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 5.35 sec
Start 35: coreneuron_modtests::test_natrans_py_gpu
97/142 Test #31: coreneuron_modtests::test_units_py_gpu ............................. Passed 4.83 sec
Start 39: external_nrntest
98/142 Test #33: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 7.51 sec
Start 54: external_ringtest::compare_results
99/142 Test #54: external_ringtest::compare_results ................................. Passed 0.07 sec
Start 64: testcorenrn_bbcore::compare_results
100/142 Test #64: testcorenrn_bbcore::compare_results ................................ Passed 0.07 sec
Start 74: testcorenrn_deriv::compare_results
101/142 Test #74: testcorenrn_deriv::compare_results ................................. Passed 0.09 sec
Start 84: testcorenrn_gf::compare_results
102/142 Test #84: testcorenrn_gf::compare_results .................................... Passed 0.06 sec
Start 90: testcorenrn_patstim::compare_results
103/142 Test #90: testcorenrn_patstim::compare_results ............................... Passed 0.12 sec
Start 100: testcorenrn_vecplay::compare_results
104/142 Test #100: testcorenrn_vecplay::compare_results ............................... Passed 0.11 sec
Start 120: testcorenrn_watch::compare_results
105/142 Test #120: testcorenrn_watch::compare_results ................................. Passed 0.11 sec
Start 123: testcorenrn_netstimdirect::compare_results
106/142 Test #123: testcorenrn_netstimdirect::compare_results ......................... Passed 0.06 sec
Start 129: channel_benchmark_hippo::compare_results
107/142 Test #129: channel_benchmark_hippo::compare_results ........................... Passed 0.06 sec
Start 135: channel_benchmark_sscx::compare_results
108/142 Test #135: channel_benchmark_sscx::compare_results ............................ Passed 0.06 sec
109/142 Test #35: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 6.31 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
110/142 Test #34: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 7.49 sec
111/142 Test #30: coreneuron_modtests::datareturn_py_gpu ............................. Passed 13.53 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
112/142 Test #32: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 12.55 sec
113/142 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 4.23 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
114/142 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 10.06 sec
Start 36: coreneuron_modtests::spikes_mpi_py_gpu
115/142 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 9.04 sec
Start 37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
116/142 Test #37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 10.96 sec
Start 38: coreneuron_modtests::inputpresyn_py_gpu
117/142 Test #36: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 11.41 sec
118/142 Test #38: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 10.27 sec
Start 105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
119/142 Test #105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 3.36 sec
Start 109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
120/142 Test #109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 3.73 sec
Start 137: olfactory-bulb-3d::neuron::preparation
121/142 Test #137: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.02 sec
Start 139: olfactory-bulb-3d::coreneuron_gpu_online::preparation
122/142 Test #139: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.02 sec
Start 141: olfactory-bulb-3d::coreneuron_cpu_online::preparation
123/142 Test #141: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.02 sec
Start 40: reduced_dentate::neuron
124/142 Test #40: reduced_dentate::neuron ............................................ Passed 34.86 sec
Start 41: reduced_dentate::coreneuron_cpu
125/142 Test #39: external_nrntest ................................................... Passed 109.77 sec
126/142 Test #41: reduced_dentate::coreneuron_cpu .................................... Passed 37.34 sec
Start 42: reduced_dentate::coreneuron_gpu
127/142 Test #42: reduced_dentate::coreneuron_gpu .................................... Passed 35.16 sec
Start 101: testcorenrn_vecevent::neuron
Start 43: reduced_dentate::compare_results
128/142 Test #43: reduced_dentate::compare_results ................................... Passed 0.07 sec
129/142 Test #101: testcorenrn_vecevent::neuron ....................................... Passed 3.45 sec
Start 102: testcorenrn_vecevent::coreneuron_gpu_online
130/142 Test #102: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 18.57 sec
Start 103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
131/142 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 265.72 sec
132/142 Test #103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 14.97 sec
Start 104: testcorenrn_vecevent::coreneuron_gpu_offline
133/142 Test #104: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 3.42 sec
Start 106: testcorenrn_vecevent::coreneuron_cpu_online
134/142 Test #106: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 7.57 sec
Start 107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
135/142 Test #107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 9.16 sec
Start 108: testcorenrn_vecevent::coreneuron_cpu_offline
136/142 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 278.47 sec
Start 136: olfactory-bulb-3d::neuron
137/142 Test #108: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 2.05 sec
Start 138: olfactory-bulb-3d::coreneuron_gpu_online
138/142 Test #138: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 80.72 sec
Start 140: olfactory-bulb-3d::coreneuron_cpu_online
139/142 Test #136: olfactory-bulb-3d::neuron .......................................... Passed 91.56 sec
Start 110: testcorenrn_vecevent::compare_results
140/142 Test #110: testcorenrn_vecevent::compare_results .............................. Passed 0.09 sec
141/142 Test #140: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 39.59 sec
Start 142: olfactory-bulb-3d::compare_results
142/142 Test #142: olfactory-bulb-3d::compare_results ................................. Passed 0.24 sec
100% tests passed, 0 tests failed out of 142
Total Test time (real) = 612.64 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1638200353:step_script section_start:1638200353:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=60201 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99617 responseStatus=201 Created token=kjBF9eZb
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=60233 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99617 responseStatus=201 Created token=kjBF9eZb
section_end:1638200354:upload_artifacts_on_success section_start:1638200354:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638200355:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1638199278:resolve_secrets Resolving secrets
section_end:1638199278:resolve_secrets section_start:1638199278:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor698469059, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 27109, build ref d86aefa82808e5df00dcbd3c88d9893994c7f531, job ID 99615
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P27109/J99615
A slurm job will be created with name GL_J99615_PROD_P112_CP3_C4
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 94342
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: PD
job state: R
section_end:1638199294:prepare_executor section_start:1638199294:prepare_script Preparing environment
Running on r1i5n20 via bbpv1.epfl.ch...
section_end:1638199297:prepare_script section_start:1638199297:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1638199298:get_sources section_start:1638199298:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl:intel (99611)...
Runtime platform  arch=amd64 os=linux pid=177629 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=99611 responseStatus=200 OK token=_qejfGV2
section_end:1638199299:download_artifacts section_start:1638199299:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n20
Build name: Linux-icpc
Create new tag: 20211129-1522 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P27109/J99611/_/spack-build/spack-stage-neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev/spack-build-jhigcl7
Start 33: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 46: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 52: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_patstim::coreneuron_cpu_offline::preparation
1/103 Test #40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.18 sec
Start 80: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/103 Test #46: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.23 sec
Start 86: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/103 Test #52: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 2.60 sec
Start 62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
4/103 Test #56: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 2.64 sec
Start 74: testcorenrn_watch::coreneuron_cpu_offline::preparation
5/103 Test #33: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 2.95 sec
Start 29: external_ringtest::neuron
Start 36: testcorenrn_bbcore::neuron
6/103 Test #80: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 1.58 sec
Start 37: testcorenrn_bbcore::coreneuron_cpu_online
7/103 Test #86: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 1.60 sec
Start 38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
8/103 Test #62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 2.00 sec
Start 30: external_ringtest::neuron_mpi
9/103 Test #36: testcorenrn_bbcore::neuron ......................................... Passed 1.69 sec
Start 39: testcorenrn_bbcore::coreneuron_cpu_offline
10/103 Test #74: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 2.05 sec
Start 31: external_ringtest::coreneuron_cpu_mpi
11/103 Test #29: external_ringtest::neuron .......................................... Passed 2.03 sec
Start 42: testcorenrn_deriv::neuron
12/103 Test #37: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 2.36 sec
Start 43: testcorenrn_deriv::coreneuron_cpu_online
13/103 Test #39: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 1.58 sec
Start 44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
14/103 Test #38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 2.85 sec
Start 45: testcorenrn_deriv::coreneuron_cpu_offline
15/103 Test #42: testcorenrn_deriv::neuron .......................................... Passed 1.86 sec
Start 76: testcorenrn_conc::neuron
16/103 Test #45: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 1.59 sec
Start 77: testcorenrn_conc::coreneuron_cpu_online
17/103 Test #76: testcorenrn_conc::neuron ........................................... Passed 1.92 sec
Start 78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
18/103 Test #43: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 3.35 sec
Start 79: testcorenrn_conc::coreneuron_cpu_offline
19/103 Test #44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 4.04 sec
Start 82: testcorenrn_kin::neuron
20/103 Test #79: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 1.48 sec
Start 83: testcorenrn_kin::coreneuron_cpu_online
21/103 Test #30: external_ringtest::neuron_mpi ...................................... Passed 6.45 sec
Start 32: external_ringtest::coreneuron_cpu_mpi_offline
22/103 Test #31: external_ringtest::coreneuron_cpu_mpi .............................. Passed 6.42 sec
Start 34: external_ringtest::coreneuron_cpu_mpi_threads
23/103 Test #78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 3.13 sec
Start 84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
24/103 Test #82: testcorenrn_kin::neuron ............................................ Passed 1.77 sec
Start 85: testcorenrn_kin::coreneuron_cpu_offline
25/103 Test #77: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 3.77 sec
Start 91: channel_benchmark_hippo::neuron
26/103 Test #83: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 4.39 sec
Start 92: channel_benchmark_hippo::coreneuron_cpu_online
27/103 Test #85: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 3.47 sec
Start 93: channel_benchmark_hippo::coreneuron_cpu_filemode
28/103 Test #32: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 4.56 sec
Start 48: testcorenrn_gf::neuron
29/103 Test #34: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 7.98 sec
Start 49: testcorenrn_gf::coreneuron_cpu_online
30/103 Test #49: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 6.04 sec
Start 50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
31/103 Test #84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 15.14 sec
Start 95: channel_benchmark_sscx::neuron
32/103 Test #48: testcorenrn_gf::neuron ............................................. Passed 16.03 sec
Start 51: testcorenrn_gf::coreneuron_cpu_offline
33/103 Test #51: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 6.91 sec
Start 54: testcorenrn_patstim::neuron
34/103 Test #50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 16.89 sec
Start 55: testcorenrn_patstim::coreneuron_cpu_offline
35/103 Test #54: testcorenrn_patstim::neuron ........................................ Passed 3.84 sec
Start 58: testcorenrn_vecplay::neuron
36/103 Test #55: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 2.19 sec
Start 59: testcorenrn_vecplay::coreneuron_cpu_online
37/103 Test #58: testcorenrn_vecplay::neuron ........................................ Passed 3.28 sec
Start 60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
38/103 Test #59: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 5.67 sec
Start 61: testcorenrn_vecplay::coreneuron_cpu_offline
39/103 Test #61: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 3.27 sec
Start 70: testcorenrn_watch::neuron
40/103 Test #70: testcorenrn_watch::neuron .......................................... Passed 4.42 sec
Start 71: testcorenrn_watch::coreneuron_cpu_online
41/103 Test #60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 12.90 sec
Start 72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
42/103 Test #71: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 6.59 sec
Start 73: testcorenrn_watch::coreneuron_cpu_offline
43/103 Test #73: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 3.30 sec
Start 88: testcorenrn_netstimdirect::direct_netstimdirect
44/103 Test #72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 10.75 sec
Start 89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
45/103 Test #88: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 6.16 sec
Start 96: channel_benchmark_sscx::coreneuron_cpu_online
Start 97: channel_benchmark_sscx::coreneuron_cpu_filemode
46/103 Test #89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 13.09 sec
Start 1: testneuron
Start 2: ringtest
47/103 Test #1: testneuron ......................................................... Passed 0.08 sec
Start 3: connect_dend
48/103 Test #3: connect_dend ....................................................... Passed 0.18 sec
Start 4: pynrn_tests::basic_tests
49/103 Test #2: ringtest ........................................................... Passed 0.31 sec
Start 5: rxdmod_tests::rxd_tests
50/103 Test #4: pynrn_tests::basic_tests ........................................... Passed 5.67 sec
Start 6: rxdmod_tests::rxd_mpi_tests
51/103 Test #91: channel_benchmark_hippo::neuron .................................... Passed 117.96 sec
Start 7: parallel_tests
52/103 Test #92: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 119.54 sec
Start 8: parallel_partrans
53/103 Test #8: parallel_partrans .................................................. Passed 10.92 sec
Start 9: parallel_bas
54/103 Test #7: parallel_tests ..................................................... Passed 19.36 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
55/103 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 75.24 sec
Start 11: coreneuron_modtests::direct_py_cpu
56/103 Test #93: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 148.22 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
57/103 Test #95: channel_benchmark_sscx::neuron ..................................... Passed 136.84 sec
Start 13: coreneuron_modtests::spikes_py_cpu
58/103 Test #9: parallel_bas ....................................................... Passed 23.09 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
59/103 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 19.95 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
60/103 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 6.20 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
61/103 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 33.49 sec
Start 17: coreneuron_modtests::test_units_py_cpu
62/103 Test #96: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 121.18 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
63/103 Test #97: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 121.95 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
64/103 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 31.76 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
65/103 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 28.01 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
66/103 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 27.73 sec
Start 25: external_nrntest
67/103 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 29.74 sec
Start 35: external_ringtest::compare_results
68/103 Test #35: external_ringtest::compare_results ................................. Passed 0.27 sec
Start 41: testcorenrn_bbcore::compare_results
69/103 Test #41: testcorenrn_bbcore::compare_results ................................ Passed 0.24 sec
Start 47: testcorenrn_deriv::compare_results
70/103 Test #47: testcorenrn_deriv::compare_results ................................. Passed 0.89 sec
Start 53: testcorenrn_gf::compare_results
71/103 Test #53: testcorenrn_gf::compare_results .................................... Passed 0.77 sec
Start 57: testcorenrn_patstim::compare_results
72/103 Test #57: testcorenrn_patstim::compare_results ............................... Passed 0.36 sec
Start 63: testcorenrn_vecplay::compare_results
73/103 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 11.00 sec
Start 75: testcorenrn_watch::compare_results
74/103 Test #63: testcorenrn_vecplay::compare_results ............................... Passed 0.37 sec
Start 81: testcorenrn_conc::compare_results
75/103 Test #81: testcorenrn_conc::compare_results .................................. Passed 0.38 sec
Start 87: testcorenrn_kin::compare_results
76/103 Test #75: testcorenrn_watch::compare_results ................................. Passed 0.49 sec
Start 90: testcorenrn_netstimdirect::compare_results
77/103 Test #87: testcorenrn_kin::compare_results ................................... Passed 1.05 sec
Start 94: channel_benchmark_hippo::compare_results
78/103 Test #90: testcorenrn_netstimdirect::compare_results ......................... Passed 1.00 sec
Start 98: channel_benchmark_sscx::compare_results
79/103 Test #94: channel_benchmark_hippo::compare_results ........................... Passed 1.02 sec
80/103 Test #98: channel_benchmark_sscx::compare_results ............................ Passed 1.02 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
81/103 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 9.92 sec
82/103 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 10.45 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
83/103 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 9.17 sec
84/103 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 12.50 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
85/103 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 5.18 sec
86/103 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 4.36 sec
Start 68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
87/103 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 3.23 sec
88/103 Test #68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 2.24 sec
Start 100: olfactory-bulb-3d::neuron::preparation
89/103 Test #100: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.02 sec
Start 102: olfactory-bulb-3d::coreneuron_cpu_online::preparation
90/103 Test #102: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.02 sec
Start 26: reduced_dentate::neuron
91/103 Test #26: reduced_dentate::neuron ............................................ Passed 30.81 sec
Start 27: reduced_dentate::coreneuron_cpu
92/103 Test #27: reduced_dentate::coreneuron_cpu .................................... Passed 17.13 sec
Start 64: testcorenrn_vecevent::neuron
Start 28: reduced_dentate::compare_results
93/103 Test #28: reduced_dentate::compare_results ................................... Passed 0.07 sec
94/103 Test #64: testcorenrn_vecevent::neuron ....................................... Passed 3.74 sec
Start 65: testcorenrn_vecevent::coreneuron_cpu_online
95/103 Test #65: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 8.14 sec
Start 66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
96/103 Test #66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 28.38 sec
Start 67: testcorenrn_vecevent::coreneuron_cpu_offline
97/103 Test #67: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 2.03 sec
Start 99: olfactory-bulb-3d::neuron
Start 69: testcorenrn_vecevent::compare_results
98/103 Test #69: testcorenrn_vecevent::compare_results .............................. Passed 0.08 sec
99/103 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 245.19 sec
100/103 Test #25: external_nrntest ................................................... Passed 186.48 sec
Start 101: olfactory-bulb-3d::coreneuron_cpu_online
101/103 Test #99: olfactory-bulb-3d::neuron .......................................... Passed 83.80 sec
102/103 Test #101: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 43.06 sec
Start 103: olfactory-bulb-3d::compare_results
103/103 Test #103: olfactory-bulb-3d::compare_results ................................. Passed 0.19 sec
100% tests passed, 0 tests failed out of 103
Total Test time (real) = 426.85 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1638199769:step_script section_start:1638199769:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=187051 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=99615 responseStatus=201 Created token=x4bmHp8z
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=187082 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=99615 responseStatus=201 Created token=x4bmHp8z
section_end:1638199771:upload_artifacts_on_success section_start:1638199771:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1638199772:cleanup_file_variables Job succeeded
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment