Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created December 21, 2021 18:56
Show Gist options
  • Save bbpbuildbot/eb4a2bbb02c032f4b69516e8f79d2db2 to your computer and use it in GitHub Desktop.
Save bbpbuildbot/eb4a2bbb02c032f4b69516e8f79d2db2 to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/30188 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#699.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640104984:resolve_secrets Resolving secrets
section_end:1640104984:resolve_secrets section_start:1640104984:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor685074744, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113210
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113210
A slurm job will be created with name GL_J113210_PROD_P112_CP16_C23
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142017
job state: R
section_end:1640104986:prepare_executor section_start:1640104986:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640104991:prepare_script section_start:1640104991:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640104992:get_sources section_start:1640104992:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=20273 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640105224:restore_cache section_start:1640105224:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (113204)...
Runtime platform  arch=amd64 os=linux pid=26250 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113204 responseStatus=200 OK token=tiEN87np
section_end:1640105225:download_artifacts section_start:1640105225:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113210/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113210/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113210/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113210/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113210/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7295f4a667503ec4677262632bb0636f48812336"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..ca44375 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7295f4a667503ec4677262632bb0636f48812336")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+gpu+tests~legacy-unit~report build_type=RelWithDebInfo
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be 7r3a4d2rmvk5oeb6vt52s4zg2hppmnjp
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113210/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113210/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 17:52:28 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.32 / 0.51 (61.57 %)
Files: 7809
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: '7r3a4d2rmvk5oeb6vt52s4zg2hppmnjp'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit~report+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- 7r3a4d2 coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
==> Installing coreneuron-develop-7r3a4d2rmvk5oeb6vt52s4zg2hppmnjp
==> No binary for coreneuron-develop-7r3a4d2rmvk5oeb6vt52s4zg2hppmnjp found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-7r3a4d
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113210/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113210/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:06:06 2021
Hits: 114 / 117 (97.44 %)
Direct: 98 / 117 (83.76 %)
Preprocessed: 16 / 19 (84.21 %)
Misses: 3
Direct: 19
Preprocessed: 3
Uncacheable: 18
Primary storage:
Hits: 227 / 234 (97.01 %)
Misses: 7
Cache size (GB): 0.32 / 0.51 (61.58 %)
Files: 7815
Uncacheable:
Called for linking: 15
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640106371:step_script section_start:1640106371:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=56287 revision=58ba2b95 version=14.2.0
ccache/: found 8376 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-6
Created cache
section_end:1640106435:archive_cache section_start:1640106435:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=58623 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113210 responseStatus=201 Created token=EsNxt9Y_
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=58666 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113210 responseStatus=201 Created token=EsNxt9Y_
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=58698 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113210 responseStatus=201 Created token=EsNxt9Y_
section_end:1640106437:upload_artifacts_on_success section_start:1640106437:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640106437:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640104984:resolve_secrets Resolving secrets
section_end:1640104984:resolve_secrets section_start:1640104984:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor264441750, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113208
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113208
A slurm job will be created with name GL_J113208_PROD_P112_CP15_C22
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142016
job state: R
section_end:1640104985:prepare_executor section_start:1640104985:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640104991:prepare_script section_start:1640104991:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640104991:get_sources section_start:1640104991:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=20242 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640105158:restore_cache section_start:1640105158:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (113204)...
Runtime platform  arch=amd64 os=linux pid=24758 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113204 responseStatus=200 OK token=tiEN87np
section_end:1640105159:download_artifacts section_start:1640105159:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113208/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113208/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113208/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113208/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113208/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7295f4a667503ec4677262632bb0636f48812336"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..ca44375 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7295f4a667503ec4677262632bb0636f48812336")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113208/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113208/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 17:52:33 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.31 / 0.51 (61.42 %)
Files: 6157
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'aevgkbdozl3htdtjhrd5w65n3c6mb2jh'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- aevgkbd coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
==> Installing coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh
==> No binary for coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113208/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113208/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:02:42 2021
Hits: 108 / 117 (92.31 %)
Direct: 92 / 118 (77.97 %)
Preprocessed: 16 / 26 (61.54 %)
Misses: 9
Direct: 26
Preprocessed: 10
Uncacheable: 20
Primary storage:
Hits: 215 / 236 (91.10 %)
Misses: 21
Cache size (GB): 0.31 / 0.51 (61.44 %)
Files: 6175
Uncacheable:
Called for linking: 16
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640106170:step_script section_start:1640106170:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=46133 revision=58ba2b95 version=14.2.0
ccache/: found 6736 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-6
Created cache
section_end:1640106207:archive_cache section_start:1640106207:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=47491 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113208 responseStatus=201 Created token=AZ6vgB2S
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=47539 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113208 responseStatus=201 Created token=AZ6vgB2S
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=47621 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113208 responseStatus=201 Created token=AZ6vgB2S
section_end:1640106209:upload_artifacts_on_success section_start:1640106209:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640106210:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640107389:resolve_secrets Resolving secrets
section_end:1640107389:resolve_secrets section_start:1640107389:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor879107078, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113209
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113209
A slurm job will be created with name GL_J113209_PROD_P112_CP4_C6
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142150
job state: R
section_end:1640107391:prepare_executor section_start:1640107391:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640107393:prepare_script section_start:1640107393:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640107393:get_sources section_start:1640107393:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=72382 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640107438:restore_cache section_start:1640107438:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:gpu (113206)...
Runtime platform  arch=amd64 os=linux pid=72835 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113206 responseStatus=200 OK token=ddR4yQyT
section_end:1640107439:download_artifacts section_start:1640107439:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7295f4a667503ec4677262632bb0636f48812336"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..ca44375 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7295f4a667503ec4677262632bb0636f48812336")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+nmodl+gpu+tests~legacy-unit~report build_type=RelWithDebInfo ^/zfakioujxsm45dlnonboqvphrxexao57
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113209/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113209/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:25:34 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.32 / 0.51 (61.58 %)
Files: 7815
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+nmodl~report+tests build_type=RelWithDebInfo
[+] ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- qnf2dk3 coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] zfakiou ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
==> Installing coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo
==> No binary for coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-qnf2dk
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113209/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113209/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:54:35 2021
Hits: 86 / 95 (90.53 %)
Direct: 1 / 95 (1.05 %)
Preprocessed: 85 / 94 (90.43 %)
Misses: 9
Direct: 94
Preprocessed: 9
Uncacheable: 15
Primary storage:
Hits: 87 / 190 (45.79 %)
Misses: 103
Cache size (GB): 0.32 / 0.51 (61.91 %)
Files: 7918
Uncacheable:
Called for linking: 12
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640109284:step_script section_start:1640109284:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=110916 revision=58ba2b95 version=14.2.0
ccache/: found 8479 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-6
Created cache
section_end:1640109334:archive_cache section_start:1640109334:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=112196 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113209 responseStatus=201 Created token=menUS1ag
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=112219 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113209 responseStatus=201 Created token=menUS1ag
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=112242 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113209 responseStatus=201 Created token=menUS1ag
section_end:1640109335:upload_artifacts_on_success section_start:1640109335:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640109336:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640107347:resolve_secrets Resolving secrets
section_end:1640107347:resolve_secrets section_start:1640107347:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor286126988, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113207
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113207
A slurm job will be created with name GL_J113207_PROD_P112_CP3_C0
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142148
job state: R
section_end:1640107349:prepare_executor section_start:1640107349:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640107351:prepare_script section_start:1640107351:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640107351:get_sources section_start:1640107351:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=69501 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640107372:restore_cache section_start:1640107372:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:intel (113205)...
Runtime platform  arch=amd64 os=linux pid=70787 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113205 responseStatus=200 OK token=EeNG8U-1
section_end:1640107373:download_artifacts section_start:1640107373:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113207/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113207/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113207/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113207/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113207/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="7295f4a667503ec4677262632bb0636f48812336"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..ca44375 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="7295f4a667503ec4677262632bb0636f48812336")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+nmodl+tests~legacy-unit build_type=Debug ^/lqyttqytclxdwwickak7uvjmb6a3au3g
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113207/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113207/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:24:15 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.31 / 0.51 (61.44 %)
Files: 6175
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'cwjs4t3f4wyl5jax3fb2obxbvjopwgn3'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+nmodl+tests build_type=Debug
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- cwjs4t3 coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
==> Installing coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
==> No binary for coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113207/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113207/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:37:02 2021
Hits: 81 / 95 (85.26 %)
Direct: 0 / 96 (0.00 %)
Preprocessed: 81 / 96 (84.38 %)
Misses: 14
Direct: 96
Preprocessed: 15
Uncacheable: 17
Primary storage:
Hits: 81 / 192 (42.19 %)
Misses: 111
Cache size (GB): 0.32 / 0.51 (61.84 %)
Files: 6284
Uncacheable:
Called for linking: 13
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640108232:step_script section_start:1640108232:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=94072 revision=58ba2b95 version=14.2.0
ccache/: found 6845 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-6
Created cache
section_end:1640108272:archive_cache section_start:1640108272:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=94782 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113207 responseStatus=201 Created token=bhErH5v-
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=94804 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113207 responseStatus=201 Created token=bhErH5v-
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=94840 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113207 responseStatus=201 Created token=bhErH5v-
section_end:1640108273:upload_artifacts_on_success section_start:1640108273:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640108274:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640106448:resolve_secrets Resolving secrets
section_end:1640106448:resolve_secrets section_start:1640106448:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor547685387, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113218
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113218
A slurm job will be created with name GL_J113218_PROD_P112_CP12_C12
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142127
job state: PD
job state: PD
job state: R
section_end:1640106451:prepare_executor section_start:1640106451:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640106454:prepare_script section_start:1640106454:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640106454:get_sources section_start:1640106454:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=59833 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640106821:restore_cache section_start:1640106821:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (113210)...
Runtime platform  arch=amd64 os=linux pid=63176 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113210 responseStatus=200 OK token=EsNxt9Y_
section_end:1640106821:download_artifacts section_start:1640106821:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113218/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113218/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113218/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113218/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113218/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/7r3a4d2rmvk5oeb6vt52s4zg2hppmnjp^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be bh5ipdlugcszf7h2tpm3kznvd5y74yr4
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113218/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113218/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:18:16 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.46 / 0.51 (90.76 %)
Files: 31488
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'bh5ipdlugcszf7h2tpm3kznvd5y74yr4'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- bh5ipdl neuron@develop%nvhpc@21.11+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] 7r3a4d2 ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5hjnqo3 ^gettext@0.21%nvhpc@21.11+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] uipobjs ^bzip2@1.0.8%nvhpc@21.11+shared arch=linux-rhel7-x86_64
[^] ruu3jsw ^libiconv@1.16%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] bt3jq7e ^libxml2@2.9.10%nvhpc@21.11~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] av5lrep ^pkgconf@1.7.3%nvhpc@21.11 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l6r3lhl ^xz@5.2.5%nvhpc@21.11~pic arch=linux-rhel7-x86_64
[^] tx5mit7 ^zlib@1.2.11%nvhpc@21.11+optimize+pic+shared arch=linux-rhel7-x86_64
[^] zuul7ic ^ncurses@6.2%nvhpc@21.11~symlinks+termlib arch=linux-rhel7-x86_64
[^] tnkl573 ^tar@1.28%nvhpc@21.11 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] arjv2hk ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 6upm4ih ^py-mpi4py@3.0.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] k3gs7u3 ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] qbjsyll ^py-setuptools-scm@4.1.2%nvhpc@21.11+toml arch=linux-rhel7-x86_64
[^] jtaqy3k ^py-toml@0.10.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ghwc5fz ^py-pytest-cov@2.8.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] vnepfwd ^py-coverage@5.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rx3mekq ^readline@8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-uipobjsrjwxnpkcrag4phvugoj7kn6h7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libiconv-1.16-ruu3js
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/pkgconf-1.7.3-av5lre
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/xz-5.2.5-l6r3lh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-tx5mit7opia6t3thbrdiubnz57rttfux)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-zuul7ickymna5aj5244q6ttogpw3o7wr)
[+] /usr (external tar-1.28-tnkl5732tb2dcrmu5z5kndpoiolmqzwh)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-rx3mekqaza7t4ajd57wqkzlm2yi7pihm)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-7r3a4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libxml2-2.9.10-bt3jq7
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/gettext-0.21-5hjnqo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-toml-0.10.0-jtaqy3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-arjv2h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-coverage-5.3-vnepfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-mpi4py-3.0.3-6upm4i
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-scm-4.1.2-qbjsyl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-k3gs7u
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-cov-2.8.1-ghwc5f
==> Installing neuron-develop-bh5ipdlugcszf7h2tpm3kznvd5y74yr4
==> No binary for neuron-develop-bh5ipdlugcszf7h2tpm3kznvd5y74yr4 found: installing from source
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 142127.4 ON r1i6n19 CANCELLED AT 2021-12-21T19:07:36 DUE TO TIME LIMIT ***
srun: error: r1i6n19: task 0: Terminated
section_end:1640110057:step_script ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640106217:resolve_secrets Resolving secrets
section_end:1640106217:resolve_secrets section_start:1640106217:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor161883387, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113216
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113216
A slurm job will be created with name GL_J113216_PROD_P112_CP2_C4
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142123
job state: PD
job state: PD
job state: R
section_end:1640106220:prepare_executor section_start:1640106220:prepare_script Preparing environment
Running on r1i7n22 via bbpv1.epfl.ch...
section_end:1640106222:prepare_script section_start:1640106222:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640106223:get_sources section_start:1640106223:restore_cache Restoring cache
Checking cache for neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=28355 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640106621:restore_cache section_start:1640106621:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (113208)...
Runtime platform  arch=amd64 os=linux pid=40578 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113208 responseStatus=200 OK token=AZ6vgB2S
section_end:1640106622:download_artifacts section_start:1640106622:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113216/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113216/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113216/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113216/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113216/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be mvn7s3za436y6xrhbspwpy7pbewubnvm
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113216/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113216/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:15:25 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.44 / 0.51 (85.18 %)
Files: 23743
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'mvn7s3za436y6xrhbspwpy7pbewubnvm'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- mvn7s3z neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] aevgkbd ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
- zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
==> Installing py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk
==> No binary for py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk found: installing from source
==> Warning: Missing a source id for neuron@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/28/280baa8ec489c4f542f8940f9c4c2181f0306a8ee1a54eceba071a449fb870a0.tar.gz
==> py-coverage: Executing phase: 'build'
==> py-coverage: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe
==> No binary for py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/cc/cc6742d8bac45070217169f5f72ceee1e0e55b0221f54bcf24845972d3a47f2b.tar.gz
==> py-pytest-cov: Executing phase: 'build'
==> py-pytest-cov: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
==> Installing neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm
==> No binary for neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm found: installing from source
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-mvn7s3
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113216/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113216/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:52:57 2021
Hits: 451 / 903 (49.94 %)
Direct: 15 / 912 (1.64 %)
Preprocessed: 436 / 891 (48.93 %)
Misses: 452
Direct: 897
Preprocessed: 455
Uncacheable: 144
Primary storage:
Hits: 504 / 1818 (27.72 %)
Misses: 1314
Cache size (GB): 0.43 / 0.51 (83.68 %)
Files: 23295
Cleanups: 4
Uncacheable:
Autoconf compile/link: 7
Called for linking: 121
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640109181:step_script section_start:1640109181:archive_cache Saving cache for successful job
Creating cache neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=109694 revision=58ba2b95 version=14.2.0
ccache/: found 23856 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-6
Created cache
section_end:1640109267:archive_cache section_start:1640109267:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=111391 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113216 responseStatus=201 Created token=mpbqzuzd
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=111442 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113216 responseStatus=201 Created token=mpbqzuzd
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=111474 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113216 responseStatus=201 Created token=mpbqzuzd
section_end:1640109268:upload_artifacts_on_success section_start:1640109268:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640109269:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640109343:resolve_secrets Resolving secrets
section_end:1640109343:resolve_secrets section_start:1640109343:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor107204497, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113217
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113217
A slurm job will be created with name GL_J113217_PROD_P112_CP3_C20
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142213
job state: PD
job state: R
section_end:1640109345:prepare_executor section_start:1640109345:prepare_script Preparing environment
Running on r1i6n18 via bbpv1.epfl.ch...
section_end:1640109349:prepare_script section_start:1640109349:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640109350:get_sources section_start:1640109350:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=231436 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640109674:restore_cache section_start:1640109674:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (113209)...
Runtime platform  arch=amd64 os=linux pid=235401 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113209 responseStatus=200 OK token=menUS1ag
section_end:1640109675:download_artifacts section_start:1640109675:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113217/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113217/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113217/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113217/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113217/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be l5xudub2hnpapwg7j7jfpyyfppajgmz5
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113217/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113217/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 19:03:44 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.46 / 0.51 (90.76 %)
Files: 31488
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'l5xudub2hnpapwg7j7jfpyyfppajgmz5'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- l5xudub neuron@develop%nvhpc@21.11+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] qnf2dk3 ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] zfakiou ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5hjnqo3 ^gettext@0.21%nvhpc@21.11+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] uipobjs ^bzip2@1.0.8%nvhpc@21.11+shared arch=linux-rhel7-x86_64
[^] ruu3jsw ^libiconv@1.16%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] bt3jq7e ^libxml2@2.9.10%nvhpc@21.11~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] av5lrep ^pkgconf@1.7.3%nvhpc@21.11 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l6r3lhl ^xz@5.2.5%nvhpc@21.11~pic arch=linux-rhel7-x86_64
[^] tx5mit7 ^zlib@1.2.11%nvhpc@21.11+optimize+pic+shared arch=linux-rhel7-x86_64
[^] zuul7ic ^ncurses@6.2%nvhpc@21.11~symlinks+termlib arch=linux-rhel7-x86_64
[^] tnkl573 ^tar@1.28%nvhpc@21.11 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] arjv2hk ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 6upm4ih ^py-mpi4py@3.0.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] k3gs7u3 ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] ghwc5fz ^py-pytest-cov@2.8.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] vnepfwd ^py-coverage@5.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rx3mekq ^readline@8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-uipobjsrjwxnpkcrag4phvugoj7kn6h7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libiconv-1.16-ruu3js
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/pkgconf-1.7.3-av5lre
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/xz-5.2.5-l6r3lh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-tx5mit7opia6t3thbrdiubnz57rttfux)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-zuul7ickymna5aj5244q6ttogpw3o7wr)
[+] /usr (external tar-1.28-tnkl5732tb2dcrmu5z5kndpoiolmqzwh)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-rx3mekqaza7t4ajd57wqkzlm2yi7pihm)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libxml2-2.9.10-bt3jq7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-coverage-5.3-vnepfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-arjv2h
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-mpi4py-3.0.3-6upm4i
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/gettext-0.21-5hjnqo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-k3gs7u
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-cov-2.8.1-ghwc5f
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-qnf2dk
==> Installing neuron-develop-l5xudub2hnpapwg7j7jfpyyfppajgmz5
==> No binary for neuron-develop-l5xudub2hnpapwg7j7jfpyyfppajgmz5 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 142213.4 ON r1i6n18 CANCELLED AT 2021-12-21T19:56:06 DUE TO TIME LIMIT ***
srun: error: r1i6n18: task 0: Terminated
section_end:1640112967:step_script ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640108278:resolve_secrets Resolving secrets
section_end:1640108278:resolve_secrets section_start:1640108278:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor736114802, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113215
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113215
A slurm job will be created with name GL_J113215_PROD_P112_CP1_C13
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142185
job state: R
section_end:1640108279:prepare_executor section_start:1640108279:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640108282:prepare_script section_start:1640108282:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640108282:get_sources section_start:1640108282:restore_cache Restoring cache
Checking cache for neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=95634 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640108484:restore_cache section_start:1640108484:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (113207)...
Runtime platform  arch=amd64 os=linux pid=97674 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113207 responseStatus=200 OK token=bhErH5v-
section_end:1640108484:download_artifacts section_start:1640108484:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113215/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113215/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113215/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113215/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113215/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be jhigcl7ephcbe47kbyz2znl76v2kaeev
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113215/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113215/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:44:36 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.44 / 0.51 (85.18 %)
Files: 23743
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'jhigcl7ephcbe47kbyz2znl76v2kaeev'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- jhigcl7 neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] cwjs4t3 ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
==> Installing neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev
==> No binary for neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
Session terminated, killing shell... ...killed.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** STEP 142185.4 ON r1i6n19 CANCELLED AT 2021-12-21T19:38:06 DUE TO TIME LIMIT ***
srun: error: r1i6n19: task 0: Terminated
section_end:1640111887:step_script ERROR: Job failed: execution took longer than 1h0m0s seconds

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640104983:resolve_secrets Resolving secrets
section_end:1640104983:resolve_secrets section_start:1640104983:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor201131972, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113206
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113206
A slurm job will be created with name GL_J113206_PROD_P112_CP11_C21
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142015
job state: PD
job state: R
section_end:1640104986:prepare_executor section_start:1640104986:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640104991:prepare_script section_start:1640104991:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640104991:get_sources section_start:1640104991:restore_cache Restoring cache
Checking cache for nmodl-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=20240 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640105038:restore_cache section_start:1640105038:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (113204)...
Runtime platform  arch=amd64 os=linux pid=22157 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113204 responseStatus=200 OK token=tiEN87np
section_end:1640105040:download_artifacts section_start:1640105040:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113206/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113206/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113206/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113206/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113206/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%nvhpc~legacy-unit ^bison%gcc^flex%gcc^py-jinja2%gcc^py-sympy%gcc^py-pyyaml%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be zfakioujxsm45dlnonboqvphrxexao57
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113206/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113206/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 17:52:22 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (91.61 %)
Files: 1803
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'zfakioujxsm45dlnonboqvphrxexao57'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%nvhpc~legacy-unit
- ^bison%gcc
- ^flex%gcc
- ^py-jinja2%gcc
- ^py-pyyaml%gcc
- ^py-sympy%gcc
Concretized
--------------------------------
- zfakiou nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
- 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
- wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] qbjsyll ^py-setuptools-scm@4.1.2%nvhpc@21.11+toml arch=linux-rhel7-x86_64
[^] jtaqy3k ^py-toml@0.10.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
- 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
- qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
- 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
==> Installing py-mpmath-1.1.0-7efatr5xp6ijytyys53hdbzdcfizj6f7
==> No binary for py-mpmath-1.1.0-7efatr5xp6ijytyys53hdbzdcfizj6f7 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
==> Installing py-pyyaml-5.3.1-4tb344rji4vizzqbe7vutaodgeetbxnt
==> No binary for py-pyyaml-5.3.1-4tb344rji4vizzqbe7vutaodgeetbxnt found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/b8/b8eac752c5e14d3eca0e6dd9199cd627518cb5ec06add0de9d32baeee6fe645d.tar.gz
==> py-pyyaml: Executing phase: 'build_ext'
==> py-pyyaml: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
==> Installing py-markupsafe-1.1.1-7ap4eonjj5kjovymydraam2pebih5ygm
==> No binary for py-markupsafe-1.1.1-7ap4eonjj5kjovymydraam2pebih5ygm found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
==> Installing py-pytz-2020.1-oy6pnkwkgv6v554uiepxhhrc33tbwxd7
==> No binary for py-pytz-2020.1-oy6pnkwkgv6v554uiepxhhrc33tbwxd7 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/c3/c35965d010ce31b23eeb663ed3cc8c906275d6be1a34393a1d73a41febf4a048.tar.gz
==> py-pytz: Executing phase: 'build'
==> py-pytz: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-toml-0.10.0-jtaqy3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
==> Installing py-sympy-1.4-qqqe57g6iljndfgfmziodof6y4csagzm
==> No binary for py-sympy-1.4-qqqe57g6iljndfgfmziodof6y4csagzm found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
==> Installing py-babel-2.7.0-wmslplddrwaswc2jxsg42t2n6qwxcpxr
==> No binary for py-babel-2.7.0-wmslplddrwaswc2jxsg42t2n6qwxcpxr found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-scm-4.1.2-qbjsyl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
==> Installing py-jinja2-2.10.3-56d4qrpcad4eylgllie3r3mhklzapldd
==> No binary for py-jinja2-2.10.3-56d4qrpcad4eylgllie3r3mhklzapldd found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
==> Installing nmodl-develop-zfakioujxsm45dlnonboqvphrxexao57
==> No binary for nmodl-develop-zfakioujxsm45dlnonboqvphrxexao57 found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113206/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113206/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:22:35 2021
Hits: 49 / 137 (35.77 %)
Direct: 33 / 137 (24.09 %)
Preprocessed: 16 / 104 (15.38 %)
Misses: 88
Direct: 104
Preprocessed: 88
Uncacheable: 26
Primary storage:
Hits: 82 / 274 (29.93 %)
Misses: 192
Cache size (GB): 0.46 / 0.51 (90.30 %)
Files: 1791
Cleanups: 9
Uncacheable:
Called for linking: 26
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640107359:step_script section_start:1640107359:archive_cache Saving cache for successful job
Creating cache nmodl-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=69967 revision=58ba2b95 version=14.2.0
ccache/: found 2352 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-nvhpc-6
Created cache
section_end:1640107384:archive_cache section_start:1640107384:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=71798 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113206 responseStatus=201 Created token=ddR4yQyT
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=71845 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113206 responseStatus=201 Created token=ddR4yQyT
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=71882 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113206 responseStatus=201 Created token=ddR4yQyT
section_end:1640107385:upload_artifacts_on_success section_start:1640107385:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640107386:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640104983:resolve_secrets Resolving secrets
section_end:1640104983:resolve_secrets section_start:1640104983:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor325954882, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113205
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113205
A slurm job will be created with name GL_J113205_PROD_P112_CP6_C19
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142014
job state: PD
job state: R
section_end:1640104985:prepare_executor section_start:1640104985:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640104991:prepare_script section_start:1640104991:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640104991:get_sources section_start:1640104991:restore_cache Restoring cache
Checking cache for nmodl-intel-6...
Runtime platform  arch=amd64 os=linux pid=20169 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640105013:restore_cache section_start:1640105013:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (113204)...
Runtime platform  arch=amd64 os=linux pid=21047 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113204 responseStatus=200 OK token=tiEN87np
section_end:1640105014:download_artifacts section_start:1640105014:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113205/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113205/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113205/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113205/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113205/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl@develop%intel~legacy-unit
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be lqyttqytclxdwwickak7uvjmb6a3au3g
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113205/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113205/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 17:52:21 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.48 / 0.51 (93.04 %)
Files: 560
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'lqyttqytclxdwwickak7uvjmb6a3au3g'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl@develop%intel~legacy-unit
Concretized
--------------------------------
- lqyttqy nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
- ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
- yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
- oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
- za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
==> Installing py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2
==> No binary for py-mpmath-1.1.0-d6t5uhnfv6vz76zvbq6dxzezju47q4b2 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/fc/fc17abe05fbab3382b61a123c398508183406fa132e0223874578e20946499f6.tar.gz
==> py-mpmath: Executing phase: 'build'
==> py-mpmath: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
==> Installing py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw
==> No binary for py-more-itertools-8.7.0-mikhjgqoad5w4yqy27gs5e6resjbaofw found: installing from source
==> Fetching https://pypi.io/packages/source/m/more-itertools/more-itertools-8.7.0.tar.gz
==> py-more-itertools: Executing phase: 'build'
==> py-more-itertools: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
==> Installing py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k
==> No binary for py-wcwidth-0.1.7-za7jmvshfdsnmghmumjvxfinateuen3k found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/3d/3df37372226d6e63e1b1e1eda15c594bca98a22d33a23832a90998faa96bc65e.tar.gz
==> py-wcwidth: Executing phase: 'build'
==> py-wcwidth: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
==> Installing py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724
==> No binary for py-markupsafe-1.1.1-oe2hrfthehpamljikolcjblr7mt52724 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/29/29872e92839765e546828bb7754a68c418d927cd064fd4708fab9fe9c8bb116b.tar.gz
==> py-markupsafe: Executing phase: 'build'
==> py-markupsafe: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
==> Installing py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw
==> No binary for py-sympy-1.4-runxrmnc6ccdqey2sq7njyz4u4i2x7xw found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/71/71a11e5686ae7ab6cb8feb5bd2651ef4482f8fd43a7c27e645a165e4353b23e1.tar.gz
==> py-sympy: Executing phase: 'build'
==> py-sympy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
==> Installing py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7
==> No binary for py-babel-2.7.0-yrbfda2telivet3ruvwscmtafc7zoys7 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/e8/e86135ae101e31e2c8ec20a4e0c5220f4eed12487d5cf3f78be7e98d3a57fc28.tar.gz
==> py-babel: Executing phase: 'build'
==> py-babel: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
==> Installing py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt
==> No binary for py-packaging-19.2-hziuwhjrhckeozwekkhwxabvm4onfilt found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/28/28b924174df7a2fa32c1953825ff29c61e2f5e082343165438812f00d3a7fc47.tar.gz
==> py-packaging: Executing phase: 'build'
==> py-packaging: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
==> Installing py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab
==> No binary for py-jinja2-2.10.3-ubiktsvw22gxnvhwzsoloqliz7czyhab found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/9f/9fe95f19286cfefaa917656583d020be14e7859c6b0252588391e47db34527de.tar.gz
==> py-jinja2: Executing phase: 'build'
==> py-jinja2: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
==> Installing py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4
==> No binary for py-pluggy-0.13.0-gc3zsisoxxbiopoa44i536m232c65zb4 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/fa/fa5fa1622fa6dd5c030e9cad086fa19ef6a0cf6d7a2d12318e10cb49d6d68f34.tar.gz
==> py-pluggy: Executing phase: 'build'
==> py-pluggy: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
==> Installing py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq
==> No binary for py-py-1.8.0-557icag4kia4rysswd2uxdettfkewclq found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/dc/dc639b046a6e2cff5bbe40194ad65936d6ba360b52b3c3fe1d08a82dd50b5e53.tar.gz
==> py-py: Executing phase: 'build'
==> py-py: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
==> Installing py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557
==> No binary for py-pytest-5.3.4-jo63uk3qcowoxe2ogccodpfmsdr2r557 found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/1d/1d122e8be54d1a709e56f82e2d85dcba3018313d64647f38a91aec88c239b600.tar.gz
==> py-pytest: Executing phase: 'build'
==> py-pytest: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g
==> No binary for nmodl-develop-lqyttqytclxdwwickak7uvjmb6a3au3g found: installing from source
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113205/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113205/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Tue Dec 21 18:21:54 2021
Hits: 42 / 137 (30.66 %)
Direct: 26 / 137 (18.98 %)
Preprocessed: 16 / 111 (14.41 %)
Misses: 95
Direct: 111
Preprocessed: 95
Uncacheable: 28
Primary storage:
Hits: 68 / 274 (24.82 %)
Misses: 206
Cache size (GB): 0.50 / 0.51 (97.10 %)
Files: 563
Cleanups: 14
Uncacheable:
Called for linking: 28
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640107319:step_script section_start:1640107319:archive_cache Saving cache for successful job
Creating cache nmodl-intel-6...
Runtime platform  arch=amd64 os=linux pid=68706 revision=58ba2b95 version=14.2.0
ccache/: found 1124 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/nmodl-intel-6
Created cache
section_end:1640107342:archive_cache section_start:1640107342:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=69056 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113205 responseStatus=201 Created token=EeNG8U-1
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=69082 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=113205 responseStatus=201 Created token=EeNG8U-1
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=69114 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113205 responseStatus=201 Created token=EeNG8U-1
section_end:1640107343:upload_artifacts_on_success section_start:1640107343:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640107344:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640104812:resolve_secrets Resolving secrets
section_end:1640104812:resolve_secrets section_start:1640104812:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor402261725, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113204
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113204
A slurm job will be created with name GL_J113204_PROD_P112_CP6_C23
Job parameters: memory=512M, cpus_per_task=1, duration=10:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142006
job state: R
section_end:1640104813:prepare_executor section_start:1640104813:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640104816:prepare_script section_start:1640104816:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640104817:get_sources section_start:1640104817:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ touch spack_clone_variables.env
$ if [[ "${PARSE_GITHUB_PR_DESCRIPTIONS}" == "true" && "${CI_PIPELINE_SOURCE}" == "external_pull_request_event" ]]; then
$ cat > parse_description.py << END_SCRIPT # collapsed multi-line command
$ cat parse_description.py
from __future__ import print_function
import os
import re
import requests
pr_info = requests.get("https://api.github.com/repos/{}/pulls/{}".format(
os.environ['CI_EXTERNAL_PULL_REQUEST_TARGET_REPOSITORY'],
os.environ['CI_EXTERNAL_PULL_REQUEST_IID']),
headers={'Accept': 'application/vnd.github.v3+json'})
pr_body = pr_info.json()["body"]
# match something like NEURON_BRANCH=foo/bar
pat = re.compile('^([A-Z0-9_]+)_([A-Z]+)=([A-Z0-9\-\_\/]+)$', re.IGNORECASE)
def parse_term(m):
ref_type = m.group(2).lower()
if ref_type not in {'branch', 'tag', 'ref'}: return
print('SPACK_PACKAGE_REF_' + m.group(1).lower() + '=' + ref_type + '="' + m.group(3) + '"')
if pr_body is not None:
for pr_body_line in pr_body.splitlines():
if not pr_body_line.startswith('CI_BRANCHES:'): continue
for config_term in pr_body_line[12:].split(','):
pat.sub(parse_term, config_term)
$ python parse_description.py > spack_clone_variables.env
$ cat spack_clone_variables.env
$ fi
$ echo Using ${PWD} as a working directory common to the whole pipeline...
Using /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113204/_ as a working directory common to the whole pipeline...
$ SPACK_BRANCH_PARSED=$(sed -n -e "s/^SPACK_PACKAGE_REF_spack=branch=\(['\"]\)\([^\1]\+\)\1/\2/p" spack_clone_variables.env)
$ SPACK_BRANCH=${SPACK_BRANCH_PARSED:-$SPACK_BRANCH}
$ echo Checking out the ${SPACK_BRANCH} of Spack...
Checking out the develop of Spack...
$ git clone --depth 1 --single-branch --branch ${SPACK_BRANCH} ${SPACK_URL} spack
Cloning into 'spack'...
Checking out files: 0% (44/7697) Checking out files: 1% (77/7697) Checking out files: 1% (146/7697) Checking out files: 2% (154/7697) Checking out files: 2% (229/7697) Checking out files: 3% (231/7697) Checking out files: 3% (292/7697) Checking out files: 4% (308/7697) Checking out files: 4% (356/7697) Checking out files: 5% (385/7697) Checking out files: 5% (423/7697) Checking out files: 6% (462/7697) Checking out files: 7% (539/7697) Checking out files: 7% (550/7697) Checking out files: 8% (616/7697) Checking out files: 8% (634/7697) Checking out files: 9% (693/7697) Checking out files: 9% (729/7697) Checking out files: 9% (756/7697) Checking out files: 10% (770/7697) Checking out files: 10% (812/7697) Checking out files: 10% (845/7697) Checking out files: 11% (847/7697) Checking out files: 11% (889/7697) Checking out files: 11% (906/7697) Checking out files: 12% (924/7697) Checking out files: 12% (936/7697) Checking out files: 13% (1001/7697) Checking out files: 14% (1078/7697) Checking out files: 14% (1134/7697) Checking out files: 15% (1155/7697) Checking out files: 15% (1189/7697) Checking out files: 16% (1232/7697) Checking out files: 16% (1235/7697) Checking out files: 16% (1304/7697) Checking out files: 17% (1309/7697) Checking out files: 17% (1332/7697) Checking out files: 17% (1383/7697) Checking out files: 18% (1386/7697) Checking out files: 18% (1405/7697) Checking out files: 18% (1462/7697) Checking out files: 19% (1463/7697) Checking out files: 19% (1482/7697) Checking out files: 19% (1518/7697) Checking out files: 20% (1540/7697) Checking out files: 20% (1587/7697) Checking out files: 21% (1617/7697) Checking out files: 21% (1646/7697) Checking out files: 21% (1673/7697) Checking out files: 22% (1694/7697) Checking out files: 22% (1727/7697) Checking out files: 23% (1771/7697) Checking out files: 23% (1782/7697) Checking out files: 24% (1848/7697) Checking out files: 24% (1856/7697) Checking out files: 24% (1886/7697) Checking out files: 24% (1920/7697) Checking out files: 25% (1925/7697) Checking out files: 25% (1937/7697) Checking out files: 25% (1974/7697) Checking out files: 26% (2002/7697) Checking out files: 26% (2003/7697) Checking out files: 27% (2079/7697) Checking out files: 28% (2156/7697) Checking out files: 29% (2233/7697) Checking out files: 29% (2234/7697) Checking out files: 30% (2310/7697) Checking out files: 31% (2387/7697) Checking out files: 31% (2412/7697) Checking out files: 32% (2464/7697) Checking out files: 33% (2541/7697) Checking out files: 33% (2576/7697) Checking out files: 34% (2617/7697) Checking out files: 34% (2634/7697) Checking out files: 34% (2669/7697) Checking out files: 35% (2694/7697) Checking out files: 36% (2771/7697) Checking out files: 36% (2812/7697) Checking out files: 36% (2844/7697) Checking out files: 37% (2848/7697) Checking out files: 37% (2867/7697) Checking out files: 37% (2901/7697) Checking out files: 38% (2925/7697) Checking out files: 38% (2969/7697) Checking out files: 39% (3002/7697) Checking out files: 39% (3011/7697) Checking out files: 39% (3028/7697) Checking out files: 39% (3053/7697) Checking out files: 39% (3059/7697) Checking out files: 40% (3079/7697) Checking out files: 40% (3084/7697) Checking out files: 40% (3130/7697) Checking out files: 41% (3156/7697) Checking out files: 41% (3165/7697) Checking out files: 41% (3176/7697) Checking out files: 41% (3196/7697) Checking out files: 41% (3208/7697) Checking out files: 41% (3211/7697) Checking out files: 42% (3233/7697) Checking out files: 42% (3241/7697) Checking out files: 42% (3290/7697) Checking out files: 42% (3301/7697) Checking out files: 43% (3310/7697) Checking out files: 43% (3380/7697) Checking out files: 44% (3387/7697) Checking out files: 45% (3464/7697) Checking out files: 45% (3531/7697) Checking out files: 46% (3541/7697) Checking out files: 46% (3567/7697) Checking out files: 47% (3618/7697) Checking out files: 47% (3656/7697) Checking out files: 48% (3695/7697) Checking out files: 48% (3725/7697) Checking out files: 49% (3772/7697) Checking out files: 49% (3846/7697) Checking out files: 50% (3849/7697) Checking out files: 51% (3926/7697) Checking out files: 51% (3948/7697) Checking out files: 52% (4003/7697) Checking out files: 52% (4058/7697) Checking out files: 53% (4080/7697) Checking out files: 53% (4146/7697) Checking out files: 54% (4157/7697) Checking out files: 54% (4227/7697) Checking out files: 55% (4234/7697) Checking out files: 55% (4264/7697) Checking out files: 56% (4311/7697) Checking out files: 56% (4320/7697) Checking out files: 57% (4388/7697) Checking out files: 57% (4406/7697) Checking out files: 58% (4465/7697) Checking out files: 58% (4523/7697) Checking out files: 59% (4542/7697) Checking out files: 60% (4619/7697) Checking out files: 60% (4667/7697) Checking out files: 61% (4696/7697) Checking out files: 61% (4764/7697) Checking out files: 62% (4773/7697) Checking out files: 63% (4850/7697) Checking out files: 63% (4888/7697) Checking out files: 64% (4927/7697) Checking out files: 65% (5004/7697) Checking out files: 65% (5011/7697) Checking out files: 66% (5081/7697) Checking out files: 67% (5157/7697) Checking out files: 67% (5163/7697) Checking out files: 68% (5234/7697) Checking out files: 68% (5239/7697) Checking out files: 68% (5288/7697) Checking out files: 69% (5311/7697) Checking out files: 69% (5358/7697) Checking out files: 70% (5388/7697) Checking out files: 70% (5428/7697) Checking out files: 70% (5464/7697) Checking out files: 71% (5465/7697) Checking out files: 71% (5516/7697) Checking out files: 72% (5542/7697) Checking out files: 72% (5609/7697) Checking out files: 73% (5619/7697) Checking out files: 73% (5660/7697) Checking out files: 74% (5696/7697) Checking out files: 74% (5701/7697) Checking out files: 75% (5773/7697) Checking out files: 75% (5812/7697) Checking out files: 76% (5850/7697) Checking out files: 76% (5870/7697) Checking out files: 77% (5927/7697) Checking out files: 77% (5929/7697) Checking out files: 77% (5991/7697) Checking out files: 78% (6004/7697) Checking out files: 78% (6074/7697) Checking out files: 79% (6081/7697) Checking out files: 79% (6125/7697) Checking out files: 80% (6158/7697) Checking out files: 80% (6180/7697) Checking out files: 80% (6210/7697) Checking out files: 81% (6235/7697) Checking out files: 81% (6255/7697) Checking out files: 82% (6312/7697) Checking out files: 82% (6343/7697) Checking out files: 82% (6377/7697) Checking out files: 83% (6389/7697) Checking out files: 83% (6454/7697) Checking out files: 84% (6466/7697) Checking out files: 84% (6527/7697) Checking out files: 85% (6543/7697) Checking out files: 85% (6563/7697) Checking out files: 86% (6620/7697) Checking out files: 86% (6624/7697) Checking out files: 86% (6688/7697) Checking out files: 87% (6697/7697) Checking out files: 87% (6767/7697) Checking out files: 88% (6774/7697) Checking out files: 88% (6822/7697) Checking out files: 89% (6851/7697) Checking out files: 90% (6928/7697) Checking out files: 90% (6950/7697) Checking out files: 91% (7005/7697) Checking out files: 91% (7061/7697) Checking out files: 92% (7082/7697) Checking out files: 93% (7159/7697) Checking out files: 93% (7168/7697) Checking out files: 94% (7236/7697) Checking out files: 94% (7266/7697) Checking out files: 95% (7313/7697) Checking out files: 95% (7347/7697) Checking out files: 96% (7390/7697) Checking out files: 97% (7467/7697) Checking out files: 97% (7505/7697) Checking out files: 98% (7544/7697) Checking out files: 98% (7579/7697) Checking out files: 99% (7621/7697) Checking out files: 100% (7697/7697) Checking out files: 100% (7697/7697), done.
$ cp /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/config/*.yaml spack/etc/spack
$ SPACK_ROOT=${PWD}/spack
$ echo "SPACK_ROOT=${SPACK_ROOT}" >> spack_clone_variables.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ spack config --scope site add "config:ccache:true"
$ spack config get config
config:
install_tree:
projections:
all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
root: $spack/opt/spack
build_jobs: 36
ccache: true
template_dirs:
- $spack/share/spack/templates
# Locations where different types of modules should be installed.
module_roots:
tcl: $spack/share/spack/modules
lmod: $spack/share/spack/lmod
build_stage:
- $tempdir/$user/spack-stage
- ~/.spack/stage
# - $spack/var/spack/stage
# Directory in which to run tests and store test results.
# Tests will be stored in directories named by date/time and package
# name/hash.
test_stage: ~/.spack/test
source_cache: $spack/var/spack/cache
misc_cache: ~/.spack/cache
connect_timeout: 10
verify_ssl: true
suppress_gpg_warnings: false
install_missing_compilers: false
checksum: true
dirty: false
build_language: C
locks: true
concretizer: original
db_lock_timeout: 300
package_lock_timeout:
shared_linking: rpath
allow_sgid: true
debug: false
$ echo "SPACK_USE_CCACHE=true" >> spack_clone_variables.env
$ if [[ "${CI_PIPELINE_SOURCE}" == "pipeline" ]]; then
section_end:1640104975:step_script section_start:1640104975:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=18690 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=113204 responseStatus=201 Created token=tiEN87np
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=18712 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=113204 responseStatus=201 Created token=tiEN87np
section_end:1640104977:upload_artifacts_on_success section_start:1640104977:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640104978:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640106447:resolve_secrets Resolving secrets
section_end:1640106447:resolve_secrets section_start:1640106447:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor121360561, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113214
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113214
A slurm job will be created with name GL_J113214_PROD_P112_CP7_C5
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 142126
job state: R
section_end:1640106449:prepare_executor section_start:1640106449:prepare_script Preparing environment
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640106449:prepare_script section_start:1640106449:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640106450:get_sources section_start:1640106450:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (113210)...
Runtime platform  arch=amd64 os=linux pid=19740 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113210 responseStatus=200 OK token=EsNxt9Y_
section_end:1640106451:download_artifacts section_start:1640106451:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n19
Build name: Linux-nvc++
Create new tag: 20211221-1708 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113210/_/spack-build/spack-stage-coreneuron-develop-7r3a4d2rmvk5oeb6vt52s4zg2hppmnjp/spack-build-7r3a4d2
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #1: cmd_interface_test ..................... Passed 2.17 sec
Start 7: ring_binqueue_TEST
2/18 Test #3: alignment_test ......................... Passed 2.78 sec
3/18 Test #4: queuing_test ........................... Passed 3.45 sec
Start 8: ring_multisend_TEST
4/18 Test #2: interleave_info_constructor_test ....... Passed 3.51 sec
5/18 Test #5: lfp_test ............................... Passed 3.57 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #9: ring_spike_buffer_TEST ................. Passed 29.26 sec
Start 10: ring_permute1_TEST
7/18 Test #6: ring_TEST .............................. Passed 37.79 sec
Start 11: ring_permute2_TEST
8/18 Test #7: ring_binqueue_TEST ..................... Passed 36.14 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 35.05 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #10: ring_permute1_TEST ..................... Passed 16.51 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 14.54 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST .......................... Passed 1224.03 sec
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST ................. Passed 1409.26 sec
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 62.44 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #14: ring_gap_multisend_TEST ................ Passed 1476.12 sec
16/18 Test #15: ring_gap_permute1_TEST ................. Passed 1473.55 sec
17/18 Test #16: ring_gap_permute2_TEST ................. Passed 263.60 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 18.50 sec
100% tests passed, 0 tests failed out of 18
Total Test time (real) = 1528.75 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640108023:step_script section_start:1640108023:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=29377 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=113214 responseStatus=201 Created token=RHPszFke
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=29410 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=113214 responseStatus=201 Created token=RHPszFke
section_end:1640108024:upload_artifacts_on_success section_start:1640108024:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640108024:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640106216:resolve_secrets Resolving secrets
section_end:1640106216:resolve_secrets section_start:1640106216:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor394568737, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113212
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113212
A slurm job will be created with name GL_J113212_PROD_P112_CP1_C3
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142122
job state: R
section_end:1640106218:prepare_executor section_start:1640106218:prepare_script Preparing environment
Running on r1i6n19 via bbpv1.epfl.ch...
section_end:1640106220:prepare_script section_start:1640106220:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640106221:get_sources section_start:1640106221:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (113208)...
Runtime platform  arch=amd64 os=linux pid=49310 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113208 responseStatus=200 OK token=AZ6vgB2S
section_end:1640106222:download_artifacts section_start:1640106222:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n19
Build name: Linux-icpc
Create new tag: 20211221-1706 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113208/_/spack-build/spack-stage-coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh/spack-build-aevgkbd
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #2: interleave_info_constructor_test ... Passed 2.92 sec
2/17 Test #4: queuing_test ....................... Passed 3.21 sec
Start 7: ring_binqueue_TEST
3/17 Test #1: cmd_interface_test ................. Passed 3.82 sec
4/17 Test #3: alignment_test ..................... Passed 3.81 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 4.14 sec
6/17 Test #17: reporting_1 ........................ Passed 6.21 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 6.46 sec
Start 10: ring_permute1_TEST
8/17 Test #8: ring_multisend_TEST ................ Passed 8.28 sec
Start 11: ring_permute2_TEST
9/17 Test #7: ring_binqueue_TEST ................. Passed 8.87 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 6.77 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 6.96 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 25.85 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #13: ring_gap_binqueue_TEST ............. Passed 1197.04 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #12: ring_gap_TEST ...................... Passed 1251.78 sec
15/17 Test #15: ring_gap_permute1_TEST ............. Passed 1234.31 sec
16/17 Test #14: ring_gap_multisend_TEST ............ Passed 1260.68 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 63.99 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 1274.36 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640107648:step_script section_start:1640107648:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=80821 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=113212 responseStatus=201 Created token=qGq3pV-A
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=80856 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=113212 responseStatus=201 Created token=qGq3pV-A
section_end:1640107649:upload_artifacts_on_success section_start:1640107649:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640107650:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640109343:resolve_secrets Resolving secrets
section_end:1640109343:resolve_secrets section_start:1640109343:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor836008903, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113213
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113213
A slurm job will be created with name GL_J113213_PROD_P112_CP2_C6
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 142212
job state: R
section_end:1640109344:prepare_executor section_start:1640109344:prepare_script Preparing environment
Running on ldir01u13.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640109345:prepare_script section_start:1640109345:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640109345:get_sources section_start:1640109345:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (113209)...
Runtime platform  arch=amd64 os=linux pid=35225 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113209 responseStatus=200 OK token=menUS1ag
section_end:1640109346:download_artifacts section_start:1640109346:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n19
Build name: Linux-nvc++
Create new tag: 20211221-1756 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-build-qnf2dk3
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #3: alignment_test ......................... Passed 1.64 sec
Start 7: ring_binqueue_TEST
2/18 Test #1: cmd_interface_test ..................... Passed 2.63 sec
3/18 Test #2: interleave_info_constructor_test ....... Passed 3.28 sec
Start 8: ring_multisend_TEST
4/18 Test #4: queuing_test ........................... Passed 3.29 sec
5/18 Test #5: lfp_test ............................... Passed 3.93 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #7: ring_binqueue_TEST ..................... Passed 41.69 sec
Start 10: ring_permute1_TEST
7/18 Test #9: ring_spike_buffer_TEST ................. Passed 40.94 sec
Start 11: ring_permute2_TEST
8/18 Test #6: ring_TEST .............................. Passed 45.03 sec
Start 12: ring_gap_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 41.90 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #11: ring_permute2_TEST ..................... Passed 44.98 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #10: ring_permute1_TEST ..................... Passed 48.62 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST ..........................***Timeout 1500.06 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 7295f4a6 (2021-12-21 14:06:59 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 217.0273, Min 216.6016, Avg 216.8379
GPU Memory (MBs) : Used = 1571.500000, Free = 30939.000000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 217.0391, Min 216.7852, Avg 217.0005
GPU Memory (MBs) : Used = 1573.500000, Free = 30937.000000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 217.2422, Min 217.1094, Avg 217.1260
GPU Memory (MBs) : Used = 1573.500000, Free = 30937.000000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.62 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 217.2617, Min 217.1289, Avg 217.1455
GPU Memory (MBs) : Used = 2083.500000, Free = 30427.000000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-build-qnf2dk3/tests/integration/ring_gap
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 217.4453, Min 217.1289, Avg 217.1914
GPU Memory (MBs) : Used = 2083.500000, Free = 30427.000000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 281.8008, Min 217.2969, Avg 233.4072
GPU Memory (MBs) : Used = 2595.500000, Free = 29915.000000, Total = 32510.500000
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST .................***Timeout 1500.08 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 7295f4a6 (2021-12-21 14:06:59 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 217.0273, Min 216.6016, Avg 216.8379
GPU Memory (MBs) : Used = 2593.500000, Free = 29917.000000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 217.0391, Min 216.7852, Avg 217.0005
GPU Memory (MBs) : Used = 2595.500000, Free = 29915.000000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 217.2383, Min 217.1055, Avg 217.1221
GPU Memory (MBs) : Used = 2595.500000, Free = 29915.000000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.62 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 217.2578, Min 217.1250, Avg 217.1416
GPU Memory (MBs) : Used = 2597.500000, Free = 29913.000000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=true
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-build-qnf2dk3/tests/integration/ring_gap_binqueue
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 217.4453, Min 217.1250, Avg 217.1880
GPU Memory (MBs) : Used = 2597.500000, Free = 29913.000000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 281.7969, Min 217.2930, Avg 233.4033
GPU Memory (MBs) : Used = 2599.500000, Free = 29911.000000, Total = 32510.500000
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................***Timeout 1500.04 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 7295f4a6 (2021-12-21 14:06:59 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 217.0273, Min 216.6016, Avg 216.8374
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 217.0352, Min 216.7852, Avg 217.0000
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 217.2383, Min 217.1055, Avg 217.1221
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 2.79 seconds
Model size : 93.34 kB
Memory (MBs) : After nrn_setup : Max 217.4336, Min 217.1250, Avg 217.1855
GPU Memory (MBs) : Used = 2589.500000, Free = 29921.000000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=true
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-build-qnf2dk3/tests/integration/ring_gap_multisend
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 217.4336, Min 217.1250, Avg 217.1855
GPU Memory (MBs) : Used = 2589.500000, Free = 29921.000000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 281.9922, Min 217.2891, Avg 233.4238
GPU Memory (MBs) : Used = 2591.500000, Free = 29919.000000, Total = 32510.500000
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST .................***Timeout 1500.05 sec
num_mpi=8
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 7295f4a6 (2021-12-21 14:06:59 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 217.0273, Min 216.6016, Avg 216.8379
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
Memory (MBs) : After MPI_Init : Max 217.0391, Min 216.7852, Avg 217.0005
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
Memory (MBs) : Before nrn_setup : Max 217.2383, Min 217.1055, Avg 217.1221
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.41 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 217.2578, Min 217.1250, Avg 217.1416
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=0
--cell-permute=1
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113209/_/spack-build/spack-stage-coreneuron-develop-qnf2dk3mbbkroyf5ykaxhu5ihwd75gxo/spack-build-qnf2dk3/tests/integration/ring_gap_permute1
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 217.4453, Min 217.1250, Avg 217.1880
GPU Memory (MBs) : Used = 2587.500000, Free = 29923.000000, Total = 32510.500000
Memory (MBs) : After nrn_finitialize : Max 281.7969, Min 217.2930, Avg 233.4033
GPU Memory (MBs) : Used = 2589.500000, Free = 29921.000000, Total = 32510.500000
16/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 88.04 sec
17/18 Test #16: ring_gap_permute2_TEST ................. Passed 88.82 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 46.85 sec
78% tests passed, 4 tests failed out of 18
Total Test time (real) = 1636.78 sec
The following tests FAILED:
12 - ring_gap_TEST (Timeout)
13 - ring_gap_binqueue_TEST (Timeout)
14 - ring_gap_multisend_TEST (Timeout)
15 - ring_gap_permute1_TEST (Timeout)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: ldir01u13: task 0: Exited with exit code 1
section_end:1640111017:step_script section_start:1640111017:upload_artifacts_on_failure Uploading artifacts for failed job
srun: Job 142212 step creation temporarily disabled, retrying (Requested nodes are busy)
srun: Job 142212 step creation still disabled, retrying (Requested nodes are busy)
srun: Step created for job 142212
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=41289 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=113213 responseStatus=201 Created token=urWr_qdH
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=41323 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=113213 responseStatus=201 Created token=urWr_qdH
section_end:1640111020:upload_artifacts_on_failure section_start:1640111020:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640111020:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640108278:resolve_secrets Resolving secrets
section_end:1640108278:resolve_secrets section_start:1640108278:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor686363456, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113211
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113211
A slurm job will be created with name GL_J113211_PROD_P112_CP0_C0
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142184
job state: R
section_end:1640108279:prepare_executor section_start:1640108279:prepare_script Preparing environment
Running on r1i6n18 via bbpv1.epfl.ch...
section_end:1640108281:prepare_script section_start:1640108281:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640108282:get_sources section_start:1640108282:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (113207)...
Runtime platform  arch=amd64 os=linux pid=205549 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113207 responseStatus=200 OK token=bhErH5v-
section_end:1640108284:download_artifacts section_start:1640108284:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n19
Build name: Linux-icpc
Create new tag: 20211221-1744 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113207/_/spack-build/spack-stage-coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3/spack-build-cwjs4t3
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #3: alignment_test ..................... Passed 4.07 sec
2/17 Test #1: cmd_interface_test ................. Passed 4.39 sec
Start 7: ring_binqueue_TEST
3/17 Test #2: interleave_info_constructor_test ... Passed 4.59 sec
4/17 Test #4: queuing_test ....................... Passed 4.71 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 5.22 sec
6/17 Test #17: reporting_1 ........................ Passed 12.65 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 13.04 sec
Start 10: ring_permute1_TEST
8/17 Test #7: ring_binqueue_TEST ................. Passed 10.43 sec
Start 11: ring_permute2_TEST
9/17 Test #8: ring_multisend_TEST ................ Passed 10.30 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 14.27 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 14.69 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 13.38 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #12: ring_gap_TEST ...................... Passed 13.10 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 23.19 sec
15/17 Test #15: ring_gap_permute1_TEST ............. Passed 508.27 sec
16/17 Test #14: ring_gap_multisend_TEST ............ Passed 512.47 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 512.35 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 540.99 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640109234:step_script section_start:1640109234:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=228058 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=113211 responseStatus=201 Created token=Gaa6EccM
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=228101 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=113211 responseStatus=201 Created token=Gaa6EccM
section_end:1640109235:upload_artifacts_on_success section_start:1640109235:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640109237:cleanup_file_variables Job succeeded
Log was not fetched because job had status: skipped
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640109274:resolve_secrets Resolving secrets
section_end:1640109274:resolve_secrets section_start:1640109274:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor965137424, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30188, build ref 7295f4a667503ec4677262632bb0636f48812336, job ID 113220
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30188/J113220
A slurm job will be created with name GL_J113220_PROD_P112_CP0_C4
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 142209
job state: R
section_end:1640109275:prepare_executor section_start:1640109275:prepare_script Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1640109278:prepare_script section_start:1640109278:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640109279:get_sources section_start:1640109279:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:intel (113216)...
Runtime platform  arch=amd64 os=linux pid=211843 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=113216 responseStatus=200 OK token=mpbqzuzd
section_end:1640109280:download_artifacts section_start:1640109280:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n22
Build name: Linux-icpc
Create new tag: 20211221-1755 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30188/J113216/_/spack-build/spack-stage-neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm/spack-build-mvn7s3z
Start 33: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 46: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 52: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
Start 68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
Start 74: testcorenrn_watch::coreneuron_cpu_offline::preparation
1/103 Test #46: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.44 sec
Start 80: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/103 Test #40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.49 sec
Start 86: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/103 Test #56: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 3.46 sec
Start 29: external_ringtest::neuron
Start 36: testcorenrn_bbcore::neuron
4/103 Test #52: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 7.09 sec
Start 30: external_ringtest::neuron_mpi
5/103 Test #62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 7.36 sec
Start 31: external_ringtest::coreneuron_cpu_mpi
6/103 Test #33: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 7.80 sec
Start 32: external_ringtest::coreneuron_cpu_mpi_offline
7/103 Test #74: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 7.86 sec
Start 37: testcorenrn_bbcore::coreneuron_cpu_online
Start 38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
8/103 Test #80: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 5.67 sec
Start 39: testcorenrn_bbcore::coreneuron_cpu_offline
9/103 Test #68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 8.22 sec
Start 100: olfactory-bulb-3d::neuron::preparation
10/103 Test #86: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 5.81 sec
Start 42: testcorenrn_deriv::neuron
11/103 Test #36: testcorenrn_bbcore::neuron ......................................... Passed 4.78 sec
Start 43: testcorenrn_deriv::coreneuron_cpu_online
12/103 Test #100: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.79 sec
Start 102: olfactory-bulb-3d::coreneuron_cpu_online::preparation
13/103 Test #29: external_ringtest::neuron .......................................... Passed 5.66 sec
Start 44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
14/103 Test #102: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 1.41 sec
Start 26: reduced_dentate::neuron
15/103 Test #32: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 4.71 sec
Start 45: testcorenrn_deriv::coreneuron_cpu_offline
Start 76: testcorenrn_conc::neuron
16/103 Test #30: external_ringtest::neuron_mpi ...................................... Passed 5.48 sec
Start 48: testcorenrn_gf::neuron
17/103 Test #39: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 5.64 sec
Start 77: testcorenrn_conc::coreneuron_cpu_online
18/103 Test #45: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 4.09 sec
Start 78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
19/103 Test #31: external_ringtest::coreneuron_cpu_mpi .............................. Passed 10.25 sec
Start 49: testcorenrn_gf::coreneuron_cpu_online
20/103 Test #42: testcorenrn_deriv::neuron .......................................... Passed 9.35 sec
Start 79: testcorenrn_conc::coreneuron_cpu_offline
21/103 Test #76: testcorenrn_conc::neuron ........................................... Passed 7.17 sec
Start 82: testcorenrn_kin::neuron
22/103 Test #43: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 11.42 sec
Start 83: testcorenrn_kin::coreneuron_cpu_online
23/103 Test #37: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 11.95 sec
Start 84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
24/103 Test #79: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 2.23 sec
Start 85: testcorenrn_kin::coreneuron_cpu_offline
25/103 Test #77: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 7.88 sec
Start 91: channel_benchmark_hippo::neuron
26/103 Test #38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 14.02 sec
Start 92: channel_benchmark_hippo::coreneuron_cpu_online
27/103 Test #44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 12.69 sec
Start 93: channel_benchmark_hippo::coreneuron_cpu_filemode
28/103 Test #85: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 2.57 sec
Start 95: channel_benchmark_sscx::neuron
29/103 Test #82: testcorenrn_kin::neuron ............................................ Passed 2.89 sec
Start 96: channel_benchmark_sscx::coreneuron_cpu_online
30/103 Test #78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 8.25 sec
Start 97: channel_benchmark_sscx::coreneuron_cpu_filemode
31/103 Test #84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 6.33 sec
Start 1: testneuron
32/103 Test #1: testneuron ......................................................... Passed 0.11 sec
Start 2: ringtest
33/103 Test #2: ringtest ........................................................... Passed 0.33 sec
Start 3: connect_dend
34/103 Test #3: connect_dend ....................................................... Passed 31.01 sec
Start 4: pynrn_tests::basic_tests
35/103 Test #49: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 40.68 sec
Start 50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
36/103 Test #83: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 48.54 sec
Start 5: rxdmod_tests::rxd_tests
37/103 Test #26: reduced_dentate::neuron ............................................ Passed 115.03 sec
Start 27: reduced_dentate::coreneuron_cpu
38/103 Test #50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 70.92 sec
Start 51: testcorenrn_gf::coreneuron_cpu_offline
39/103 Test #95: channel_benchmark_sscx::neuron ..................................... Passed 110.98 sec
Start 6: rxdmod_tests::rxd_mpi_tests
40/103 Test #92: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 118.31 sec
Start 7: parallel_tests
41/103 Test #51: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 20.39 sec
Start 54: testcorenrn_patstim::neuron
42/103 Test #4: pynrn_tests::basic_tests ........................................... Passed 92.84 sec
Start 8: parallel_partrans
43/103 Test #48: testcorenrn_gf::neuron ............................................. Passed 140.26 sec
Start 55: testcorenrn_patstim::coreneuron_cpu_offline
44/103 Test #55: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 5.39 sec
Start 58: testcorenrn_vecplay::neuron
45/103 Test #8: parallel_partrans .................................................. Passed 8.14 sec
Start 9: parallel_bas
46/103 Test #54: testcorenrn_patstim::neuron ........................................ Passed 12.94 sec
Start 59: testcorenrn_vecplay::coreneuron_cpu_online
47/103 Test #58: testcorenrn_vecplay::neuron ........................................ Passed 4.37 sec
Start 60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
48/103 Test #7: parallel_tests ..................................................... Passed 25.26 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
49/103 Test #59: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 9.31 sec
Start 61: testcorenrn_vecplay::coreneuron_cpu_offline
50/103 Test #61: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 5.25 sec
Start 70: testcorenrn_watch::neuron
51/103 Test #70: testcorenrn_watch::neuron .......................................... Passed 5.15 sec
Start 71: testcorenrn_watch::coreneuron_cpu_online
52/103 Test #91: channel_benchmark_hippo::neuron .................................... Passed 164.27 sec
Start 11: coreneuron_modtests::direct_py_cpu
53/103 Test #71: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 9.91 sec
Start 72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
54/103 Test #60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 30.09 sec
Start 73: testcorenrn_watch::coreneuron_cpu_offline
55/103 Test #9: parallel_bas ....................................................... Passed 34.20 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
56/103 Test #73: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 3.09 sec
Start 88: testcorenrn_netstimdirect::direct_netstimdirect
57/103 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 33.22 sec
Start 13: coreneuron_modtests::spikes_py_cpu
58/103 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 10.63 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
59/103 Test #88: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 8.49 sec
Start 89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
60/103 Test #72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 16.39 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
Start 16: coreneuron_modtests::datareturn_py_cpu
61/103 Test #96: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 188.22 sec
Start 17: coreneuron_modtests::test_units_py_cpu
62/103 Test #93: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 193.99 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
63/103 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 31.81 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
64/103 Test #97: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 194.93 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
65/103 Test #89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 16.11 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
Start 25: external_nrntest
66/103 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 23.09 sec
Start 41: testcorenrn_bbcore::compare_results
67/103 Test #41: testcorenrn_bbcore::compare_results ................................ Passed 0.80 sec
Start 47: testcorenrn_deriv::compare_results
68/103 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 22.36 sec
Start 53: testcorenrn_gf::compare_results
69/103 Test #47: testcorenrn_deriv::compare_results ................................. Passed 3.13 sec
Start 57: testcorenrn_patstim::compare_results
70/103 Test #27: reduced_dentate::coreneuron_cpu .................................... Passed 101.53 sec
Start 64: testcorenrn_vecevent::neuron
71/103 Test #57: testcorenrn_patstim::compare_results ............................... Passed 1.62 sec
Start 28: reduced_dentate::compare_results
72/103 Test #53: testcorenrn_gf::compare_results .................................... Passed 2.30 sec
Start 63: testcorenrn_vecplay::compare_results
73/103 Test #28: reduced_dentate::compare_results ................................... Passed 1.33 sec
Start 75: testcorenrn_watch::compare_results
74/103 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 20.32 sec
Start 81: testcorenrn_conc::compare_results
75/103 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 20.33 sec
Start 87: testcorenrn_kin::compare_results
76/103 Test #63: testcorenrn_vecplay::compare_results ............................... Passed 1.64 sec
Start 90: testcorenrn_netstimdirect::compare_results
77/103 Test #75: testcorenrn_watch::compare_results ................................. Passed 1.69 sec
Start 94: channel_benchmark_hippo::compare_results
78/103 Test #87: testcorenrn_kin::compare_results ................................... Passed 1.78 sec
Start 98: channel_benchmark_sscx::compare_results
79/103 Test #90: testcorenrn_netstimdirect::compare_results ......................... Passed 1.15 sec
80/103 Test #81: testcorenrn_conc::compare_results .................................. Passed 2.06 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
81/103 Test #94: channel_benchmark_hippo::compare_results ........................... Passed 1.29 sec
82/103 Test #98: channel_benchmark_sscx::compare_results ............................ Passed 1.40 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
83/103 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 21.83 sec
84/103 Test #64: testcorenrn_vecevent::neuron ....................................... Passed 9.71 sec
Start 65: testcorenrn_vecevent::coreneuron_cpu_online
85/103 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 28.56 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
86/103 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 14.83 sec
87/103 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 13.90 sec
Start 66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
88/103 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 29.22 sec
89/103 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 27.69 sec
90/103 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 27.19 sec
91/103 Test #65: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 15.71 sec
Start 34: external_ringtest::coreneuron_cpu_mpi_threads
92/103 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 11.24 sec
93/103 Test #66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 12.57 sec
Start 67: testcorenrn_vecevent::coreneuron_cpu_offline
94/103 Test #34: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 8.08 sec
Start 99: olfactory-bulb-3d::neuron
Start 101: olfactory-bulb-3d::coreneuron_cpu_online
Start 35: external_ringtest::compare_results
95/103 Test #35: external_ringtest::compare_results ................................. Passed 0.15 sec
96/103 Test #67: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 2.27 sec
Start 69: testcorenrn_vecevent::compare_results
97/103 Test #69: testcorenrn_vecevent::compare_results .............................. Passed 0.08 sec
98/103 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 197.43 sec
99/103 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 274.35 sec
100/103 Test #25: external_nrntest ................................................... Passed 212.92 sec
101/103 Test #101: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 175.33 sec
102/103 Test #99: olfactory-bulb-3d::neuron .......................................... Passed 176.87 sec
Start 103: olfactory-bulb-3d::compare_results
103/103 Test #103: olfactory-bulb-3d::compare_results ................................. Passed 0.20 sec
100% tests passed, 0 tests failed out of 103
Total Test time (real) = 437.76 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640109764:step_script section_start:1640109764:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=222096 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=113220 responseStatus=201 Created token=TrmAHtt8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=222148 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=113220 responseStatus=201 Created token=TrmAHtt8
section_end:1640109765:upload_artifacts_on_success section_start:1640109765:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640109766:cleanup_file_variables Job succeeded
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment