Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created December 23, 2021 12:53
Show Gist options
  • Save bbpbuildbot/da9d1197d97f7cd4480f7b80ae46fdeb to your computer and use it in GitHub Desktop.
Save bbpbuildbot/da9d1197d97f7cd4480f7b80ae46fdeb to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/30395 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#699.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640257411:resolve_secrets Resolving secrets
section_end:1640257411:resolve_secrets section_start:1640257411:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor366080483, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114824
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114824_PROD_P112_CP9_C16
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144780
job state: PD
job state: PD
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114824_PROD_P112_CP9_C16 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824 --ntasks=1 --jobid=144780 --cpus-per-task=6 --mem=30750M
section_end:1640257414:prepare_executor section_start:1640257414:prepare_script Preparing environment
Running on r1i7n20 via bbpv1.epfl.ch...
section_end:1640257416:prepare_script section_start:1640257416:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640257417:get_sources section_start:1640257417:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=54366 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640257427:restore_cache section_start:1640257427:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (114810)...
Runtime platform  arch=amd64 os=linux pid=55752 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114810 responseStatus=200 OK token=QkA_LJss
section_end:1640257428:download_artifacts section_start:1640257428:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114824/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114824/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114824/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114824/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114824/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..5bfbd2e 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+gpu+openmp+tests~legacy-unit~report build_type=RelWithDebInfo
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be d4mbc44tzlxvfyp7iy3jomhrptr7oxvo
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:04:36 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.41 / 0.51 (79.15 %)
Files: 9813
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'd4mbc44tzlxvfyp7iy3jomhrptr7oxvo'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+openmp~report+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- d4mbc44 coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
==> Installing coreneuron-develop-d4mbc44tzlxvfyp7iy3jomhrptr7oxvo
==> No binary for coreneuron-develop-d4mbc44tzlxvfyp7iy3jomhrptr7oxvo found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-d4mbc4
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114824/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:09:36 2021
Hits: 115 / 118 (97.46 %)
Direct: 99 / 118 (83.90 %)
Preprocessed: 16 / 19 (84.21 %)
Misses: 3
Direct: 19
Preprocessed: 3
Uncacheable: 19
Primary storage:
Hits: 229 / 236 (97.03 %)
Misses: 7
Cache size (GB): 0.41 / 0.51 (79.22 %)
Files: 9819
Uncacheable:
Called for linking: 16
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640257778:step_script section_start:1640257778:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=70299 revision=58ba2b95 version=14.2.0
ccache/: found 10380 matching files and directories
Archive is up to date! 
Created cache
section_end:1640257779:archive_cache section_start:1640257779:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=70495 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114824 responseStatus=201 Created token=y5jsK9as
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=70520 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114824 responseStatus=201 Created token=y5jsK9as
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=70552 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114824 responseStatus=201 Created token=y5jsK9as
section_end:1640257781:upload_artifacts_on_success section_start:1640257781:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640257781:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640257410:resolve_secrets Resolving secrets
section_end:1640257410:resolve_secrets section_start:1640257410:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor874414793, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114818
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114818_PROD_P112_CP8_C15
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144779
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114818_PROD_P112_CP8_C15 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818 --ntasks=1 --jobid=144779 --cpus-per-task=6 --mem=30750M
section_end:1640257412:prepare_executor section_start:1640257412:prepare_script Preparing environment
Running on r1i7n20 via bbpv1.epfl.ch...
section_end:1640257413:prepare_script section_start:1640257413:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640257414:get_sources section_start:1640257414:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=54169 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640257423:restore_cache section_start:1640257423:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (114810)...
Runtime platform  arch=amd64 os=linux pid=54588 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114810 responseStatus=200 OK token=QkA_LJss
section_end:1640257423:download_artifacts section_start:1640257423:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114818/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114818/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114818/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114818/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114818/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..5bfbd2e 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:04:36 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.38 / 0.51 (73.76 %)
Files: 7916
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'aevgkbdozl3htdtjhrd5w65n3c6mb2jh'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- aevgkbd coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
==> Installing coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh
==> No binary for coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh found: installing from source
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114818/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:06:32 2021
Hits: 108 / 117 (92.31 %)
Direct: 92 / 118 (77.97 %)
Preprocessed: 16 / 26 (61.54 %)
Misses: 9
Direct: 26
Preprocessed: 10
Uncacheable: 20
Primary storage:
Hits: 215 / 236 (91.10 %)
Misses: 21
Cache size (GB): 0.38 / 0.51 (73.78 %)
Files: 7934
Uncacheable:
Called for linking: 16
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640257597:step_script section_start:1640257597:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=64894 revision=58ba2b95 version=14.2.0
ccache/: found 8495 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-6
Created cache
section_end:1640257636:archive_cache section_start:1640257636:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=65871 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114818 responseStatus=201 Created token=8ySxDqEf
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=65896 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114818 responseStatus=201 Created token=8ySxDqEf
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=65920 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114818 responseStatus=201 Created token=8ySxDqEf
section_end:1640257638:upload_artifacts_on_success section_start:1640257638:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640257638:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640258031:resolve_secrets Resolving secrets
section_end:1640258031:resolve_secrets section_start:1640258031:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor078365501, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114820
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114820_PROD_P112_CP7_C14
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144833
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114820_PROD_P112_CP7_C14 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820 --ntasks=1 --jobid=144833 --cpus-per-task=6 --mem=30750M
section_end:1640258032:prepare_executor section_start:1640258032:prepare_script Preparing environment
Running on r1i6n32 via bbpv1.epfl.ch...
section_end:1640258034:prepare_script section_start:1640258034:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640258034:get_sources section_start:1640258034:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=282644 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640258045:restore_cache section_start:1640258045:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:gpu (114814)...
Runtime platform  arch=amd64 os=linux pid=282753 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114814 responseStatus=200 OK token=rPCRLxzx
section_end:1640258046:download_artifacts section_start:1640258046:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..5bfbd2e 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+nmodl+openmp+gpu+tests~legacy-unit~report~sympy build_type=RelWithDebInfo ^/zfakioujxsm45dlnonboqvphrxexao57
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be fzwojn4n4gs3mly2gllogfiwmaydujfg
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:14:48 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.41 / 0.51 (80.66 %)
Files: 9939
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'fzwojn4n4gs3mly2gllogfiwmaydujfg'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+nmodl+openmp~report~sympy+tests build_type=RelWithDebInfo
[+] ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- fzwojn4 coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] zfakiou ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
==> Installing coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg
==> No binary for coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-fzwojn
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114820/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:22:20 2021
Hits: 65 / 96 (67.71 %)
Direct: 1 / 96 (1.04 %)
Preprocessed: 64 / 95 (67.37 %)
Misses: 31
Direct: 95
Preprocessed: 31
Uncacheable: 16
Primary storage:
Hits: 66 / 192 (34.38 %)
Misses: 126
Cache size (GB): 0.42 / 0.51 (82.07 %)
Files: 10064
Uncacheable:
Called for linking: 13
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640258541:step_script section_start:1640258541:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=300053 revision=58ba2b95 version=14.2.0
ccache/: found 10625 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-6
Created cache
section_end:1640258568:archive_cache section_start:1640258568:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=301514 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114820 responseStatus=201 Created token=7NCyeTYf
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=301552 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114820 responseStatus=201 Created token=7NCyeTYf
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=301586 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114820 responseStatus=201 Created token=7NCyeTYf
section_end:1640258571:upload_artifacts_on_success section_start:1640258571:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640258571:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640258628:resolve_secrets Resolving secrets
section_end:1640258628:resolve_secrets section_start:1640258628:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor257415055, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114816
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114816_PROD_P112_CP4_C13
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144932
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114816_PROD_P112_CP4_C13 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816 --ntasks=1 --jobid=144932 --cpus-per-task=6 --mem=30750M
section_end:1640258629:prepare_executor section_start:1640258629:prepare_script Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1640258631:prepare_script section_start:1640258631:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640258632:get_sources section_start:1640258632:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=157984 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640258666:restore_cache section_start:1640258666:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:intel (114812)...
Runtime platform  arch=amd64 os=linux pid=158393 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114812 responseStatus=200 OK token=2xHcBtC1
section_end:1640258667:download_artifacts section_start:1640258667:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114816/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114816/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114816/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114816/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114816/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..5bfbd2e 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+nmodl+tests~legacy-unit build_type=Debug ^/lqyttqytclxdwwickak7uvjmb6a3au3g
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:25:58 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.40 / 0.51 (77.25 %)
Files: 8010
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'cwjs4t3f4wyl5jax3fb2obxbvjopwgn3'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+nmodl+tests build_type=Debug
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- cwjs4t3 coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
==> Installing coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
==> No binary for coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3 found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114816/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:42:20 2021
Hits: 80 / 95 (84.21 %)
Direct: 0 / 96 (0.00 %)
Preprocessed: 80 / 96 (83.33 %)
Misses: 15
Direct: 96
Preprocessed: 16
Uncacheable: 17
Primary storage:
Hits: 80 / 192 (41.67 %)
Misses: 112
Cache size (GB): 0.40 / 0.51 (77.65 %)
Files: 8120
Uncacheable:
Called for linking: 13
Compiler produced no output: 1
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640259751:step_script section_start:1640259751:archive_cache Saving cache for successful job
Creating cache coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=199898 revision=58ba2b95 version=14.2.0
ccache/: found 8681 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-intel-6
Created cache
section_end:1640259820:archive_cache section_start:1640259820:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=201547 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114816 responseStatus=201 Created token=oqzj7qYH
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=201574 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114816 responseStatus=201 Created token=oqzj7qYH
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=201600 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114816 responseStatus=201 Created token=oqzj7qYH
section_end:1640259821:upload_artifacts_on_success section_start:1640259821:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640259822:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640258031:resolve_secrets Resolving secrets
section_end:1640258031:resolve_secrets section_start:1640258031:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor297511031, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114822
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114822_PROD_P112_CP11_C18
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144834
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114822_PROD_P112_CP11_C18 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822 --ntasks=1 --jobid=144834 --cpus-per-task=6 --mem=30750M
section_end:1640258033:prepare_executor section_start:1640258033:prepare_script Preparing environment
Running on r1i6n32 via bbpv1.epfl.ch...
section_end:1640258034:prepare_script section_start:1640258034:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640258035:get_sources section_start:1640258035:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=282685 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640258045:restore_cache section_start:1640258045:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl:gpu (114814)...
Runtime platform  arch=amd64 os=linux pid=282791 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114814 responseStatus=200 OK token=rPCRLxzx
section_end:1640258046:download_artifacts section_start:1640258046:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114822/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114822/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114822/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114822/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114822/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..5bfbd2e 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="0281e0edc6c227d5d57ed963b08a6ecd528ab79f")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+nmodl~openmp+gpu+tests~legacy-unit~report+sympy build_type=RelWithDebInfo ^/zfakioujxsm45dlnonboqvphrxexao57
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be is6uybjw66hpxwgpzajec3egglb7vpaw
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:14:48 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.41 / 0.51 (80.66 %)
Files: 9939
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'is6uybjw66hpxwgpzajec3egglb7vpaw'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+nmodl~openmp~report+sympy+tests build_type=RelWithDebInfo
[+] ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
Concretized
--------------------------------
- is6uybj coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared+sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] zfakiou ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
==> Installing coreneuron-develop-is6uybjw66hpxwgpzajec3egglb7vpaw
==> No binary for coreneuron-develop-is6uybjw66hpxwgpzajec3egglb7vpaw found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-is6uyb
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114822/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:21:08 2021
Hits: 85 / 95 (89.47 %)
Direct: 1 / 95 (1.05 %)
Preprocessed: 84 / 94 (89.36 %)
Misses: 10
Direct: 94
Preprocessed: 10
Uncacheable: 15
Primary storage:
Hits: 86 / 190 (45.26 %)
Misses: 104
Cache size (GB): 0.41 / 0.51 (81.01 %)
Files: 10043
Uncacheable:
Called for linking: 12
No input file: 3
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640258469:step_script section_start:1640258469:archive_cache Saving cache for successful job
Creating cache coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=293870 revision=58ba2b95 version=14.2.0
ccache/: found 10604 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/coreneuron-nvhpc-6
Created cache
section_end:1640258492:archive_cache section_start:1640258492:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=296299 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114822 responseStatus=201 Created token=jjw5XjR4
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=296514 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114822 responseStatus=201 Created token=jjw5XjR4
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=296605 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114822 responseStatus=201 Created token=jjw5XjR4
section_end:1640258494:upload_artifacts_on_success section_start:1640258494:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640258494:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640257787:resolve_secrets Resolving secrets
section_end:1640257787:resolve_secrets section_start:1640257787:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor047186332, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114844
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114844_PROD_P112_CP16_C21
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144794
job state: PD
job state: PD
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114844_PROD_P112_CP16_C21 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844 --ntasks=1 --jobid=144794 --cpus-per-task=6 --mem=30750M
section_end:1640257790:prepare_executor section_start:1640257790:prepare_script Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1640257792:prepare_script section_start:1640257792:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640257792:get_sources section_start:1640257792:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=118470 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640257881:restore_cache section_start:1640257881:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (114824)...
Runtime platform  arch=amd64 os=linux pid=133425 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114824 responseStatus=200 OK token=y5jsK9as
section_end:1640257882:download_artifacts section_start:1640257882:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114844/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114844/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114844/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114844/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114844/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/d4mbc44tzlxvfyp7iy3jomhrptr7oxvo^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be btws4riobbseoweauaroqks3egxs5hg4
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:12:38 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.51 / 0.51 (98.64 %)
Files: 33681
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'btws4riobbseoweauaroqks3egxs5hg4'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- btws4ri neuron@develop%nvhpc@21.11+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] d4mbc44 ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5hjnqo3 ^gettext@0.21%nvhpc@21.11+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] uipobjs ^bzip2@1.0.8%nvhpc@21.11+shared arch=linux-rhel7-x86_64
[^] ruu3jsw ^libiconv@1.16%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] bt3jq7e ^libxml2@2.9.10%nvhpc@21.11~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] av5lrep ^pkgconf@1.7.3%nvhpc@21.11 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l6r3lhl ^xz@5.2.5%nvhpc@21.11~pic arch=linux-rhel7-x86_64
[^] tx5mit7 ^zlib@1.2.11%nvhpc@21.11+optimize+pic+shared arch=linux-rhel7-x86_64
[^] zuul7ic ^ncurses@6.2%nvhpc@21.11~symlinks+termlib arch=linux-rhel7-x86_64
[^] tnkl573 ^tar@1.28%nvhpc@21.11 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] arjv2hk ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 6upm4ih ^py-mpi4py@3.0.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] k3gs7u3 ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] qbjsyll ^py-setuptools-scm@4.1.2%nvhpc@21.11+toml arch=linux-rhel7-x86_64
[^] jtaqy3k ^py-toml@0.10.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ghwc5fz ^py-pytest-cov@2.8.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] vnepfwd ^py-coverage@5.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rx3mekq ^readline@8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-uipobjsrjwxnpkcrag4phvugoj7kn6h7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libiconv-1.16-ruu3js
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/pkgconf-1.7.3-av5lre
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/xz-5.2.5-l6r3lh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-tx5mit7opia6t3thbrdiubnz57rttfux)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-zuul7ickymna5aj5244q6ttogpw3o7wr)
[+] /usr (external tar-1.28-tnkl5732tb2dcrmu5z5kndpoiolmqzwh)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-rx3mekqaza7t4ajd57wqkzlm2yi7pihm)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-d4mbc4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libxml2-2.9.10-bt3jq7
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/gettext-0.21-5hjnqo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-coverage-5.3-vnepfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-mpi4py-3.0.3-6upm4i
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-toml-0.10.0-jtaqy3
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-arjv2h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-scm-4.1.2-qbjsyl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-k3gs7u
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-cov-2.8.1-ghwc5f
==> Installing neuron-develop-btws4riobbseoweauaroqks3egxs5hg4
==> No binary for neuron-develop-btws4riobbseoweauaroqks3egxs5hg4 found: installing from source
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/neuron-develop-btws4r
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114844/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:45:46 2021
Hits: 526 / 901 (58.38 %)
Direct: 15 / 910 (1.65 %)
Preprocessed: 511 / 889 (57.48 %)
Misses: 375
Direct: 895
Preprocessed: 378
Uncacheable: 134
Primary storage:
Hits: 579 / 1814 (31.92 %)
Misses: 1235
Cache size (GB): 0.51 / 0.51 (98.91 %)
Files: 33753
Cleanups: 15
Uncacheable:
Autoconf compile/link: 7
Called for linking: 111
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640259947:step_script section_start:1640259947:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=205816 revision=58ba2b95 version=14.2.0
ccache/: found 34314 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-6
Created cache
section_end:1640259986:archive_cache section_start:1640259986:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=207746 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114844 responseStatus=201 Created token=qCM31Hno
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=207781 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114844 responseStatus=201 Created token=qCM31Hno
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=207820 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114844 responseStatus=201 Created token=qCM31Hno
section_end:1640259988:upload_artifacts_on_success section_start:1640259988:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640259989:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640257644:resolve_secrets Resolving secrets
section_end:1640257644:resolve_secrets section_start:1640257644:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor916727182, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114838
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114838_PROD_P112_CP13_C15
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144786
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114838_PROD_P112_CP13_C15 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838 --ntasks=1 --jobid=144786 --cpus-per-task=6 --mem=30750M
section_end:1640257646:prepare_executor section_start:1640257646:prepare_script Preparing environment
Running on r1i7n20 via bbpv1.epfl.ch...
section_end:1640257648:prepare_script section_start:1640257648:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640257648:get_sources section_start:1640257648:restore_cache Restoring cache
Checking cache for neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=66344 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640257774:restore_cache section_start:1640257774:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (114818)...
Runtime platform  arch=amd64 os=linux pid=69747 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114818 responseStatus=200 OK token=8ySxDqEf
section_end:1640257775:download_artifacts section_start:1640257775:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114838/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114838/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114838/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114838/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114838/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be mvn7s3za436y6xrhbspwpy7pbewubnvm
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:10:32 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.46 / 0.51 (89.87 %)
Files: 24531
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'mvn7s3za436y6xrhbspwpy7pbewubnvm'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- mvn7s3z neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] aevgkbd ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
- jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ze65gmo ^py-setuptools-scm@4.1.2%intel@19.1.2.254+toml arch=linux-rhel7-x86_64
[^] p553wsa ^py-toml@0.10.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
- zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
- 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
==> Installing py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk
==> No binary for py-coverage-5.3-2v5wfwapuwn63xqjymkn5jpew7mdm6uk found: installing from source
==> Warning: Missing a source id for neuron@develop
==> Fetching https://mirror.spack.io/_source-cache/archive/28/280baa8ec489c4f542f8940f9c4c2181f0306a8ee1a54eceba071a449fb870a0.tar.gz
==> py-coverage: Executing phase: 'build'
==> py-coverage: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-toml-0.10.0-p553ws
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-aevgkb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-scm-4.1.2-ze65gm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
==> Installing py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe
==> No binary for py-pytest-cov-2.8.1-zniig3b6klz2ibslrfa3digiozwp46fe found: installing from source
==> Fetching https://mirror.spack.io/_source-cache/archive/cc/cc6742d8bac45070217169f5f72ceee1e0e55b0221f54bcf24845972d3a47f2b.tar.gz
==> py-pytest-cov: Executing phase: 'build'
==> py-pytest-cov: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
==> Installing neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm
==> No binary for neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm found: installing from source
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-mvn7s3
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114838/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:33:50 2021
Hits: 457 / 906 (50.44 %)
Direct: 16 / 915 (1.75 %)
Preprocessed: 441 / 893 (49.38 %)
Misses: 449
Direct: 899
Preprocessed: 452
Uncacheable: 145
Primary storage:
Hits: 507 / 1824 (27.80 %)
Misses: 1317
Cache size (GB): 0.47 / 0.51 (92.48 %)
Files: 25269
Cleanups: 6
Uncacheable:
Autoconf compile/link: 7
Called for linking: 122
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640259233:step_script section_start:1640259233:archive_cache Saving cache for successful job
Creating cache neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=115530 revision=58ba2b95 version=14.2.0
ccache/: found 25830 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-6
Created cache
section_end:1640259286:archive_cache section_start:1640259286:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=118529 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114838 responseStatus=201 Created token=xNjRYbK8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=118591 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114838 responseStatus=201 Created token=xNjRYbK8
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=118647 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114838 responseStatus=201 Created token=xNjRYbK8
section_end:1640259287:upload_artifacts_on_success section_start:1640259287:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640259288:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640258580:resolve_secrets Resolving secrets
section_end:1640258580:resolve_secrets section_start:1640258580:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor020916515, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114840
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114840_PROD_P112_CP21_C24
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144929
job state: PD
job state: PD
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114840_PROD_P112_CP21_C24 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840 --ntasks=1 --jobid=144929 --cpus-per-task=6 --mem=30750M
section_end:1640258584:prepare_executor section_start:1640258584:prepare_script Preparing environment
Running on r1i6n32 via bbpv1.epfl.ch...
section_end:1640258586:prepare_script section_start:1640258586:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640258587:get_sources section_start:1640258587:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=302246 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640258801:restore_cache section_start:1640258801:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (114820)...
Runtime platform  arch=amd64 os=linux pid=2968 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114820 responseStatus=200 OK token=7NCyeTYf
section_end:1640258801:download_artifacts section_start:1640258801:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114840/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114840/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114840/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114840/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114840/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/fzwojn4n4gs3mly2gllogfiwmaydujfg^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be gmrkbryjpmglziazibefpq5zk5edkyfe
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:29:44 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.51 / 0.51 (98.64 %)
Files: 33681
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'gmrkbryjpmglziazibefpq5zk5edkyfe'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- gmrkbry neuron@develop%nvhpc@21.11+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] fzwojn4 ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] zfakiou ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5hjnqo3 ^gettext@0.21%nvhpc@21.11+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] uipobjs ^bzip2@1.0.8%nvhpc@21.11+shared arch=linux-rhel7-x86_64
[^] ruu3jsw ^libiconv@1.16%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] bt3jq7e ^libxml2@2.9.10%nvhpc@21.11~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] av5lrep ^pkgconf@1.7.3%nvhpc@21.11 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l6r3lhl ^xz@5.2.5%nvhpc@21.11~pic arch=linux-rhel7-x86_64
[^] tx5mit7 ^zlib@1.2.11%nvhpc@21.11+optimize+pic+shared arch=linux-rhel7-x86_64
[^] zuul7ic ^ncurses@6.2%nvhpc@21.11~symlinks+termlib arch=linux-rhel7-x86_64
[^] tnkl573 ^tar@1.28%nvhpc@21.11 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] arjv2hk ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 6upm4ih ^py-mpi4py@3.0.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] k3gs7u3 ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] ghwc5fz ^py-pytest-cov@2.8.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] vnepfwd ^py-coverage@5.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rx3mekq ^readline@8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-uipobjsrjwxnpkcrag4phvugoj7kn6h7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libiconv-1.16-ruu3js
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/pkgconf-1.7.3-av5lre
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/xz-5.2.5-l6r3lh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-tx5mit7opia6t3thbrdiubnz57rttfux)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-zuul7ickymna5aj5244q6ttogpw3o7wr)
[+] /usr (external tar-1.28-tnkl5732tb2dcrmu5z5kndpoiolmqzwh)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-rx3mekqaza7t4ajd57wqkzlm2yi7pihm)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libxml2-2.9.10-bt3jq7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-arjv2h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-mpi4py-3.0.3-6upm4i
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-coverage-5.3-vnepfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/gettext-0.21-5hjnqo
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-k3gs7u
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-cov-2.8.1-ghwc5f
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-fzwojn
==> Installing neuron-develop-gmrkbryjpmglziazibefpq5zk5edkyfe
==> No binary for neuron-develop-gmrkbryjpmglziazibefpq5zk5edkyfe found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/neuron-develop-gmrkbr
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114840/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:53:17 2021
Hits: 527 / 898 (58.69 %)
Direct: 12 / 907 (1.32 %)
Preprocessed: 515 / 889 (57.93 %)
Misses: 371
Direct: 895
Preprocessed: 374
Uncacheable: 134
Primary storage:
Hits: 543 / 1808 (30.03 %)
Misses: 1265
Cache size (GB): 0.51 / 0.51 (98.90 %)
Files: 33769
Cleanups: 15
Uncacheable:
Autoconf compile/link: 7
Called for linking: 111
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640260398:step_script section_start:1640260398:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=43818 revision=58ba2b95 version=14.2.0
ccache/: found 34330 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-6
Created cache
section_end:1640260434:archive_cache section_start:1640260434:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=43944 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114840 responseStatus=201 Created token=HSjGyK5J
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=43966 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114840 responseStatus=201 Created token=HSjGyK5J
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=43991 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114840 responseStatus=201 Created token=HSjGyK5J
section_end:1640260435:upload_artifacts_on_success section_start:1640260435:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640260435:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640259829:resolve_secrets Resolving secrets
section_end:1640259829:resolve_secrets section_start:1640259829:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor810894458, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114837
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114837_PROD_P112_CP14_C16
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 145058
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114837_PROD_P112_CP14_C16 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837 --ntasks=1 --jobid=145058 --cpus-per-task=6 --mem=30750M
section_end:1640259830:prepare_executor section_start:1640259830:prepare_script Preparing environment
Running on r1i4n16 via bbpv1.epfl.ch...
section_end:1640259835:prepare_script section_start:1640259835:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640259836:get_sources section_start:1640259836:restore_cache Restoring cache
Checking cache for neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=177422 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640260088:restore_cache section_start:1640260088:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (114816)...
Runtime platform  arch=amd64 os=linux pid=181685 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114816 responseStatus=200 OK token=oqzj7qYH
section_end:1640260089:download_artifacts section_start:1640260089:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114837/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114837/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114837/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114837/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114837/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%intel+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/cwjs4t3f4wyl5jax3fb2obxbvjopwgn3
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be jhigcl7ephcbe47kbyz2znl76v2kaeev
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:50:10 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (91.12 %)
Files: 24805
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'jhigcl7ephcbe47kbyz2znl76v2kaeev'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%intel+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
Concretized
--------------------------------
- jhigcl7 neuron@develop%intel@19.1.2.254+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] cwjs4t3 ^coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] lqyttqy ^nmodl@develop%intel@19.1.2.254~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ubiktsv ^py-jinja2@2.10.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] yrbfda2 ^py-babel@2.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] oe2c27i ^py-pytz@2020.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] xfgkmkd ^py-setuptools@50.3.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] oe2hrft ^py-markupsafe@1.1.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] jo63uk3 ^py-pytest@5.3.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kcyedyh ^py-attrs@20.3.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] mikhjgq ^py-more-itertools@8.7.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] hziuwhj ^py-packaging@19.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] vpsqgcg ^py-pyparsing@2.4.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] xgnwei3 ^py-six@1.16.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] gc3zsis ^py-pluggy@0.13.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 557icag ^py-py@1.8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] za7jmvs ^py-wcwidth@0.1.7%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] chpzzlm ^py-pyyaml@5.3.1%intel@19.1.2.254+libyaml arch=linux-rhel7-x86_64
[^] 4237mpr ^libyaml@0.2.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] runxrmn ^py-sympy@1.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] d6t5uhn ^py-mpmath@1.1.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 6vrzcuv ^gettext@0.21%intel@19.1.2.254+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-x86_64
[^] 6zbb66a ^bzip2@1.0.8%intel@19.1.2.254+shared arch=linux-rhel7-x86_64
[^] qlmq4dv ^libiconv@1.16%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 6lr2umn ^libxml2@2.9.10%intel@19.1.2.254~python arch=linux-rhel7-x86_64
[^] 2qyzkdl ^pkgconf@1.7.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] wzx3yy4 ^xz@5.2.5%intel@19.1.2.254~pic arch=linux-rhel7-x86_64
[^] nedfnju ^ncurses@6.2%intel@19.1.2.254~symlinks+termlib arch=linux-rhel7-x86_64
[^] d4pg4b2 ^tar@1.28%intel@19.1.2.254 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] i3t5fut ^py-cython@0.29.21%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] mr7m2z7 ^py-mpi4py@3.0.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] l643i7a ^py-numpy@1.19.4%intel@19.1.2.254+blas+lapack arch=linux-rhel7-x86_64
[^] nnxc4wm ^intel-mkl@2018.3.222%intel@19.1.2.254~ilp64+shared threads=none arch=linux-rhel7-x86_64
[+] zniig3b ^py-pytest-cov@2.8.1%intel@19.1.2.254 arch=linux-rhel7-x86_64
[+] 2v5wfwa ^py-coverage@5.3%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] kej56sd ^readline@8.0%intel@19.1.2.254 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ymcya3lbfxylkvsbomj2rbzbvecsldu2)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-mxqypexiy6wmh4hpnmf4lbwwwqhxzscg)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-pvpzjklfqyl55rerdxp63j32kpqkfr4z)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-nnhu6ziqp6ramcgkmky7i3e2ll5vl5ey)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-wjshhipoj5m66agnke3p2dsjf32qntuf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/spdlog-1.8.1-gwht6m
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-icfhbitmltpoj6w6vghr23ac5erldiic)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libyaml-0.2.4-4237mp
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-5mabxtbvp5xw7gfjcac32iffw27sdssk)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-6zbb66a3uunskwyljh6sbgo36hbo7lj4)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libiconv-1.16-qlmq4d
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/pkgconf-1.7.3-2qyzkd
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/xz-5.2.5-wzx3yy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-nedfnju3ptngli3lpj3occtiuoe2x6e3)
[+] /usr (external tar-1.28-d4pg4b2ncvxd3p2ptw3j4os6jb5a7yvy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-nnxc4wmon4s26gfyily3n6tqa43p36rj)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-kej56sdf2cwo7ximwd5foo34wzwveqxc)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/reportinglib-2.5.6-7eg3tq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/hdf5-1.10.7-pjaxv6
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-mpmath-1.1.0-d6t5uh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-attrs-20.3.0-kcyedy
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-six-1.16.0-xgnwei
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-nayogh4gvnag7ybxc2ud5dt4ckxod3cc)
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-more-itertools-8.7.0-mikhjg
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-setuptools-50.3.2-xfgkmk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-markupsafe-1.1.1-oe2hrf
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyparsing-2.4.2-vpsqgc
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pytz-2020.1-oe2c27
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pluggy-0.13.0-gc3zsi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-py-1.8.0-557ica
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-wcwidth-0.1.7-za7jmv
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/applications/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-pyyaml-5.3.1-chpzzl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libxml2-2.9.10-6lr2um
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/libsonata-report-1.0.0.20211007-2gn7wj
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-sympy-1.4-runxrm
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-coverage-5.3-2v5wfw
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-mpi4py-3.0.3-mr7m2z
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-cython-0.29.21-i3t5fu
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-packaging-19.2-hziuwh
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-babel-2.7.0-yrbfda
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/gettext-0.21-6vrzcu
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/intel-19.1.2.254/py-numpy-1.19.4-l643i7
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-5.3.4-jo63uk
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-jinja2-2.10.3-ubikts
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/py-pytest-cov-2.8.1-zniig3
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/nmodl-develop-lqyttq
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/coreneuron-develop-cwjs4t
==> Installing neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev
==> No binary for neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/intel-19.1.2.254/neuron-develop-jhigcl
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114837/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 13:30:21 2021
Hits: 450 / 899 (50.06 %)
Direct: 10 / 908 (1.10 %)
Preprocessed: 440 / 892 (49.33 %)
Misses: 449
Direct: 898
Preprocessed: 452
Uncacheable: 143
Primary storage:
Hits: 461 / 1810 (25.47 %)
Misses: 1349
Cache size (GB): 0.47 / 0.51 (92.18 %)
Files: 25094
Cleanups: 7
Uncacheable:
Autoconf compile/link: 7
Called for linking: 120
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640262625:step_script section_start:1640262625:archive_cache Saving cache for successful job
Creating cache neuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=264770 revision=58ba2b95 version=14.2.0
ccache/: found 25655 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-intel-6
Created cache
section_end:1640262694:archive_cache section_start:1640262694:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=265518 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114837 responseStatus=201 Created token=Au-kFzLA
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=265549 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114837 responseStatus=201 Created token=Au-kFzLA
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=265577 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114837 responseStatus=201 Created token=Au-kFzLA
section_end:1640262696:upload_artifacts_on_success section_start:1640262696:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640262696:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640258503:resolve_secrets Resolving secrets
section_end:1640258503:resolve_secrets section_start:1640258503:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor269615393, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114842
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J114842_PROD_P112_CP18_C18
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144919
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J114842_PROD_P112_CP18_C18 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842 --ntasks=1 --jobid=144919 --cpus-per-task=6 --mem=30750M
section_end:1640258504:prepare_executor section_start:1640258504:prepare_script Preparing environment
Running on r1i5n30 via bbpv1.epfl.ch...
section_end:1640258506:prepare_script section_start:1640258506:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640258507:get_sources section_start:1640258507:restore_cache Restoring cache
Checking cache for neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=99737 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640258869:restore_cache section_start:1640258869:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl~openmp:gpu (114822)...
Runtime platform  arch=amd64 os=linux pid=114592 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114822 responseStatus=200 OK token=jjw5XjR4
section_end:1640258869:download_artifacts section_start:1640258869:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_PACKAGE_DEPENDENCIES="${SPACK_PACKAGE_DEPENDENCIES}^py-cython%gcc^py-numpy%gcc"
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114842/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114842/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114842/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114842/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114842/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron@develop%nvhpc+coreneuron+debug+tests~legacy-unit model_tests=channel-benchmark,olfactory ^/is6uybjw66hpxwgpzajec3egglb7vpaw^py-cython%gcc^py-numpy%gcc
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
==> Warning: Missing a source id for neuron@develop
==> Warning: Missing a source id for nmodl@develop
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be fwu47zj5ksgprg63usqqvmnfvuvjnlmc
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 12:30:47 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.51 / 0.51 (98.64 %)
Files: 33681
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'fwu47zj5ksgprg63usqqvmnfvuvjnlmc'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron@develop%nvhpc+coreneuron+debug~legacy-unit+tests model_tests=channel-benchmark,olfactory
[+] ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared+sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- ^py-cython%gcc
- ^py-numpy%gcc
Concretized
--------------------------------
- fwu47zj neuron@develop%nvhpc@21.11+binary+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python+rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[+] is6uybj ^coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile~report+shared+sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] zfakiou ^nmodl@develop%nvhpc@21.11~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[+] 56d4qrp ^py-jinja2@2.10.3%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] wmslpld ^py-babel@2.7.0%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] oy6pnkw ^py-pytz@2020.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] qtsnebc ^py-setuptools@50.3.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 7ap4eon ^py-markupsafe@1.1.1%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] nklcaqd ^py-pytest@5.3.4%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] hv3l6m3 ^py-attrs@20.3.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] ric2ffi ^py-more-itertools@8.7.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] tnxvjns ^py-packaging@19.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] nqd6d4a ^py-pyparsing@2.4.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] dt3gjsu ^py-six@1.16.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rlm5oq3 ^py-pluggy@0.13.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] auxibxx ^py-py@1.8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] a5khbku ^py-wcwidth@0.1.7%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] 4tb344r ^py-pyyaml@5.3.1%gcc@9.3.0+libyaml arch=linux-rhel7-x86_64
[^] ggibzjm ^libyaml@0.2.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] qqqe57g ^py-sympy@1.4%gcc@9.3.0 arch=linux-rhel7-x86_64
[+] 7efatr5 ^py-mpmath@1.1.0%gcc@9.3.0 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] 5hjnqo3 ^gettext@0.21%nvhpc@21.11+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-x86_64
[^] uipobjs ^bzip2@1.0.8%nvhpc@21.11+shared arch=linux-rhel7-x86_64
[^] ruu3jsw ^libiconv@1.16%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] bt3jq7e ^libxml2@2.9.10%nvhpc@21.11~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-x86_64
[^] av5lrep ^pkgconf@1.7.3%nvhpc@21.11 patches=6e94c68d45d4cb8148c8c53699921d10b13784f758f0563ce64c838e0ca48ceb arch=linux-rhel7-x86_64
[^] l6r3lhl ^xz@5.2.5%nvhpc@21.11~pic arch=linux-rhel7-x86_64
[^] tx5mit7 ^zlib@1.2.11%nvhpc@21.11+optimize+pic+shared arch=linux-rhel7-x86_64
[^] zuul7ic ^ncurses@6.2%nvhpc@21.11~symlinks+termlib arch=linux-rhel7-x86_64
[^] tnkl573 ^tar@1.28%nvhpc@21.11 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,4e8cdf69294c376c45c39d059f11769c5c996c2d84cdfb56eb69890e0aa4e991,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] arjv2hk ^py-cython@0.29.21%gcc@9.3.0 arch=linux-rhel7-x86_64
[^] 6upm4ih ^py-mpi4py@3.0.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[+] k3gs7u3 ^py-numpy@1.19.4%gcc@9.3.0+blas+lapack arch=linux-rhel7-x86_64
[^] syahjjg ^intel-mkl@2018.3.222%gcc@9.3.0~ilp64+shared threads=none arch=linux-rhel7-x86_64
[^] ghwc5fz ^py-pytest-cov@2.8.1%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] vnepfwd ^py-coverage@5.3%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] rx3mekq ^readline@8.0%nvhpc@21.11 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
==> bison@3.6.4 : has external module in ['bison/3.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bison-3.6.4-sqrqli (external bison-3.6.4-ilh3i6hsazuqblyjs46wno4wkyhcaycx)
==> cmake@3.15.7 : has external module in ['cmake/3.15.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cmake-3.15.7-4373ty (external cmake-3.15.7-3id4xmvyepn3luv5kvzabnojgl4kjbvv)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/boost-1.73.0-n5sq7k (external boost-1.73.0-ugnnaujozxx7u35zmkozzxs42p6ujetq)
==> cuda@11.5.1 : has external module in ['cuda/11.5.1']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/cuda-11.5.1-gygt6u (external cuda-11.5.1-rtdgzjuarsbhlad5e2q6z6hb35poq3ba)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/hpe-mpi-2.25.hmpt-l6dob7 (external hpe-mpi-2.25.hmpt-rvmqyashdppnfjw5xoegvqeeaassuana)
==> python@3.8.3 : has external module in ['python/3.8.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/python-3.8.3-suxrst (external python-3.8.3-boepiq7qwlm3d6e5almdw67q65o5quqn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/libyaml-0.2.4-ggibzj
==> flex@2.6.4 : has external module in ['flex/2.6.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/flex-2.6.4-kpj7of (external flex-2.6.4-o7642tm7j36qtzmyzthrmdbfctyfsdnn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/bzip2-1.0.8-vatuhz (external bzip2-1.0.8-uipobjsrjwxnpkcrag4phvugoj7kn6h7)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libiconv-1.16-ruu3js
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/pkgconf-1.7.3-av5lre
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/xz-5.2.5-l6r3lh
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/zlib-1.2.11-uubmvo (external zlib-1.2.11-tx5mit7opia6t3thbrdiubnz57rttfux)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ncurses-6.2-xvsnay (external ncurses-6.2-zuul7ickymna5aj5244q6ttogpw3o7wr)
[+] /usr (external tar-1.28-tnkl5732tb2dcrmu5z5kndpoiolmqzwh)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/intel-mkl-2018.3.222-xjuqsf (external intel-mkl-2018.3.222-syahjjgpawq4c4jicb753yciaowfyr75)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/readline-8.0-f2v4sr (external readline-8.0-rx3mekqaza7t4ajd57wqkzlm2yi7pihm)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-py-1.8.0-auxibx
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-wcwidth-0.1.7-a5khbk
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ninja-1.10.2-7mzwmh (external ninja-1.10.2-6yf3e2oymeefngifdautp2wd347lcijn)
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-more-itertools-8.7.0-ric2ff
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pytz-2020.1-oy6pnk
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pluggy-0.13.0-rlm5oq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-setuptools-50.3.2-qtsneb
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-six-1.16.0-dt3gjs
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-attrs-20.3.0-hv3l6m
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-mpmath-1.1.0-7efatr
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-markupsafe-1.1.1-7ap4eo
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pyparsing-2.4.2-nqd6d4
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-pyyaml-5.3.1-4tb344
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/libxml2-2.9.10-bt3jq7
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-coverage-5.3-vnepfw
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-babel-2.7.0-wmslpl
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-cython-0.29.21-arjv2h
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-mpi4py-3.0.3-6upm4i
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-sympy-1.4-qqqe57
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-packaging-19.2-tnxvjn
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/gettext-0.21-5hjnqo
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/gcc-9.3.0/py-jinja2-2.10.3-56d4qr
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/py-numpy-1.19.4-k3gs7u
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-5.3.4-nklcaq
[+] /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/libraries/2021-01-06/linux-rhel7-x86_64/nvhpc-21.11/py-pytest-cov-2.8.1-ghwc5f
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/nmodl-develop-zfakio
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/coreneuron-develop-is6uyb
==> Installing neuron-develop-fwu47zj5ksgprg63usqqvmnfvuvjnlmc
==> No binary for neuron-develop-fwu47zj5ksgprg63usqqvmnfvuvjnlmc found: installing from source
==> Warning: Missing a source id for nmodl@develop
==> Warning: Missing a source id for neuron@develop
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114810/_/spack/opt/spack/linux-rhel7-x86_64/nvhpc-21.11/neuron-develop-fwu47z
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114842/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Thu Dec 23 13:17:45 2021
Hits: 565 / 898 (62.92 %)
Direct: 15 / 907 (1.65 %)
Preprocessed: 550 / 886 (62.08 %)
Misses: 333
Direct: 892
Preprocessed: 336
Uncacheable: 134
Primary storage:
Hits: 580 / 1808 (32.08 %)
Misses: 1228
Cache size (GB): 0.50 / 0.51 (96.89 %)
Files: 33147
Cleanups: 15
Uncacheable:
Autoconf compile/link: 7
Called for linking: 111
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ SPACK_PACKAGE_DEPENDENCIES=^/${SPACK_INSTALLED_HASH}
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCIES=${SPACK_PACKAGE_DEPENDENCIES}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.8.3
Autoloading py-virtualenv/16.7.6
Autoloading py-numpy/1.19.4
Autoloading py-mpi4py/3.0.3
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.1.0
Autoloading hdf5/1.10.7
$ echo "Returning the number of failed builds, ${num_failures}"
Returning the number of failed builds, 0
$ exit ${num_failures}
section_end:1640261869:step_script section_start:1640261869:archive_cache Saving cache for successful job
Creating cache neuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=206298 revision=58ba2b95 version=14.2.0
ccache/: found 33708 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/neuron-nvhpc-6
Created cache
section_end:1640262025:archive_cache section_start:1640262025:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=215846 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=114842 responseStatus=201 Created token=rbf5-kDC
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=215877 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=114842 responseStatus=201 Created token=rbf5-kDC
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=215904 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114842 responseStatus=201 Created token=rbf5-kDC
section_end:1640262027:upload_artifacts_on_success section_start:1640262027:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640262028:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640257785:resolve_secrets Resolving secrets
section_end:1640257785:resolve_secrets section_start:1640257785:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor398735939, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114834
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114834, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114834_PROD_P112_CP2_C4
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 144791
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J114834_PROD_P112_CP2_C4 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114834 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114834 --ntasks=8 --jobid=144791 --cpus-per-task=1 --mem=30750M
section_end:1640257786:prepare_executor section_start:1640257786:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640257788:prepare_script section_start:1640257788:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640257789:get_sources section_start:1640257789:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:gpu (114824)...
Runtime platform  arch=amd64 os=linux pid=12905 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114824 responseStatus=200 OK token=y5jsK9as
section_end:1640257789:download_artifacts section_start:1640257789:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n20
Build name: Linux-nvc++
Create new tag: 20211223-1110 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114824/_/spack-build/spack-stage-coreneuron-develop-d4mbc44tzlxvfyp7iy3jomhrptr7oxvo/spack-build-d4mbc44
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #1: cmd_interface_test ..................... Passed 2.34 sec
Start 7: ring_binqueue_TEST
2/18 Test #2: interleave_info_constructor_test ....... Passed 2.98 sec
3/18 Test #4: queuing_test ........................... Passed 4.21 sec
Start 8: ring_multisend_TEST
4/18 Test #3: alignment_test ......................... Passed 4.38 sec
5/18 Test #5: lfp_test ............................... Passed 4.39 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 7.44 sec
Start 10: ring_permute1_TEST
7/18 Test #7: ring_binqueue_TEST ..................... Passed 48.25 sec
Start 11: ring_permute2_TEST
8/18 Test #8: ring_multisend_TEST .................... Passed 52.24 sec
Start 12: ring_gap_TEST
9/18 Test #10: ring_permute1_TEST ..................... Passed 53.24 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #9: ring_spike_buffer_TEST ................. Passed 60.44 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 54.80 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #12: ring_gap_TEST .......................... Passed 931.67 sec
Start 16: ring_gap_permute2_TEST
13/18 Test #13: ring_gap_binqueue_TEST ................. Passed 1461.82 sec
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #14: ring_gap_multisend_TEST ................ Passed 1498.80 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST ................. Passed 1460.42 sec
16/18 Test #16: ring_gap_permute2_TEST ................. Passed 580.99 sec
17/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 69.78 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 39.21 sec
100% tests passed, 0 tests failed out of 18
Total Test time (real) = 1602.89 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640259431:step_script section_start:1640259431:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=32684 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114834 responseStatus=201 Created token=nf7gqNLx
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=32769 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114834 responseStatus=201 Created token=nf7gqNLx
section_end:1640259432:upload_artifacts_on_success section_start:1640259432:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640259433:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640257644:resolve_secrets Resolving secrets
section_end:1640257644:resolve_secrets section_start:1640257644:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor064811260, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114828
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114828, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114828_PROD_P112_CP8_C3
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 144785
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J114828_PROD_P112_CP8_C3 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114828 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114828 --ntasks=8 --jobid=144785 --cpus-per-task=1 --mem=30750M
section_end:1640257645:prepare_executor section_start:1640257645:prepare_script Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1640257648:prepare_script section_start:1640257648:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640257649:get_sources section_start:1640257649:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:intel (114818)...
Runtime platform  arch=amd64 os=linux pid=109757 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114818 responseStatus=200 OK token=8ySxDqEf
section_end:1640257650:download_artifacts section_start:1640257650:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n20
Build name: Linux-icpc
Create new tag: 20211223-1110 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114818/_/spack-build/spack-stage-coreneuron-develop-aevgkbdozl3htdtjhrd5w65n3c6mb2jh/spack-build-aevgkbd
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #3: alignment_test ..................... Passed 1.76 sec
2/17 Test #2: interleave_info_constructor_test ... Passed 2.99 sec
Start 7: ring_binqueue_TEST
3/17 Test #1: cmd_interface_test ................. Passed 3.23 sec
4/17 Test #4: queuing_test ....................... Passed 3.38 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 4.69 sec
6/17 Test #17: reporting_1 ........................ Passed 8.98 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #6: ring_TEST .......................... Passed 9.19 sec
Start 10: ring_permute1_TEST
8/17 Test #8: ring_multisend_TEST ................ Passed 5.82 sec
Start 11: ring_permute2_TEST
9/17 Test #7: ring_binqueue_TEST ................. Passed 6.49 sec
Start 12: ring_gap_TEST
10/17 Test #9: ring_spike_buffer_TEST ............. Passed 6.52 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #10: ring_permute1_TEST ................. Passed 10.69 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 13.13 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #12: ring_gap_TEST ...................... Passed 13.14 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 7.46 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 7.38 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 6.05 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 6.15 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 28.87 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640257851:step_script section_start:1640257851:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=128130 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114828 responseStatus=201 Created token=QboD7oUy
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=128281 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114828 responseStatus=201 Created token=QboD7oUy
section_end:1640257852:upload_artifacts_on_success section_start:1640257852:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640257853:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640261805:resolve_secrets Resolving secrets
section_end:1640261805:resolve_secrets section_start:1640261805:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor508518257, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114960
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114960, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114960_PROD_P112_CP11_C7
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 145197
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J114960_PROD_P112_CP11_C7 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114960 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114960 --ntasks=8 --jobid=145197 --cpus-per-task=1 --mem=30750M
section_end:1640261807:prepare_executor section_start:1640261807:prepare_script Preparing environment
Running on r2i3n1 via bbpv1.epfl.ch...
section_end:1640261809:prepare_script section_start:1640261809:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640261809:get_sources section_start:1640261809:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:gpu (114820)...
Runtime platform  arch=amd64 os=linux pid=158591 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114820 responseStatus=200 OK token=7NCyeTYf
section_end:1640261810:download_artifacts section_start:1640261810:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n32
Build name: Linux-nvc++
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-build-fzwojn4
Start 12: ring_gap_TEST
Start 14: ring_gap_multisend_TEST
Start 13: ring_gap_binqueue_TEST
Start 15: ring_gap_permute1_TEST
1/18 Test #13: ring_gap_binqueue_TEST ................. Passed 9.95 sec
Start 16: ring_gap_permute2_TEST
2/18 Test #12: ring_gap_TEST ..........................***Timeout 1500.23 sec
num_mpi=8
num_omp_thread=1
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 0281e0ed (2021-12-23 12:01:05 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 219.2070, Min 218.9180, Avg 218.9561
GPU Memory (MBs) : Used = 1967.500000, Free = 14193.000000, Total = 16160.500000
Memory (MBs) : After MPI_Init : Max 219.3555, Min 219.2070, Avg 219.3350
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Memory (MBs) : Before nrn_setup : Max 219.5664, Min 219.3906, Avg 219.4150
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.65 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 219.5938, Min 219.4180, Avg 219.4424
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=65536
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-build-fzwojn4/tests/integration/ring_gap
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 219.5938, Min 219.4180, Avg 219.4424
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Memory (MBs) : After nrn_finitialize : Max 220.0625, Min 219.6250, Avg 219.7158
GPU Memory (MBs) : Used = 1979.500000, Free = 14181.000000, Total = 16160.500000
Start 18: ring_gap_permute2_cudaInterface_TEST
3/18 Test #14: ring_gap_multisend_TEST ................***Timeout 1500.30 sec
num_mpi=8
num_omp_thread=1
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 0281e0ed (2021-12-23 12:01:05 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 219.2070, Min 218.9141, Avg 218.9536
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Memory (MBs) : After MPI_Init : Max 219.3516, Min 219.2070, Avg 219.3330
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Memory (MBs) : Before nrn_setup : Max 219.5664, Min 219.3867, Avg 219.4121
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
WARNING : GPU execution requires --cell-permute type 1 or 2. Setting it to 1.
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 1.17 seconds
Model size : 93.34 kB
Memory (MBs) : After nrn_setup : Max 219.7852, Min 219.4141, Avg 219.4873
GPU Memory (MBs) : Used = 1979.500000, Free = 14181.000000, Total = 16160.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=65536
--cell-permute=0
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=true
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-build-fzwojn4/tests/integration/ring_gap_multisend
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 219.7852, Min 219.4141, Avg 219.4873
GPU Memory (MBs) : Used = 1981.500000, Free = 14179.000000, Total = 16160.500000
Memory (MBs) : After nrn_finitialize : Max 219.8906, Min 219.5586, Avg 219.6226
GPU Memory (MBs) : Used = 1983.500000, Free = 14177.000000, Total = 16160.500000
Start 17: ring_permute2_cudaInterface_TEST
4/18 Test #15: ring_gap_permute1_TEST .................***Timeout 1500.34 sec
num_mpi=8
num_omp_thread=1
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 0281e0ed (2021-12-23 12:01:05 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 219.2070, Min 218.9141, Avg 218.9536
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Memory (MBs) : After MPI_Init : Max 219.3516, Min 219.2070, Avg 219.3330
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Memory (MBs) : Before nrn_setup : Max 219.5664, Min 219.3867, Avg 219.4121
GPU Memory (MBs) : Used = 1971.500000, Free = 14189.000000, Total = 16160.500000
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
Setup Done : 0.62 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 219.5938, Min 219.4141, Avg 219.4395
GPU Memory (MBs) : Used = 1975.500000, Free = 14185.000000, Total = 16160.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=65536
--cell-permute=1
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-build-fzwojn4/tests/integration/ring_gap_permute1
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 219.5938, Min 219.4141, Avg 219.4395
GPU Memory (MBs) : Used = 1975.500000, Free = 14185.000000, Total = 16160.500000
Memory (MBs) : After nrn_finitialize : Max 220.0664, Min 219.6250, Avg 219.7158
GPU Memory (MBs) : Used = 1979.500000, Free = 14181.000000, Total = 16160.500000
Start 7: ring_binqueue_TEST
5/18 Test #16: ring_gap_permute2_TEST .................***Timeout 1500.08 sec
num_mpi=8
num_omp_thread=1
Info : 4 GPUs shared by 8 ranks per node
Duke, Yale, and the BlueBrain Project -- Copyright 1984-2020
Version : 1.0 0281e0ed (2021-12-23 12:01:05 +0100)
Additional mechanisms from files
exp2syn.mod expsyn.mod halfgap.mod hh.mod netstim.mod passive.mod pattern.mod stim.mod svclmp.mod
Memory (MBs) : After mk_mech : Max 219.2070, Min 218.9180, Avg 218.9541
GPU Memory (MBs) : Used = 2942.500000, Free = 13218.000000, Total = 16160.500000
Memory (MBs) : After MPI_Init : Max 219.3516, Min 219.2070, Avg 219.3335
GPU Memory (MBs) : Used = 2944.500000, Free = 13216.000000, Total = 16160.500000
Memory (MBs) : Before nrn_setup : Max 219.5664, Min 219.3906, Avg 219.4126
best_balance=0.82093 ncell=10 ntype=3 nwarp=10
GPU Memory (MBs) : Used = 2944.500000, Free = 13216.000000, Total = 16160.500000
Model uses gap junctions
Info : The number of input datasets are less than ranks, some ranks will be idle!
best_balance=0.848837 ncell=10 ntype=3 nwarp=10
Setup Done : 1.40 seconds
Model size : 93.06 kB
Memory (MBs) : After nrn_setup : Max 219.7969, Min 219.4180, Avg 219.4907
GPU Memory (MBs) : Used = 3831.500000, Free = 12329.000000, Total = 16160.500000
GENERAL PARAMETERS
--mpi=true
--mpi-lib=
--gpu=true
--dt=0.025
--tstop=100
GPU
--nwarp=65536
--cell-permute=2
--cuda-interface=false
INPUT PARAMETERS
--voltage=-65
--seed=-1
--datpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-src/tests/integration/ring_gap
--filesdat=files.dat
--pattern=
--report-conf=
--restore=
PARALLEL COMPUTATION PARAMETERS
--threading=false
--skip_mpi_finalize=false
SPIKE EXCHANGE
--ms_phases=2
--ms_subintervals=2
--multisend=false
--spk_compress=0
--binqueue=false
CONFIGURATION
--spikebuf=100000
--prcellgid=-1
--forwardskip=0
--celsius=6.3
--mindelay=10
--report-buffer-size=4
OUTPUT PARAMETERS
--dt_io=0.1
--outpath=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114820/_/spack-build/spack-stage-coreneuron-develop-fzwojn4n4gs3mly2gllogfiwmaydujfg/spack-build-fzwojn4/tests/integration/ring_gap_permute2
--checkpoint=
Start time (t) = 0
Memory (MBs) : After mk_spikevec_buffer : Max 219.7969, Min 219.4180, Avg 219.4907
GPU Memory (MBs) : Used = 3835.500000, Free = 12325.000000, Total = 16160.500000
Memory (MBs) : After nrn_finitialize : Max 220.0625, Min 219.6172, Avg 219.7056
GPU Memory (MBs) : Used = 3530.500000, Free = 12630.000000, Total = 16160.500000
Start 8: ring_multisend_TEST
6/18 Test #7: ring_binqueue_TEST ..................... Passed 69.97 sec
Start 9: ring_spike_buffer_TEST
7/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 73.97 sec
Start 10: ring_permute1_TEST
8/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 84.57 sec
Start 11: ring_permute2_TEST
9/18 Test #8: ring_multisend_TEST .................... Passed 85.92 sec
Start 6: ring_TEST
10/18 Test #11: ring_permute2_TEST ..................... Passed 62.58 sec
Start 5: lfp_test
Start 3: alignment_test
11/18 Test #9: ring_spike_buffer_TEST ................. Passed 77.40 sec
Start 4: queuing_test
Start 1: cmd_interface_test
12/18 Test #10: ring_permute1_TEST ..................... Passed 73.49 sec
Start 2: interleave_info_constructor_test
13/18 Test #6: ring_TEST .............................. Passed 55.16 sec
14/18 Test #3: alignment_test ......................... Passed 4.18 sec
15/18 Test #1: cmd_interface_test ..................... Passed 4.10 sec
16/18 Test #4: queuing_test ........................... Passed 4.59 sec
17/18 Test #2: interleave_info_constructor_test ....... Passed 4.60 sec
18/18 Test #5: lfp_test ............................... Passed 4.93 sec
78% tests passed, 4 tests failed out of 18
Total Test time (real) = 1652.41 sec
The following tests FAILED:
12 - ring_gap_TEST (Timeout)
14 - ring_gap_multisend_TEST (Timeout)
15 - ring_gap_permute1_TEST (Timeout)
16 - ring_gap_permute2_TEST (Timeout)
Errors while running CTest
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
srun: error: r2i3n1: task 0: Exited with exit code 1
section_end:1640263512:step_script section_start:1640263512:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=199443 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 8 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114960 responseStatus=201 Created token=kyHYgbSg
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=199476 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114960 responseStatus=201 Created token=kyHYgbSg
section_end:1640263514:upload_artifacts_on_failure section_start:1640263514:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640263515:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640259828:resolve_secrets Resolving secrets
section_end:1640259828:resolve_secrets section_start:1640259828:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor337492488, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114826
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114826, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114826_PROD_P112_CP4_C13
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 145057
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J114826_PROD_P112_CP4_C13 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114826 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114826 --ntasks=8 --jobid=145057 --cpus-per-task=1 --mem=30750M
section_end:1640259830:prepare_executor section_start:1640259830:prepare_script Preparing environment
Running on r1i4n16 via bbpv1.epfl.ch...
section_end:1640259835:prepare_script section_start:1640259835:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640259836:get_sources section_start:1640259836:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl:intel (114816)...
Runtime platform  arch=amd64 os=linux pid=177531 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114816 responseStatus=200 OK token=oqzj7qYH
section_end:1640259838:download_artifacts section_start:1640259838:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n21
Build name: Linux-icpc
Create new tag: 20211223-1149 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114816/_/spack-build/spack-stage-coreneuron-develop-cwjs4t3f4wyl5jax3fb2obxbvjopwgn3/spack-build-cwjs4t3
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #1: cmd_interface_test ................. Passed 3.39 sec
2/17 Test #3: alignment_test ..................... Passed 3.70 sec
Start 7: ring_binqueue_TEST
3/17 Test #2: interleave_info_constructor_test ... Passed 4.14 sec
4/17 Test #4: queuing_test ....................... Passed 4.37 sec
Start 8: ring_multisend_TEST
5/17 Test #5: lfp_test ........................... Passed 4.87 sec
6/17 Test #6: ring_TEST .......................... Passed 8.25 sec
Start 9: ring_spike_buffer_TEST
7/17 Test #17: reporting_1 ........................ Passed 8.67 sec
Start 10: ring_permute1_TEST
8/17 Test #8: ring_multisend_TEST ................ Passed 5.69 sec
Start 11: ring_permute2_TEST
9/17 Test #7: ring_binqueue_TEST ................. Passed 6.67 sec
Start 12: ring_gap_TEST
10/17 Test #10: ring_permute1_TEST ................. Passed 16.85 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #9: ring_spike_buffer_TEST ............. Passed 20.76 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 19.83 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #12: ring_gap_TEST ...................... Passed 19.77 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 8.60 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 5.83 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 5.36 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 5.38 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 35.74 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640260179:step_script section_start:1640260179:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=184757 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114826 responseStatus=201 Created token=mioeMzyL
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=184792 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114826 responseStatus=201 Created token=mioeMzyL
section_end:1640260181:upload_artifacts_on_success section_start:1640260181:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640260182:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640258502:resolve_secrets Resolving secrets
section_end:1640258502:resolve_secrets section_start:1640258502:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor824102103, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114832
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114832, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114832_PROD_P112_CP11_C12
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 144918
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J114832_PROD_P112_CP11_C12 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114832 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114832 --ntasks=8 --jobid=144918 --cpus-per-task=1 --mem=30750M
section_end:1640258504:prepare_executor section_start:1640258504:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640258505:prepare_script section_start:1640258505:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640258506:get_sources section_start:1640258506:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron+nmodl~openmp:gpu (114822)...
Runtime platform  arch=amd64 os=linux pid=19877 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114822 responseStatus=200 OK token=jjw5XjR4
section_end:1640258507:download_artifacts section_start:1640258507:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n32
Build name: Linux-nvc++
Create new tag: 20211223-1122 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114822/_/spack-build/spack-stage-coreneuron-develop-is6uybjw66hpxwgpzajec3egglb7vpaw/spack-build-is6uybj
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
1/18 Test #1: cmd_interface_test ..................... Passed 1.99 sec
Start 7: ring_binqueue_TEST
2/18 Test #3: alignment_test ......................... Passed 2.20 sec
3/18 Test #2: interleave_info_constructor_test ....... Passed 2.32 sec
Start 8: ring_multisend_TEST
4/18 Test #4: queuing_test ........................... Passed 2.54 sec
5/18 Test #5: lfp_test ............................... Passed 2.70 sec
Start 9: ring_spike_buffer_TEST
6/18 Test #6: ring_TEST .............................. Passed 5.39 sec
Start 10: ring_permute1_TEST
7/18 Test #7: ring_binqueue_TEST ..................... Passed 47.56 sec
Start 11: ring_permute2_TEST
8/18 Test #9: ring_spike_buffer_TEST ................. Passed 47.38 sec
Start 12: ring_gap_TEST
9/18 Test #10: ring_permute1_TEST ..................... Passed 44.87 sec
Start 13: ring_gap_binqueue_TEST
10/18 Test #8: ring_multisend_TEST .................... Passed 48.14 sec
Start 14: ring_gap_multisend_TEST
11/18 Test #11: ring_permute2_TEST ..................... Passed 18.84 sec
Start 15: ring_gap_permute1_TEST
12/18 Test #14: ring_gap_multisend_TEST ................ Passed 1409.10 sec
Start 16: ring_gap_permute2_TEST
13/18 Test #12: ring_gap_TEST .......................... Passed 1458.22 sec
Start 17: ring_permute2_cudaInterface_TEST
14/18 Test #13: ring_gap_binqueue_TEST ................. Passed 1463.66 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
15/18 Test #15: ring_gap_permute1_TEST ................. Passed 1445.73 sec
16/18 Test #16: ring_gap_permute2_TEST ................. Passed 94.45 sec
17/18 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 82.99 sec
18/18 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 89.88 sec
100% tests passed, 0 tests failed out of 18
Total Test time (real) = 1603.85 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640260154:step_script section_start:1640260154:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=60548 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114832 responseStatus=201 Created token=7MFF33pN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=60645 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114832 responseStatus=201 Created token=7MFF33pN
section_end:1640260156:upload_artifacts_on_success section_start:1640260156:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640260157:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640259993:resolve_secrets Resolving secrets
section_end:1640259993:resolve_secrets section_start:1640259993:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor115900806, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114852
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114852, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114852_PROD_P112_CP16_C17
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 145067
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=30750M --job-name=GL_J114852_PROD_P112_CP16_C17 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114852 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114852 --ntasks=16 --jobid=145067 --cpus-per-task=1 --mem=30750M
section_end:1640259995:prepare_executor section_start:1640259995:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640259996:prepare_script section_start:1640259996:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640259997:get_sources section_start:1640259997:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:gpu (114844)...
Runtime platform  arch=amd64 os=linux pid=52550 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114844 responseStatus=200 OK token=qCM31Hno
section_end:1640259999:download_artifacts section_start:1640259999:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n21
Build name: Linux-nvc++
Create new tag: 20211223-1147 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114844/_/spack-build/spack-stage-neuron-develop-btws4riobbseoweauaroqks3egxs5hg4/spack-build-btws4ri
Start 48: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 52: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 69: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 73: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 79: testcorenrn_gf::coreneuron_gpu_offline::preparation
Start 83: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 87: testcorenrn_patstim::coreneuron_gpu_offline::preparation
Start 89: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 125: testcorenrn_conc::coreneuron_gpu_offline::preparation
1/162 Test #63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 4.40 sec
Start 129: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/162 Test #59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 5.11 sec
Start 135: testcorenrn_kin::coreneuron_gpu_offline::preparation
3/162 Test #87: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 5.18 sec
Start 139: testcorenrn_kin::coreneuron_cpu_offline::preparation
4/162 Test #79: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 5.58 sec
Start 95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
5/162 Test #89: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 6.75 sec
Start 99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
6/162 Test #69: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 7.45 sec
Start 44: external_ringtest::neuron
7/162 Test #125: testcorenrn_conc::coreneuron_gpu_offline::preparation .............. Passed 7.65 sec
Start 55: testcorenrn_bbcore::neuron
8/162 Test #73: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 8.06 sec
Start 56: testcorenrn_bbcore::coreneuron_gpu_online
9/162 Test #129: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 4.10 sec
Start 57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
10/162 Test #83: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 8.57 sec
Start 115: testcorenrn_watch::coreneuron_gpu_offline::preparation
11/162 Test #139: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 3.37 sec
Start 58: testcorenrn_bbcore::coreneuron_gpu_offline
12/162 Test #135: testcorenrn_kin::coreneuron_gpu_offline::preparation ............... Passed 4.40 sec
Start 60: testcorenrn_bbcore::coreneuron_cpu_online
13/162 Test #99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 6.71 sec
Start 119: testcorenrn_watch::coreneuron_cpu_offline::preparation
14/162 Test #95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 8.18 sec
Start 45: external_ringtest::neuron_mpi
15/162 Test #55: testcorenrn_bbcore::neuron ......................................... Passed 6.20 sec
Start 61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
16/162 Test #44: external_ringtest::neuron .......................................... Passed 7.73 sec
Start 62: testcorenrn_bbcore::coreneuron_cpu_offline
17/162 Test #115: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 7.83 sec
Start 46: external_ringtest::coreneuron_cpu_mpi
18/162 Test #119: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 7.40 sec
Start 50: external_ringtest::coreneuron_gpu_mpi
19/162 Test #45: external_ringtest::neuron_mpi ...................................... Passed 8.37 sec
Start 65: testcorenrn_deriv::neuron
Start 66: testcorenrn_deriv::coreneuron_gpu_online
20/162 Test #65: testcorenrn_deriv::neuron .......................................... Passed 4.04 sec
Start 67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
21/162 Test #52: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 69.15 sec
Start 51: external_ringtest::coreneuron_gpu_mpi_offline
22/162 Test #48: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 69.41 sec
Start 47: external_ringtest::coreneuron_cpu_mpi_offline
23/162 Test #62: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 54.28 sec
Start 68: testcorenrn_deriv::coreneuron_gpu_offline
24/162 Test #61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 56.70 sec
Start 70: testcorenrn_deriv::coreneuron_cpu_online
25/162 Test #58: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 64.51 sec
Start 71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
26/162 Test #56: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 65.37 sec
Start 72: testcorenrn_deriv::coreneuron_cpu_offline
27/162 Test #66: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 52.69 sec
Start 86: testcorenrn_patstim::coreneuron_gpu_offline
28/162 Test #60: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 65.53 sec
Start 121: testcorenrn_conc::neuron
29/162 Test #46: external_ringtest::coreneuron_cpu_mpi .............................. Passed 63.28 sec
Start 75: testcorenrn_gf::neuron
30/162 Test #121: testcorenrn_conc::neuron ........................................... Passed 6.25 sec
Start 122: testcorenrn_conc::coreneuron_gpu_online
31/162 Test #75: testcorenrn_gf::neuron ............................................. Passed 6.65 sec
Start 76: testcorenrn_gf::coreneuron_gpu_online
32/162 Test #50: external_ringtest::coreneuron_gpu_mpi .............................. Passed 70.51 sec
Start 77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
33/162 Test #57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 83.10 sec
Start 123: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate
34/162 Test #67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 66.18 sec
Start 124: testcorenrn_conc::coreneuron_gpu_offline
35/162 Test #47: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 63.12 sec
Start 78: testcorenrn_gf::coreneuron_gpu_offline
36/162 Test #70: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 61.74 sec
Start 126: testcorenrn_conc::coreneuron_cpu_online
37/162 Test #68: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 65.10 sec
Start 127: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
38/162 Test #51: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 66.88 sec
Start 80: testcorenrn_gf::coreneuron_cpu_online
39/162 Test #72: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 63.19 sec
Start 128: testcorenrn_conc::coreneuron_cpu_offline
40/162 Test #71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 66.21 sec
Start 131: testcorenrn_kin::neuron
41/162 Test #86: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 66.70 sec
Start 132: testcorenrn_kin::coreneuron_gpu_online
42/162 Test #131: testcorenrn_kin::neuron ............................................ Passed 8.17 sec
Start 133: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate
43/162 Test #124: testcorenrn_conc::coreneuron_gpu_offline ........................... Passed 84.13 sec
Start 134: testcorenrn_kin::coreneuron_gpu_offline
44/162 Test #122: testcorenrn_conc::coreneuron_gpu_online ............................ Passed 95.28 sec
Start 136: testcorenrn_kin::coreneuron_cpu_online
45/162 Test #76: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 90.63 sec
Start 81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
46/162 Test #123: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate ........... Passed 85.55 sec
Start 137: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
47/162 Test #77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 85.81 sec
Start 82: testcorenrn_gf::coreneuron_cpu_offline
48/162 Test #127: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 68.30 sec
Start 138: testcorenrn_kin::coreneuron_cpu_offline
49/162 Test #128: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 71.19 sec
Start 144: channel_benchmark_hippo::neuron
50/162 Test #126: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 75.29 sec
Start 145: channel_benchmark_hippo::coreneuron_gpu_online
51/162 Test #80: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 72.46 sec
Start 85: testcorenrn_patstim::neuron
52/162 Test #132: testcorenrn_kin::coreneuron_gpu_online ............................. Passed 69.40 sec
Start 146: channel_benchmark_hippo::coreneuron_gpu_filemode
53/162 Test #85: testcorenrn_patstim::neuron ........................................ Passed 2.94 sec
Start 88: testcorenrn_patstim::coreneuron_cpu_offline
54/162 Test #78: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 79.47 sec
Start 91: testcorenrn_vecplay::neuron
55/162 Test #91: testcorenrn_vecplay::neuron ........................................ Passed 2.60 sec
Start 92: testcorenrn_vecplay::coreneuron_gpu_online
56/162 Test #136: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 64.93 sec
Start 147: channel_benchmark_hippo::coreneuron_cpu_online
57/162 Test #81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 65.11 sec
Start 93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
58/162 Test #137: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 65.03 sec
Start 148: channel_benchmark_hippo::coreneuron_cpu_filemode
59/162 Test #82: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 64.96 sec
Start 94: testcorenrn_vecplay::coreneuron_gpu_offline
60/162 Test #134: testcorenrn_kin::coreneuron_gpu_offline ............................ Passed 65.69 sec
Start 150: channel_benchmark_sscx::neuron
61/162 Test #133: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate ............ Passed 94.97 sec
Start 151: channel_benchmark_sscx::coreneuron_gpu_online
62/162 Test #138: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 64.77 sec
Start 152: channel_benchmark_sscx::coreneuron_gpu_filemode
63/162 Test #88: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 56.60 sec
Start 96: testcorenrn_vecplay::coreneuron_cpu_online
64/162 Test #92: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 92.16 sec
Start 97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
65/162 Test #144: channel_benchmark_hippo::neuron .................................... Passed 117.63 sec
Start 153: channel_benchmark_sscx::coreneuron_cpu_online
66/162 Test #94: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 100.82 sec
Start 98: testcorenrn_vecplay::coreneuron_cpu_offline
67/162 Test #150: channel_benchmark_sscx::neuron ..................................... Passed 136.59 sec
Start 154: channel_benchmark_sscx::coreneuron_cpu_filemode
68/162 Test #96: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 115.25 sec
Start 111: testcorenrn_watch::neuron
69/162 Test #93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 141.32 sec
Start 112: testcorenrn_watch::coreneuron_gpu_online
70/162 Test #111: testcorenrn_watch::neuron .......................................... Passed 2.29 sec
Start 113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
71/162 Test #145: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 183.73 sec
Start 1: testneuron
72/162 Test #1: testneuron ......................................................... Passed 0.07 sec
Start 2: ringtest
73/162 Test #2: ringtest ........................................................... Passed 0.26 sec
Start 3: connect_dend
74/162 Test #3: connect_dend ....................................................... Passed 0.15 sec
Start 4: pynrn_tests::basic_tests
75/162 Test #97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 88.69 sec
Start 114: testcorenrn_watch::coreneuron_gpu_offline
76/162 Test #4: pynrn_tests::basic_tests ........................................... Passed 8.79 sec
Start 5: rxdmod_tests::rxd_tests
77/162 Test #146: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 211.11 sec
Start 6: rxdmod_tests::rxd_mpi_tests
78/162 Test #98: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 82.50 sec
Start 116: testcorenrn_watch::coreneuron_cpu_online
79/162 Test #148: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 203.40 sec
Start 7: parallel_tests
80/162 Test #147: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 204.14 sec
Start 8: parallel_partrans
81/162 Test #151: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 203.22 sec
Start 9: parallel_bas
82/162 Test #152: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 189.71 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
83/162 Test #153: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 132.24 sec
Start 11: coreneuron_modtests::direct_py_cpu
84/162 Test #8: parallel_partrans .................................................. Passed 20.26 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
85/162 Test #114: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 70.89 sec
Start 117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
86/162 Test #112: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 85.79 sec
Start 118: testcorenrn_watch::coreneuron_cpu_offline
87/162 Test #7: parallel_tests ..................................................... Passed 29.95 sec
Start 13: coreneuron_modtests::spikes_py_cpu
88/162 Test #9: parallel_bas ....................................................... Passed 39.52 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
89/162 Test #154: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 126.25 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
90/162 Test #116: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 80.43 sec
Start 141: testcorenrn_netstimdirect::direct_netstimdirect
91/162 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 1.28 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
92/162 Test #113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 121.21 sec
Start 142: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
93/162 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 83.34 sec
Start 17: coreneuron_modtests::test_units_py_cpu
94/162 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 83.73 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
95/162 Test #118: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 77.20 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
Start 20: coreneuron_modtests::test_psolve_py_cpu
96/162 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 94.68 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
97/162 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 78.78 sec
Start 25: coreneuron_modtests::direct_py_gpu
98/162 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 89.65 sec
Start 26: coreneuron_modtests::direct_hoc_gpu
99/162 Test #117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 127.91 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
100/162 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 213.12 sec
Start 27: coreneuron_modtests::spikes_py_gpu
101/162 Test #141: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 118.79 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
102/162 Test #142: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 133.07 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
103/162 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 133.77 sec
Start 28: coreneuron_modtests::spikes_file_mode_py_gpu
104/162 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 99.50 sec
Start 29: coreneuron_modtests::fast_imem_py_gpu
105/162 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 99.65 sec
Start 30: coreneuron_modtests::datareturn_py_gpu
106/162 Test #29: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 2.21 sec
Start 31: coreneuron_modtests::test_units_py_gpu
107/162 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 114.59 sec
Start 32: coreneuron_modtests::test_netmove_py_gpu
108/162 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 116.44 sec
Start 33: coreneuron_modtests::test_watchrange_py_gpu
109/162 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 103.44 sec
Start 34: coreneuron_modtests::test_psolve_py_gpu
110/162 Test #25: coreneuron_modtests::direct_py_gpu ................................. Passed 101.28 sec
Start 35: coreneuron_modtests::test_natrans_py_gpu
111/162 Test #26: coreneuron_modtests::direct_hoc_gpu ................................ Passed 100.53 sec
Start 39: external_nrntest
112/162 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 266.47 sec
Start 64: testcorenrn_bbcore::compare_results
113/162 Test #64: testcorenrn_bbcore::compare_results ................................ Passed 0.14 sec
Start 74: testcorenrn_deriv::compare_results
114/162 Test #74: testcorenrn_deriv::compare_results ................................. Passed 0.14 sec
Start 84: testcorenrn_gf::compare_results
115/162 Test #84: testcorenrn_gf::compare_results .................................... Passed 0.06 sec
Start 90: testcorenrn_patstim::compare_results
116/162 Test #90: testcorenrn_patstim::compare_results ............................... Passed 0.09 sec
Start 100: testcorenrn_vecplay::compare_results
117/162 Test #100: testcorenrn_vecplay::compare_results ............................... Passed 0.19 sec
Start 120: testcorenrn_watch::compare_results
118/162 Test #120: testcorenrn_watch::compare_results ................................. Passed 0.17 sec
Start 130: testcorenrn_conc::compare_results
119/162 Test #130: testcorenrn_conc::compare_results .................................. Passed 0.14 sec
Start 140: testcorenrn_kin::compare_results
120/162 Test #140: testcorenrn_kin::compare_results ................................... Passed 0.09 sec
Start 143: testcorenrn_netstimdirect::compare_results
121/162 Test #143: testcorenrn_netstimdirect::compare_results ......................... Passed 0.09 sec
Start 149: channel_benchmark_hippo::compare_results
122/162 Test #149: channel_benchmark_hippo::compare_results ........................... Passed 0.09 sec
Start 155: channel_benchmark_sscx::compare_results
123/162 Test #155: channel_benchmark_sscx::compare_results ............................ Passed 0.05 sec
124/162 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 97.40 sec
Start 36: coreneuron_modtests::spikes_mpi_py_gpu
125/162 Test #27: coreneuron_modtests::spikes_py_gpu ................................. Passed 100.73 sec
Start 37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
126/162 Test #28: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 75.04 sec
127/162 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 91.24 sec
Start 38: coreneuron_modtests::inputpresyn_py_gpu
128/162 Test #31: coreneuron_modtests::test_units_py_gpu ............................. Passed 88.12 sec
129/162 Test #34: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 66.79 sec
130/162 Test #30: coreneuron_modtests::datareturn_py_gpu ............................. Passed 91.58 sec
Start 105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
131/162 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 94.76 sec
132/162 Test #33: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 71.77 sec
133/162 Test #105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 2.51 sec
Start 109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
134/162 Test #35: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 69.99 sec
Start 157: olfactory-bulb-3d::neuron::preparation
135/162 Test #157: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.04 sec
Start 159: olfactory-bulb-3d::coreneuron_gpu_online::preparation
136/162 Test #32: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 74.57 sec
137/162 Test #159: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.19 sec
Start 161: olfactory-bulb-3d::coreneuron_cpu_online::preparation
138/162 Test #161: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.20 sec
Start 40: reduced_dentate::neuron
139/162 Test #109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 2.70 sec
Start 41: reduced_dentate::coreneuron_cpu
140/162 Test #39: external_nrntest ................................................... Passed 82.54 sec
141/162 Test #40: reduced_dentate::neuron ............................................ Passed 13.55 sec
Start 42: reduced_dentate::coreneuron_gpu
142/162 Test #36: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 68.21 sec
Start 101: testcorenrn_vecevent::neuron
143/162 Test #101: testcorenrn_vecevent::neuron ....................................... Passed 2.04 sec
Start 102: testcorenrn_vecevent::coreneuron_gpu_online
144/162 Test #38: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 72.64 sec
145/162 Test #37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 74.46 sec
Start 103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
146/162 Test #41: reduced_dentate::coreneuron_cpu .................................... Passed 71.17 sec
Start 104: testcorenrn_vecevent::coreneuron_gpu_offline
147/162 Test #42: reduced_dentate::coreneuron_gpu .................................... Passed 59.47 sec
Start 106: testcorenrn_vecevent::coreneuron_cpu_online
148/162 Test #102: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 53.94 sec
Start 107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
149/162 Test #103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 77.64 sec
Start 108: testcorenrn_vecevent::coreneuron_cpu_offline
150/162 Test #106: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 83.89 sec
Start 156: olfactory-bulb-3d::neuron
151/162 Test #104: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 84.56 sec
Start 158: olfactory-bulb-3d::coreneuron_gpu_online
152/162 Test #107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 77.42 sec
Start 160: olfactory-bulb-3d::coreneuron_cpu_online
153/162 Test #108: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 85.53 sec
Start 43: reduced_dentate::compare_results
Start 110: testcorenrn_vecevent::compare_results
154/162 Test #110: testcorenrn_vecevent::compare_results .............................. Passed 0.06 sec
155/162 Test #43: reduced_dentate::compare_results ................................... Passed 0.06 sec
156/162 Test #156: olfactory-bulb-3d::neuron .......................................... Passed 104.88 sec
Start 49: external_ringtest::coreneuron_cpu_mpi_threads
157/162 Test #49: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 50.84 sec
Start 53: external_ringtest::coreneuron_gpu_mpi_threads
158/162 Test #158: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 156.63 sec
159/162 Test #160: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 162.82 sec
Start 162: olfactory-bulb-3d::compare_results
160/162 Test #162: olfactory-bulb-3d::compare_results ................................. Passed 1.77 sec
161/162 Test #53: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 17.81 sec
Start 54: external_ringtest::compare_results
162/162 Test #54: external_ringtest::compare_results ................................. Passed 2.07 sec
100% tests passed, 0 tests failed out of 162
Total Test time (real) = 1068.90 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640261126:step_script section_start:1640261126:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=4298 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114852 responseStatus=201 Created token=JNAeRHVA
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=4377 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114852 responseStatus=201 Created token=JNAeRHVA
section_end:1640261129:upload_artifacts_on_success section_start:1640261129:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640261130:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640259291:resolve_secrets Resolving secrets
section_end:1640259291:resolve_secrets section_start:1640259291:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor356565976, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114849
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114849, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114849_PROD_P112_CP13_C15
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 145003
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=30750M --job-name=GL_J114849_PROD_P112_CP13_C15 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114849 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114849 --ntasks=16 --jobid=145003 --cpus-per-task=1 --mem=30750M
section_end:1640259292:prepare_executor section_start:1640259292:prepare_script Preparing environment
Running on r1i5n30 via bbpv1.epfl.ch...
section_end:1640259296:prepare_script section_start:1640259296:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640259297:get_sources section_start:1640259297:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:intel (114838)...
Runtime platform  arch=amd64 os=linux pid=134583 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114838 responseStatus=200 OK token=xNjRYbK8
section_end:1640259298:download_artifacts section_start:1640259298:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n20
Build name: Linux-icpc
Create new tag: 20211223-1137 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114838/_/spack-build/spack-stage-neuron-develop-mvn7s3za436y6xrhbspwpy7pbewubnvm/spack-build-mvn7s3z
Start 33: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 46: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 52: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
Start 68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
Start 74: testcorenrn_watch::coreneuron_cpu_offline::preparation
1/103 Test #46: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 5.40 sec
Start 80: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/103 Test #40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 5.59 sec
Start 86: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/103 Test #74: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 8.23 sec
Start 29: external_ringtest::neuron
Start 36: testcorenrn_bbcore::neuron
4/103 Test #62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 10.14 sec
Start 30: external_ringtest::neuron_mpi
5/103 Test #52: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 10.64 sec
Start 31: external_ringtest::coreneuron_cpu_mpi
6/103 Test #56: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 11.26 sec
Start 37: testcorenrn_bbcore::coreneuron_cpu_online
Start 38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
7/103 Test #68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 12.03 sec
Start 100: olfactory-bulb-3d::neuron::preparation
8/103 Test #100: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.65 sec
Start 102: olfactory-bulb-3d::coreneuron_cpu_online::preparation
9/103 Test #102: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.64 sec
Start 26: reduced_dentate::neuron
10/103 Test #80: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 7.97 sec
Start 39: testcorenrn_bbcore::coreneuron_cpu_offline
11/103 Test #33: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 13.71 sec
Start 32: external_ringtest::coreneuron_cpu_mpi_offline
12/103 Test #86: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 8.69 sec
Start 42: testcorenrn_deriv::neuron
13/103 Test #36: testcorenrn_bbcore::neuron ......................................... Passed 5.93 sec
Start 43: testcorenrn_deriv::coreneuron_cpu_online
14/103 Test #39: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 5.23 sec
Start 44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
15/103 Test #30: external_ringtest::neuron_mpi ...................................... Passed 11.06 sec
Start 45: testcorenrn_deriv::coreneuron_cpu_offline
Start 76: testcorenrn_conc::neuron
16/103 Test #29: external_ringtest::neuron .......................................... Passed 13.14 sec
Start 77: testcorenrn_conc::coreneuron_cpu_online
17/103 Test #32: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 7.86 sec
Start 48: testcorenrn_gf::neuron
18/103 Test #42: testcorenrn_deriv::neuron .......................................... Passed 8.38 sec
Start 78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
19/103 Test #31: external_ringtest::coreneuron_cpu_mpi .............................. Passed 12.32 sec
Start 49: testcorenrn_gf::coreneuron_cpu_online
20/103 Test #37: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 11.71 sec
Start 79: testcorenrn_conc::coreneuron_cpu_offline
21/103 Test #45: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 5.12 sec
Start 82: testcorenrn_kin::neuron
22/103 Test #38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 15.70 sec
Start 83: testcorenrn_kin::coreneuron_cpu_online
23/103 Test #43: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 17.00 sec
Start 84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
24/103 Test #79: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 9.85 sec
Start 85: testcorenrn_kin::coreneuron_cpu_offline
25/103 Test #48: testcorenrn_gf::neuron ............................................. Passed 12.75 sec
Start 50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
26/103 Test #26: reduced_dentate::neuron ............................................ Passed 21.78 sec
Start 27: reduced_dentate::coreneuron_cpu
27/103 Test #76: testcorenrn_conc::neuron ........................................... Passed 14.47 sec
Start 91: channel_benchmark_hippo::neuron
28/103 Test #82: testcorenrn_kin::neuron ............................................ Passed 9.35 sec
Start 92: channel_benchmark_hippo::coreneuron_cpu_online
29/103 Test #85: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 3.92 sec
Start 93: channel_benchmark_hippo::coreneuron_cpu_filemode
30/103 Test #44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 18.63 sec
Start 95: channel_benchmark_sscx::neuron
31/103 Test #77: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 17.48 sec
Start 96: channel_benchmark_sscx::coreneuron_cpu_online
32/103 Test #78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 18.80 sec
Start 97: channel_benchmark_sscx::coreneuron_cpu_filemode
33/103 Test #49: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 19.83 sec
Start 51: testcorenrn_gf::coreneuron_cpu_offline
34/103 Test #83: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 19.55 sec
Start 1: testneuron
35/103 Test #84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 16.02 sec
Start 2: ringtest
36/103 Test #1: testneuron ......................................................... Passed 1.98 sec
Start 3: connect_dend
37/103 Test #2: ringtest ........................................................... Passed 2.37 sec
Start 4: pynrn_tests::basic_tests
38/103 Test #3: connect_dend ....................................................... Passed 2.45 sec
Start 5: rxdmod_tests::rxd_tests
39/103 Test #51: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 9.66 sec
Start 54: testcorenrn_patstim::neuron
40/103 Test #50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 31.28 sec
Start 55: testcorenrn_patstim::coreneuron_cpu_offline
41/103 Test #54: testcorenrn_patstim::neuron ........................................ Passed 13.45 sec
Start 58: testcorenrn_vecplay::neuron
42/103 Test #55: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 6.38 sec
Start 59: testcorenrn_vecplay::coreneuron_cpu_online
43/103 Test #58: testcorenrn_vecplay::neuron ........................................ Passed 18.90 sec
Start 60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
44/103 Test #59: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 44.62 sec
Start 61: testcorenrn_vecplay::coreneuron_cpu_offline
45/103 Test #4: pynrn_tests::basic_tests ........................................... Passed 67.19 sec
Start 6: rxdmod_tests::rxd_mpi_tests
46/103 Test #61: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 8.77 sec
Start 70: testcorenrn_watch::neuron
47/103 Test #60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 64.30 sec
Start 71: testcorenrn_watch::coreneuron_cpu_online
48/103 Test #70: testcorenrn_watch::neuron .......................................... Passed 23.85 sec
Start 72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
49/103 Test #27: reduced_dentate::coreneuron_cpu .................................... Passed 138.82 sec
Start 64: testcorenrn_vecevent::neuron
50/103 Test #71: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 30.13 sec
Start 73: testcorenrn_watch::coreneuron_cpu_offline
51/103 Test #73: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 9.10 sec
Start 88: testcorenrn_netstimdirect::direct_netstimdirect
52/103 Test #72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 41.10 sec
Start 89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
53/103 Test #64: testcorenrn_vecevent::neuron ....................................... Passed 19.40 sec
Start 65: testcorenrn_vecevent::coreneuron_cpu_online
54/103 Test #92: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 165.40 sec
Start 7: parallel_tests
55/103 Test #91: channel_benchmark_hippo::neuron .................................... Passed 165.71 sec
Start 8: parallel_partrans
56/103 Test #93: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 165.54 sec
Start 9: parallel_bas
57/103 Test #97: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 162.72 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
58/103 Test #96: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 165.47 sec
Start 11: coreneuron_modtests::direct_py_cpu
59/103 Test #95: channel_benchmark_sscx::neuron ..................................... Passed 167.11 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
60/103 Test #88: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 21.77 sec
Start 13: coreneuron_modtests::spikes_py_cpu
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
61/103 Test #89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 20.66 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
Start 16: coreneuron_modtests::datareturn_py_cpu
62/103 Test #65: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 31.13 sec
Start 66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
63/103 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 22.81 sec
Start 17: coreneuron_modtests::test_units_py_cpu
64/103 Test #8: parallel_partrans .................................................. Passed 28.20 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
65/103 Test #7: parallel_tests ..................................................... Passed 37.51 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
66/103 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 66.91 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
67/103 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 73.38 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
68/103 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 67.81 sec
Start 25: external_nrntest
69/103 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 69.93 sec
Start 28: reduced_dentate::compare_results
70/103 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 77.59 sec
Start 41: testcorenrn_bbcore::compare_results
71/103 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 71.16 sec
Start 47: testcorenrn_deriv::compare_results
72/103 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 55.66 sec
Start 53: testcorenrn_gf::compare_results
73/103 Test #28: reduced_dentate::compare_results ................................... Passed 2.16 sec
Start 57: testcorenrn_patstim::compare_results
74/103 Test #66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 59.35 sec
Start 67: testcorenrn_vecevent::coreneuron_cpu_offline
75/103 Test #47: testcorenrn_deriv::compare_results ................................. Passed 2.15 sec
Start 63: testcorenrn_vecplay::compare_results
76/103 Test #41: testcorenrn_bbcore::compare_results ................................ Passed 2.68 sec
Start 75: testcorenrn_watch::compare_results
77/103 Test #57: testcorenrn_patstim::compare_results ............................... Passed 2.12 sec
Start 81: testcorenrn_conc::compare_results
78/103 Test #75: testcorenrn_watch::compare_results ................................. Passed 2.04 sec
Start 87: testcorenrn_kin::compare_results
79/103 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 47.97 sec
Start 90: testcorenrn_netstimdirect::compare_results
80/103 Test #81: testcorenrn_conc::compare_results .................................. Passed 1.84 sec
Start 94: channel_benchmark_hippo::compare_results
81/103 Test #63: testcorenrn_vecplay::compare_results ............................... Passed 3.12 sec
Start 98: channel_benchmark_sscx::compare_results
82/103 Test #53: testcorenrn_gf::compare_results .................................... Passed 4.57 sec
83/103 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 58.28 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
84/103 Test #87: testcorenrn_kin::compare_results ................................... Passed 1.39 sec
85/103 Test #90: testcorenrn_netstimdirect::compare_results ......................... Passed 1.74 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
86/103 Test #98: channel_benchmark_sscx::compare_results ............................ Passed 1.20 sec
87/103 Test #94: channel_benchmark_hippo::compare_results ........................... Passed 1.61 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
88/103 Test #9: parallel_bas ....................................................... Passed 86.59 sec
89/103 Test #67: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 6.01 sec
Start 99: olfactory-bulb-3d::neuron
Start 69: testcorenrn_vecevent::compare_results
90/103 Test #69: testcorenrn_vecevent::compare_results .............................. Passed 1.99 sec
91/103 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 10.35 sec
92/103 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 13.36 sec
Start 101: olfactory-bulb-3d::coreneuron_cpu_online
93/103 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 13.39 sec
94/103 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 42.32 sec
95/103 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 49.95 sec
96/103 Test #99: olfactory-bulb-3d::neuron .......................................... Passed 102.33 sec
Start 34: external_ringtest::coreneuron_cpu_mpi_threads
97/103 Test #34: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 25.39 sec
Start 35: external_ringtest::compare_results
98/103 Test #35: external_ringtest::compare_results ................................. Passed 0.61 sec
99/103 Test #101: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 118.82 sec
Start 103: olfactory-bulb-3d::compare_results
100/103 Test #103: olfactory-bulb-3d::compare_results ................................. Passed 1.10 sec
101/103 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 400.63 sec
102/103 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 455.70 sec
103/103 Test #25: external_nrntest ................................................... Passed 513.65 sec
100% tests passed, 0 tests failed out of 103
Total Test time (real) = 793.08 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640260246:step_script section_start:1640260246:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=161962 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114849 responseStatus=201 Created token=mar5Bgus
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=162019 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114849 responseStatus=201 Created token=mar5Bgus
section_end:1640260247:upload_artifacts_on_success section_start:1640260247:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640260249:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640260443:resolve_secrets Resolving secrets
section_end:1640260443:resolve_secrets section_start:1640260443:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor965508993, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114850
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114850, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114850_PROD_P112_CP8_C13
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 145078
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=30750M --job-name=GL_J114850_PROD_P112_CP8_C13 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114850 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114850 --ntasks=16 --jobid=145078 --cpus-per-task=1 --mem=30750M
section_end:1640260445:prepare_executor section_start:1640260445:prepare_script Preparing environment
Running on ldir01u09.bbp.epfl.ch via bbpv1.epfl.ch...
section_end:1640260447:prepare_script section_start:1640260447:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640260448:get_sources section_start:1640260448:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl:gpu (114840)...
Runtime platform  arch=amd64 os=linux pid=66839 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114840 responseStatus=200 OK token=HSjGyK5J
section_end:1640260449:download_artifacts section_start:1640260449:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n32
Build name: Linux-nvc++
Create new tag: 20211223-1154 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114840/_/spack-build/spack-stage-neuron-develop-gmrkbryjpmglziazibefpq5zk5edkyfe/spack-build-gmrkbry
Start 48: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 52: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 69: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 73: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 79: testcorenrn_gf::coreneuron_gpu_offline::preparation
Start 83: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 87: testcorenrn_patstim::coreneuron_gpu_offline::preparation
Start 89: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 44: external_ringtest::neuron
1/142 Test #69: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 5.08 sec
Start 55: testcorenrn_bbcore::neuron
2/142 Test #59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 6.41 sec
Start 56: testcorenrn_bbcore::coreneuron_gpu_online
3/142 Test #73: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 7.39 sec
Start 57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
4/142 Test #83: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 8.44 sec
Start 95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
5/142 Test #87: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 10.29 sec
Start 58: testcorenrn_bbcore::coreneuron_gpu_offline
6/142 Test #89: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 12.06 sec
Start 99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
7/142 Test #79: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 13.54 sec
Start 115: testcorenrn_watch::coreneuron_gpu_offline::preparation
8/142 Test #63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 15.02 sec
Start 60: testcorenrn_bbcore::coreneuron_cpu_online
9/142 Test #55: testcorenrn_bbcore::neuron ......................................... Passed 12.53 sec
Start 61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
10/142 Test #44: external_ringtest::neuron .......................................... Passed 23.17 sec
Start 62: testcorenrn_bbcore::coreneuron_cpu_offline
11/142 Test #95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 15.07 sec
Start 119: testcorenrn_watch::coreneuron_cpu_offline::preparation
12/142 Test #115: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 12.86 sec
Start 45: external_ringtest::neuron_mpi
13/142 Test #99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 16.86 sec
Start 46: external_ringtest::coreneuron_cpu_mpi
14/142 Test #119: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 11.16 sec
Start 50: external_ringtest::coreneuron_gpu_mpi
15/142 Test #45: external_ringtest::neuron_mpi ...................................... Passed 11.17 sec
Start 65: testcorenrn_deriv::neuron
Start 66: testcorenrn_deriv::coreneuron_gpu_online
16/142 Test #65: testcorenrn_deriv::neuron .......................................... Passed 3.08 sec
Start 67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
17/142 Test #58: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 89.06 sec
Start 68: testcorenrn_deriv::coreneuron_gpu_offline
18/142 Test #62: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 76.43 sec
Start 70: testcorenrn_deriv::coreneuron_cpu_online
19/142 Test #48: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 99.80 sec
Start 47: external_ringtest::coreneuron_cpu_mpi_offline
20/142 Test #52: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 100.17 sec
Start 51: external_ringtest::coreneuron_gpu_mpi_offline
21/142 Test #56: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 93.73 sec
Start 71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
22/142 Test #60: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 85.20 sec
Start 72: testcorenrn_deriv::coreneuron_cpu_offline
23/142 Test #61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 82.74 sec
Start 86: testcorenrn_patstim::coreneuron_gpu_offline
24/142 Test #57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 112.33 sec
Start 124: channel_benchmark_hippo::neuron
25/142 Test #46: external_ringtest::coreneuron_cpu_mpi .............................. Passed 91.28 sec
Start 75: testcorenrn_gf::neuron
26/142 Test #66: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 83.10 sec
Start 125: channel_benchmark_hippo::coreneuron_gpu_online
27/142 Test #75: testcorenrn_gf::neuron ............................................. Passed 3.15 sec
Start 76: testcorenrn_gf::coreneuron_gpu_online
28/142 Test #50: external_ringtest::coreneuron_gpu_mpi .............................. Passed 115.44 sec
Start 77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
29/142 Test #67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 110.94 sec
Start 126: channel_benchmark_hippo::coreneuron_gpu_filemode
30/142 Test #124: channel_benchmark_hippo::neuron .................................... Passed 47.63 sec
Start 127: channel_benchmark_hippo::coreneuron_cpu_online
31/142 Test #68: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 100.30 sec
Start 128: channel_benchmark_hippo::coreneuron_cpu_filemode
32/142 Test #51: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 110.95 sec
Start 78: testcorenrn_gf::coreneuron_gpu_offline
33/142 Test #72: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 119.36 sec
Start 130: channel_benchmark_sscx::neuron
34/142 Test #70: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 120.14 sec
Start 131: channel_benchmark_sscx::coreneuron_gpu_online
35/142 Test #86: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 121.65 sec
Start 132: channel_benchmark_sscx::coreneuron_gpu_filemode
36/142 Test #71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 123.77 sec
Start 133: channel_benchmark_sscx::coreneuron_cpu_online
37/142 Test #47: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 125.41 sec
Start 80: testcorenrn_gf::coreneuron_cpu_online
38/142 Test #76: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 122.19 sec
Start 81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
39/142 Test #125: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 153.48 sec
Start 134: channel_benchmark_sscx::coreneuron_cpu_filemode
40/142 Test #77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 124.30 sec
Start 82: testcorenrn_gf::coreneuron_cpu_offline
41/142 Test #126: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 131.85 sec
Start 1: testneuron
42/142 Test #1: testneuron ......................................................... Passed 0.10 sec
Start 2: ringtest
43/142 Test #2: ringtest ........................................................... Passed 0.30 sec
Start 3: connect_dend
44/142 Test #3: connect_dend ....................................................... Passed 0.17 sec
Start 4: pynrn_tests::basic_tests
45/142 Test #4: pynrn_tests::basic_tests ........................................... Passed 9.80 sec
Start 5: rxdmod_tests::rxd_tests
46/142 Test #127: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 149.01 sec
Start 6: rxdmod_tests::rxd_mpi_tests
47/142 Test #78: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 105.95 sec
Start 85: testcorenrn_patstim::neuron
48/142 Test #85: testcorenrn_patstim::neuron ........................................ Passed 2.97 sec
Start 88: testcorenrn_patstim::coreneuron_cpu_offline
49/142 Test #130: channel_benchmark_sscx::neuron ..................................... Passed 107.64 sec
Start 7: parallel_tests
50/142 Test #7: parallel_tests ..................................................... Passed 7.47 sec
Start 8: parallel_partrans
51/142 Test #8: parallel_partrans .................................................. Passed 2.85 sec
Start 9: parallel_bas
52/142 Test #80: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 112.69 sec
Start 91: testcorenrn_vecplay::neuron
53/142 Test #81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 92.59 sec
Start 92: testcorenrn_vecplay::coreneuron_gpu_online
54/142 Test #128: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 138.49 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
55/142 Test #91: testcorenrn_vecplay::neuron ........................................ Passed 5.88 sec
Start 93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
56/142 Test #9: parallel_bas ....................................................... Passed 12.06 sec
Start 11: coreneuron_modtests::direct_py_cpu
57/142 Test #82: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 74.93 sec
Start 94: testcorenrn_vecplay::coreneuron_gpu_offline
58/142 Test #88: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 46.31 sec
Start 96: testcorenrn_vecplay::coreneuron_cpu_online
59/142 Test #133: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 142.60 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
60/142 Test #131: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 146.81 sec
Start 13: coreneuron_modtests::spikes_py_cpu
61/142 Test #132: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 144.71 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
62/142 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 54.93 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
63/142 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 43.84 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
64/142 Test #134: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 120.51 sec
Start 17: coreneuron_modtests::test_units_py_cpu
65/142 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 2.15 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
66/142 Test #92: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 60.77 sec
Start 97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
67/142 Test #94: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 74.66 sec
Start 98: testcorenrn_vecplay::coreneuron_cpu_offline
68/142 Test #93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 80.41 sec
Start 111: testcorenrn_watch::neuron
69/142 Test #111: testcorenrn_watch::neuron .......................................... Passed 2.34 sec
Start 112: testcorenrn_watch::coreneuron_gpu_online
70/142 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 73.54 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
71/142 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 74.20 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
72/142 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 82.04 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
73/142 Test #96: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 91.68 sec
Start 113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
74/142 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 75.02 sec
Start 25: coreneuron_modtests::direct_py_gpu
75/142 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 74.80 sec
Start 26: coreneuron_modtests::direct_hoc_gpu
76/142 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 84.82 sec
Start 27: coreneuron_modtests::spikes_py_gpu
77/142 Test #97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 80.71 sec
Start 114: testcorenrn_watch::coreneuron_gpu_offline
78/142 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 209.48 sec
Start 28: coreneuron_modtests::spikes_file_mode_py_gpu
79/142 Test #98: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 81.98 sec
Start 116: testcorenrn_watch::coreneuron_cpu_online
80/142 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 71.40 sec
Start 29: coreneuron_modtests::fast_imem_py_gpu
81/142 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 70.89 sec
Start 30: coreneuron_modtests::datareturn_py_gpu
82/142 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 65.19 sec
Start 31: coreneuron_modtests::test_units_py_gpu
83/142 Test #29: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 4.20 sec
Start 32: coreneuron_modtests::test_netmove_py_gpu
84/142 Test #26: coreneuron_modtests::direct_hoc_gpu ................................ Passed 50.79 sec
Start 33: coreneuron_modtests::test_watchrange_py_gpu
85/142 Test #25: coreneuron_modtests::direct_py_gpu ................................. Passed 57.64 sec
Start 34: coreneuron_modtests::test_psolve_py_gpu
86/142 Test #27: coreneuron_modtests::spikes_py_gpu ................................. Passed 49.35 sec
Start 35: coreneuron_modtests::test_natrans_py_gpu
87/142 Test #112: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 101.74 sec
Start 117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
88/142 Test #114: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 68.79 sec
Start 118: testcorenrn_watch::coreneuron_cpu_offline
89/142 Test #113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 90.59 sec
Start 121: testcorenrn_netstimdirect::direct_netstimdirect
90/142 Test #28: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 63.11 sec
Start 39: external_nrntest
91/142 Test #31: coreneuron_modtests::test_units_py_gpu ............................. Passed 53.25 sec
Start 64: testcorenrn_bbcore::compare_results
92/142 Test #64: testcorenrn_bbcore::compare_results ................................ Passed 0.10 sec
Start 74: testcorenrn_deriv::compare_results
93/142 Test #74: testcorenrn_deriv::compare_results ................................. Passed 0.11 sec
Start 84: testcorenrn_gf::compare_results
94/142 Test #84: testcorenrn_gf::compare_results .................................... Passed 0.42 sec
Start 90: testcorenrn_patstim::compare_results
95/142 Test #90: testcorenrn_patstim::compare_results ............................... Passed 0.66 sec
Start 100: testcorenrn_vecplay::compare_results
96/142 Test #116: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 61.96 sec
Start 122: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
97/142 Test #100: testcorenrn_vecplay::compare_results ............................... Passed 1.27 sec
Start 129: channel_benchmark_hippo::compare_results
98/142 Test #129: channel_benchmark_hippo::compare_results ........................... Passed 1.02 sec
Start 135: channel_benchmark_sscx::compare_results
99/142 Test #135: channel_benchmark_sscx::compare_results ............................ Passed 1.84 sec
100/142 Test #30: coreneuron_modtests::datareturn_py_gpu ............................. Passed 65.16 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
101/142 Test #32: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 63.47 sec
102/142 Test #33: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 59.02 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
103/142 Test #34: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 54.20 sec
104/142 Test #35: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 55.10 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
105/142 Test #117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 57.35 sec
Start 36: coreneuron_modtests::spikes_mpi_py_gpu
106/142 Test #118: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 43.83 sec
Start 37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
107/142 Test #121: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 45.39 sec
Start 38: coreneuron_modtests::inputpresyn_py_gpu
108/142 Test #122: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 32.28 sec
Start 120: testcorenrn_watch::compare_results
Start 123: testcorenrn_netstimdirect::compare_results
109/142 Test #123: testcorenrn_netstimdirect::compare_results ......................... Passed 0.73 sec
110/142 Test #120: testcorenrn_watch::compare_results ................................. Passed 0.76 sec
111/142 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 28.57 sec
Start 105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
112/142 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 23.80 sec
113/142 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 28.09 sec
Start 109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
114/142 Test #36: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 23.32 sec
115/142 Test #105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 8.14 sec
Start 137: olfactory-bulb-3d::neuron::preparation
116/142 Test #137: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.13 sec
Start 139: olfactory-bulb-3d::coreneuron_gpu_online::preparation
117/142 Test #139: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.65 sec
Start 141: olfactory-bulb-3d::coreneuron_cpu_online::preparation
118/142 Test #141: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.56 sec
Start 40: reduced_dentate::neuron
119/142 Test #109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 7.21 sec
Start 41: reduced_dentate::coreneuron_cpu
120/142 Test #37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 27.28 sec
Start 42: reduced_dentate::coreneuron_gpu
121/142 Test #38: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 26.96 sec
122/142 Test #40: reduced_dentate::neuron ............................................ Passed 29.67 sec
Start 49: external_ringtest::coreneuron_cpu_mpi_threads
123/142 Test #41: reduced_dentate::coreneuron_cpu .................................... Passed 37.73 sec
Start 101: testcorenrn_vecevent::neuron
124/142 Test #101: testcorenrn_vecevent::neuron ....................................... Passed 4.70 sec
Start 102: testcorenrn_vecevent::coreneuron_gpu_online
125/142 Test #42: reduced_dentate::coreneuron_gpu .................................... Passed 38.79 sec
Start 103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
126/142 Test #49: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 21.43 sec
Start 53: external_ringtest::coreneuron_gpu_mpi_threads
127/142 Test #102: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 24.84 sec
Start 104: testcorenrn_vecevent::coreneuron_gpu_offline
128/142 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 374.62 sec
Start 43: reduced_dentate::compare_results
129/142 Test #43: reduced_dentate::compare_results ................................... Passed 0.06 sec
130/142 Test #104: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 20.68 sec
Start 106: testcorenrn_vecevent::coreneuron_cpu_online
131/142 Test #53: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 38.84 sec
Start 107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
Start 54: external_ringtest::compare_results
132/142 Test #54: external_ringtest::compare_results ................................. Passed 2.09 sec
133/142 Test #103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 51.08 sec
Start 108: testcorenrn_vecevent::coreneuron_cpu_offline
134/142 Test #108: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 16.87 sec
Start 136: olfactory-bulb-3d::neuron
135/142 Test #106: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 23.85 sec
Start 138: olfactory-bulb-3d::coreneuron_gpu_online
136/142 Test #107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 22.00 sec
Start 140: olfactory-bulb-3d::coreneuron_cpu_online
Start 110: testcorenrn_vecevent::compare_results
137/142 Test #110: testcorenrn_vecevent::compare_results .............................. Passed 1.06 sec
138/142 Test #39: external_nrntest ................................................... Passed 219.73 sec
139/142 Test #136: olfactory-bulb-3d::neuron .......................................... Passed 169.72 sec
140/142 Test #138: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 197.54 sec
141/142 Test #140: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 199.92 sec
Start 142: olfactory-bulb-3d::compare_results
142/142 Test #142: olfactory-bulb-3d::compare_results ................................. Passed 0.24 sec
100% tests passed, 0 tests failed out of 142
Total Test time (real) = 927.43 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640261418:step_script section_start:1640261418:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=12508 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114850 responseStatus=201 Created token=X8LmMETB
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=12560 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114850 responseStatus=201 Created token=X8LmMETB
section_end:1640261419:upload_artifacts_on_success section_start:1640261419:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640261420:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640262703:resolve_secrets Resolving secrets
section_end:1640262703:resolve_secrets section_start:1640262703:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor521097577, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114847
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114847, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114847_PROD_P112_CP14_C16
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 145291
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=30750M --job-name=GL_J114847_PROD_P112_CP14_C16 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114847 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114847 --ntasks=16 --jobid=145291 --cpus-per-task=1 --mem=30750M
section_end:1640262704:prepare_executor section_start:1640262704:prepare_script Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1640262708:prepare_script section_start:1640262708:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640262709:get_sources section_start:1640262709:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl:intel (114837)...
Runtime platform  arch=amd64 os=linux pid=251436 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114837 responseStatus=200 OK token=Au-kFzLA
section_end:1640262711:download_artifacts section_start:1640262711:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i4n16
Build name: Linux-icpc
Create new tag: 20211223-1235 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114837/_/spack-build/spack-stage-neuron-develop-jhigcl7ephcbe47kbyz2znl76v2kaeev/spack-build-jhigcl7
Start 33: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 46: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 52: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
Start 68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
Start 74: testcorenrn_watch::coreneuron_cpu_offline::preparation
1/103 Test #46: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 10.00 sec
Start 80: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/103 Test #40: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 10.48 sec
Start 86: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/103 Test #74: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 11.30 sec
Start 29: external_ringtest::neuron
Start 36: testcorenrn_bbcore::neuron
4/103 Test #52: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 14.24 sec
Start 30: external_ringtest::neuron_mpi
5/103 Test #56: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 14.35 sec
Start 31: external_ringtest::coreneuron_cpu_mpi
6/103 Test #62: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 14.40 sec
Start 37: testcorenrn_bbcore::coreneuron_cpu_online
Start 38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
7/103 Test #68: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 14.81 sec
Start 100: olfactory-bulb-3d::neuron::preparation
8/103 Test #86: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 4.44 sec
Start 39: testcorenrn_bbcore::coreneuron_cpu_offline
9/103 Test #100: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.13 sec
Start 102: olfactory-bulb-3d::coreneuron_cpu_online::preparation
10/103 Test #102: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.13 sec
Start 26: reduced_dentate::neuron
11/103 Test #36: testcorenrn_bbcore::neuron ......................................... Passed 4.03 sec
Start 42: testcorenrn_deriv::neuron
12/103 Test #80: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 5.52 sec
Start 43: testcorenrn_deriv::coreneuron_cpu_online
13/103 Test #33: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 16.61 sec
Start 32: external_ringtest::coreneuron_cpu_mpi_offline
14/103 Test #39: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 2.35 sec
Start 44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
15/103 Test #29: external_ringtest::neuron .......................................... Passed 7.69 sec
Start 45: testcorenrn_deriv::coreneuron_cpu_offline
16/103 Test #38: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 6.42 sec
Start 76: testcorenrn_conc::neuron
17/103 Test #37: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 7.52 sec
Start 77: testcorenrn_conc::coreneuron_cpu_online
18/103 Test #45: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 5.88 sec
Start 78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
19/103 Test #32: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 8.98 sec
Start 48: testcorenrn_gf::neuron
20/103 Test #42: testcorenrn_deriv::neuron .......................................... Passed 11.77 sec
Start 79: testcorenrn_conc::coreneuron_cpu_offline
21/103 Test #31: external_ringtest::coreneuron_cpu_mpi .............................. Passed 13.78 sec
Start 49: testcorenrn_gf::coreneuron_cpu_online
22/103 Test #76: testcorenrn_conc::neuron ........................................... Passed 9.40 sec
Start 82: testcorenrn_kin::neuron
23/103 Test #30: external_ringtest::neuron_mpi ...................................... Passed 16.57 sec
Start 50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
24/103 Test #79: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 4.31 sec
Start 83: testcorenrn_kin::coreneuron_cpu_online
25/103 Test #44: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 17.15 sec
Start 84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
26/103 Test #43: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 19.40 sec
Start 85: testcorenrn_kin::coreneuron_cpu_offline
27/103 Test #48: testcorenrn_gf::neuron ............................................. Passed 10.14 sec
Start 51: testcorenrn_gf::coreneuron_cpu_offline
28/103 Test #77: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 15.03 sec
Start 91: channel_benchmark_hippo::neuron
29/103 Test #82: testcorenrn_kin::neuron ............................................ Passed 7.35 sec
Start 92: channel_benchmark_hippo::coreneuron_cpu_online
30/103 Test #26: reduced_dentate::neuron ............................................ Passed 24.10 sec
Start 27: reduced_dentate::coreneuron_cpu
31/103 Test #85: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 4.58 sec
Start 93: channel_benchmark_hippo::coreneuron_cpu_filemode
32/103 Test #78: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 15.47 sec
Start 95: channel_benchmark_sscx::neuron
33/103 Test #51: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 6.69 sec
Start 54: testcorenrn_patstim::neuron
34/103 Test #49: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 14.96 sec
Start 55: testcorenrn_patstim::coreneuron_cpu_offline
35/103 Test #83: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 11.82 sec
Start 96: channel_benchmark_sscx::coreneuron_cpu_online
36/103 Test #84: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 13.58 sec
Start 97: channel_benchmark_sscx::coreneuron_cpu_filemode
37/103 Test #55: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 7.84 sec
Start 58: testcorenrn_vecplay::neuron
38/103 Test #54: testcorenrn_patstim::neuron ........................................ Passed 10.86 sec
Start 59: testcorenrn_vecplay::coreneuron_cpu_online
39/103 Test #58: testcorenrn_vecplay::neuron ........................................ Passed 5.86 sec
Start 60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
40/103 Test #50: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 31.86 sec
Start 61: testcorenrn_vecplay::coreneuron_cpu_offline
41/103 Test #59: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 9.70 sec
Start 70: testcorenrn_watch::neuron
42/103 Test #61: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 6.01 sec
Start 71: testcorenrn_watch::coreneuron_cpu_online
43/103 Test #70: testcorenrn_watch::neuron .......................................... Passed 6.17 sec
Start 72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
44/103 Test #60: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 21.39 sec
Start 73: testcorenrn_watch::coreneuron_cpu_offline
45/103 Test #71: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 12.21 sec
Start 88: testcorenrn_netstimdirect::direct_netstimdirect
46/103 Test #73: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 6.47 sec
Start 89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
47/103 Test #88: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 16.18 sec
Start 1: testneuron
Start 2: ringtest
48/103 Test #72: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 28.18 sec
Start 3: connect_dend
Start 4: pynrn_tests::basic_tests
49/103 Test #1: testneuron ......................................................... Passed 0.46 sec
Start 5: rxdmod_tests::rxd_tests
50/103 Test #3: connect_dend ....................................................... Passed 2.59 sec
Start 6: rxdmod_tests::rxd_mpi_tests
51/103 Test #2: ringtest ........................................................... Passed 3.05 sec
Start 7: parallel_tests
52/103 Test #89: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 36.32 sec
Start 8: parallel_partrans
Start 9: parallel_bas
53/103 Test #7: parallel_tests ..................................................... Passed 41.79 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
54/103 Test #8: parallel_partrans .................................................. Passed 35.73 sec
Start 11: coreneuron_modtests::direct_py_cpu
55/103 Test #4: pynrn_tests::basic_tests ........................................... Passed 68.04 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
56/103 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 16.83 sec
Start 13: coreneuron_modtests::spikes_py_cpu
57/103 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 60.57 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
58/103 Test #96: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 165.87 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
59/103 Test #92: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 173.78 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
60/103 Test #97: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 163.85 sec
Start 17: coreneuron_modtests::test_units_py_cpu
61/103 Test #95: channel_benchmark_sscx::neuron ..................................... Passed 171.61 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
62/103 Test #91: channel_benchmark_hippo::neuron .................................... Passed 176.44 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
63/103 Test #93: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 174.51 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
64/103 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 59.78 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
65/103 Test #27: reduced_dentate::coreneuron_cpu .................................... Passed 196.59 sec
Start 64: testcorenrn_vecevent::neuron
66/103 Test #9: parallel_bas ....................................................... Passed 115.65 sec
Start 25: external_nrntest
67/103 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 54.41 sec
Start 28: reduced_dentate::compare_results
68/103 Test #28: reduced_dentate::compare_results ................................... Passed 1.94 sec
Start 41: testcorenrn_bbcore::compare_results
69/103 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 37.45 sec
Start 47: testcorenrn_deriv::compare_results
70/103 Test #41: testcorenrn_bbcore::compare_results ................................ Passed 4.98 sec
Start 53: testcorenrn_gf::compare_results
71/103 Test #47: testcorenrn_deriv::compare_results ................................. Passed 3.62 sec
Start 57: testcorenrn_patstim::compare_results
72/103 Test #53: testcorenrn_gf::compare_results .................................... Passed 3.80 sec
Start 63: testcorenrn_vecplay::compare_results
73/103 Test #57: testcorenrn_patstim::compare_results ............................... Passed 3.60 sec
Start 75: testcorenrn_watch::compare_results
74/103 Test #64: testcorenrn_vecevent::neuron ....................................... Passed 14.85 sec
Start 65: testcorenrn_vecevent::coreneuron_cpu_online
75/103 Test #75: testcorenrn_watch::compare_results ................................. Passed 3.20 sec
Start 81: testcorenrn_conc::compare_results
76/103 Test #63: testcorenrn_vecplay::compare_results ............................... Passed 4.27 sec
Start 87: testcorenrn_kin::compare_results
77/103 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 45.02 sec
Start 90: testcorenrn_netstimdirect::compare_results
78/103 Test #81: testcorenrn_conc::compare_results .................................. Passed 5.29 sec
Start 94: channel_benchmark_hippo::compare_results
79/103 Test #87: testcorenrn_kin::compare_results ................................... Passed 5.70 sec
Start 98: channel_benchmark_sscx::compare_results
80/103 Test #90: testcorenrn_netstimdirect::compare_results ......................... Passed 3.41 sec
81/103 Test #94: channel_benchmark_hippo::compare_results ........................... Passed 3.31 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
82/103 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 48.02 sec
83/103 Test #98: channel_benchmark_sscx::compare_results ............................ Passed 2.54 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
84/103 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 46.85 sec
85/103 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 46.89 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
86/103 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 49.44 sec
87/103 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 44.99 sec
88/103 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 57.04 sec
89/103 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 19.54 sec
Start 66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
90/103 Test #65: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 36.21 sec
Start 67: testcorenrn_vecevent::coreneuron_cpu_offline
91/103 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 28.61 sec
92/103 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 29.17 sec
Start 99: olfactory-bulb-3d::neuron
93/103 Test #67: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 9.76 sec
Start 101: olfactory-bulb-3d::coreneuron_cpu_online
94/103 Test #66: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 27.09 sec
Start 69: testcorenrn_vecevent::compare_results
95/103 Test #69: testcorenrn_vecevent::compare_results .............................. Passed 6.68 sec
96/103 Test #99: olfactory-bulb-3d::neuron .......................................... Passed 101.34 sec
Start 34: external_ringtest::coreneuron_cpu_mpi_threads
97/103 Test #101: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 117.89 sec
Start 103: olfactory-bulb-3d::compare_results
98/103 Test #103: olfactory-bulb-3d::compare_results ................................. Passed 2.70 sec
99/103 Test #34: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 28.25 sec
Start 35: external_ringtest::compare_results
100/103 Test #35: external_ringtest::compare_results ................................. Passed 1.24 sec
101/103 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 662.74 sec
102/103 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 681.65 sec
103/103 Test #25: external_nrntest ................................................... Passed 830.01 sec
100% tests passed, 0 tests failed out of 103
Total Test time (real) = 1066.83 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640263995:step_script section_start:1640263995:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=284481 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114847 responseStatus=201 Created token=rNiu8_xp
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=284538 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114847 responseStatus=201 Created token=rNiu8_xp
section_end:1640263997:upload_artifacts_on_success section_start:1640263997:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640263999:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640262036:resolve_secrets Resolving secrets
section_end:1640262036:resolve_secrets section_start:1640262036:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor372958854, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30395, build ref 0281e0edc6c227d5d57ed963b08a6ecd528ab79f, job ID 114851
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114851, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J114851_PROD_P112_CP15_C14
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 145215
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J114851_PROD_P112_CP15_C14 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114851 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30395/J114851 --ntasks=8 --jobid=145215 --cpus-per-task=1 --mem=30750M
section_end:1640262038:prepare_executor section_start:1640262038:prepare_script Preparing environment
Running on r2i3n1 via bbpv1.epfl.ch...
section_end:1640262040:prepare_script section_start:1640262040:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640262041:get_sources section_start:1640262041:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron+nmodl~openmp:gpu (114842)...
Runtime platform  arch=amd64 os=linux pid=161942 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114842 responseStatus=200 OK token=rbf5-kDC
section_end:1640262042:download_artifacts section_start:1640262042:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n30
Build name: Linux-nvc++
Create new tag: 20211223-1221 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30395/J114842/_/spack-build/spack-stage-neuron-develop-fwu47zj5ksgprg63usqqvmnfvuvjnlmc/spack-build-fwu47zj
Start 48: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 52: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 69: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 73: testcorenrn_deriv::coreneuron_cpu_offline::preparation
1/142 Test #59: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 2.58 sec
Start 87: testcorenrn_patstim::coreneuron_gpu_offline::preparation
2/142 Test #73: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.93 sec
Start 44: external_ringtest::neuron
3/142 Test #69: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 2.98 sec
Start 55: testcorenrn_bbcore::neuron
4/142 Test #63: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 3.00 sec
Start 56: testcorenrn_bbcore::coreneuron_gpu_online
5/142 Test #52: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 4.58 sec
Start 79: testcorenrn_gf::coreneuron_gpu_offline::preparation
6/142 Test #87: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 2.02 sec
Start 57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
7/142 Test #44: external_ringtest::neuron .......................................... Passed 1.67 sec
Start 58: testcorenrn_bbcore::coreneuron_gpu_offline
8/142 Test #48: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 4.68 sec
Start 83: testcorenrn_gf::coreneuron_cpu_offline::preparation
9/142 Test #55: testcorenrn_bbcore::neuron ......................................... Passed 1.96 sec
Start 60: testcorenrn_bbcore::coreneuron_cpu_online
10/142 Test #56: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 2.85 sec
Start 61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
11/142 Test #58: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 3.12 sec
Start 62: testcorenrn_bbcore::coreneuron_cpu_offline
12/142 Test #83: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 3.68 sec
Start 89: testcorenrn_patstim::coreneuron_cpu_offline::preparation
13/142 Test #79: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 4.11 sec
Start 95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
14/142 Test #60: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 5.14 sec
Start 65: testcorenrn_deriv::neuron
15/142 Test #62: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 2.49 sec
Start 66: testcorenrn_deriv::coreneuron_gpu_online
16/142 Test #89: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 3.11 sec
Start 99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
17/142 Test #57: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 6.93 sec
Start 67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
18/142 Test #61: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 5.71 sec
Start 68: testcorenrn_deriv::coreneuron_gpu_offline
19/142 Test #95: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 2.93 sec
Start 115: testcorenrn_watch::coreneuron_gpu_offline::preparation
20/142 Test #65: testcorenrn_deriv::neuron .......................................... Passed 1.75 sec
Start 70: testcorenrn_deriv::coreneuron_cpu_online
21/142 Test #66: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 2.94 sec
Start 71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
22/142 Test #68: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 3.41 sec
Start 72: testcorenrn_deriv::coreneuron_cpu_offline
23/142 Test #99: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 3.58 sec
Start 119: testcorenrn_watch::coreneuron_cpu_offline::preparation
24/142 Test #115: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 3.69 sec
Start 45: external_ringtest::neuron_mpi
25/142 Test #70: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 4.57 sec
Start 86: testcorenrn_patstim::coreneuron_gpu_offline
26/142 Test #72: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 2.24 sec
Start 124: channel_benchmark_hippo::neuron
27/142 Test #119: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 3.03 sec
Start 46: external_ringtest::coreneuron_cpu_mpi
28/142 Test #67: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 7.42 sec
Start 125: channel_benchmark_hippo::coreneuron_gpu_online
29/142 Test #71: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 6.05 sec
Start 126: channel_benchmark_hippo::coreneuron_gpu_filemode
30/142 Test #86: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 4.22 sec
Start 127: channel_benchmark_hippo::coreneuron_cpu_online
31/142 Test #45: external_ringtest::neuron_mpi ...................................... Passed 6.60 sec
Start 47: external_ringtest::coreneuron_cpu_mpi_offline
32/142 Test #47: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 15.65 sec
Start 50: external_ringtest::coreneuron_gpu_mpi
33/142 Test #46: external_ringtest::coreneuron_cpu_mpi .............................. Passed 20.68 sec
Start 51: external_ringtest::coreneuron_gpu_mpi_offline
34/142 Test #51: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 21.05 sec
Start 75: testcorenrn_gf::neuron
35/142 Test #50: external_ringtest::coreneuron_gpu_mpi .............................. Passed 33.56 sec
Start 76: testcorenrn_gf::coreneuron_gpu_online
36/142 Test #75: testcorenrn_gf::neuron ............................................. Passed 11.49 sec
Start 77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
37/142 Test #124: channel_benchmark_hippo::neuron .................................... Passed 88.29 sec
Start 128: channel_benchmark_hippo::coreneuron_cpu_filemode
38/142 Test #127: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 125.52 sec
Start 130: channel_benchmark_sscx::neuron
39/142 Test #125: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 127.71 sec
Start 131: channel_benchmark_sscx::coreneuron_gpu_online
40/142 Test #126: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 127.48 sec
Start 132: channel_benchmark_sscx::coreneuron_gpu_filemode
41/142 Test #77: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 79.43 sec
Start 78: testcorenrn_gf::coreneuron_gpu_offline
42/142 Test #76: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 99.62 sec
Start 80: testcorenrn_gf::coreneuron_cpu_online
43/142 Test #128: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 90.47 sec
Start 133: channel_benchmark_sscx::coreneuron_cpu_online
44/142 Test #130: channel_benchmark_sscx::neuron ..................................... Passed 68.73 sec
Start 134: channel_benchmark_sscx::coreneuron_cpu_filemode
45/142 Test #78: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 76.20 sec
Start 81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
46/142 Test #80: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 56.60 sec
Start 82: testcorenrn_gf::coreneuron_cpu_offline
47/142 Test #131: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 117.02 sec
Start 1: testneuron
48/142 Test #132: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 117.07 sec
Start 2: ringtest
49/142 Test #1: testneuron ......................................................... Passed 0.09 sec
Start 3: connect_dend
50/142 Test #3: connect_dend ....................................................... Passed 0.22 sec
Start 4: pynrn_tests::basic_tests
51/142 Test #2: ringtest ........................................................... Passed 0.34 sec
Start 5: rxdmod_tests::rxd_tests
52/142 Test #82: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 38.33 sec
Start 85: testcorenrn_patstim::neuron
53/142 Test #81: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 40.12 sec
Start 88: testcorenrn_patstim::coreneuron_cpu_offline
54/142 Test #85: testcorenrn_patstim::neuron ........................................ Passed 3.75 sec
Start 91: testcorenrn_vecplay::neuron
55/142 Test #91: testcorenrn_vecplay::neuron ........................................ Passed 1.93 sec
Start 92: testcorenrn_vecplay::coreneuron_gpu_online
56/142 Test #4: pynrn_tests::basic_tests ........................................... Passed 11.25 sec
Start 6: rxdmod_tests::rxd_mpi_tests
57/142 Test #133: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 79.57 sec
Start 7: parallel_tests
58/142 Test #134: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 60.82 sec
Start 8: parallel_partrans
59/142 Test #8: parallel_partrans .................................................. Passed 7.24 sec
Start 9: parallel_bas
60/142 Test #7: parallel_tests ..................................................... Passed 7.53 sec
Start 10: coreneuron_modtests::fornetcon_py_cpu
61/142 Test #9: parallel_bas ....................................................... Passed 4.56 sec
Start 11: coreneuron_modtests::direct_py_cpu
62/142 Test #88: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 36.68 sec
Start 93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
63/142 Test #92: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 41.52 sec
Start 94: testcorenrn_vecplay::coreneuron_gpu_offline
64/142 Test #10: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 42.22 sec
Start 12: coreneuron_modtests::direct_hoc_cpu
65/142 Test #11: coreneuron_modtests::direct_py_cpu ................................. Passed 37.95 sec
Start 13: coreneuron_modtests::spikes_py_cpu
66/142 Test #94: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 46.07 sec
Start 96: testcorenrn_vecplay::coreneuron_cpu_online
67/142 Test #12: coreneuron_modtests::direct_hoc_cpu ................................ Passed 43.46 sec
Start 14: coreneuron_modtests::spikes_file_mode_py_cpu
68/142 Test #93: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 66.88 sec
Start 97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
69/142 Test #13: coreneuron_modtests::spikes_py_cpu ................................. Passed 46.98 sec
Start 15: coreneuron_modtests::fast_imem_py_cpu
70/142 Test #15: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 1.99 sec
Start 16: coreneuron_modtests::datareturn_py_cpu
71/142 Test #14: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 41.70 sec
Start 17: coreneuron_modtests::test_units_py_cpu
72/142 Test #96: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 52.73 sec
Start 98: testcorenrn_vecplay::coreneuron_cpu_offline
73/142 Test #97: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 41.79 sec
Start 111: testcorenrn_watch::neuron
74/142 Test #111: testcorenrn_watch::neuron .......................................... Passed 2.34 sec
Start 112: testcorenrn_watch::coreneuron_gpu_online
75/142 Test #16: coreneuron_modtests::datareturn_py_cpu ............................. Passed 45.22 sec
Start 18: coreneuron_modtests::test_netmove_py_cpu
76/142 Test #17: coreneuron_modtests::test_units_py_cpu ............................. Passed 44.43 sec
Start 19: coreneuron_modtests::test_watchrange_py_cpu
77/142 Test #98: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 44.54 sec
Start 113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
78/142 Test #112: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 54.52 sec
Start 114: testcorenrn_watch::coreneuron_gpu_offline
79/142 Test #18: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 56.06 sec
Start 20: coreneuron_modtests::test_psolve_py_cpu
80/142 Test #19: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 33.85 sec
Start 21: coreneuron_modtests::test_natrans_py_cpu
81/142 Test #20: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 15.58 sec
Start 25: coreneuron_modtests::direct_py_gpu
82/142 Test #21: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 4.72 sec
Start 26: coreneuron_modtests::direct_hoc_gpu
83/142 Test #5: rxdmod_tests::rxd_tests ............................................ Passed 232.35 sec
Start 27: coreneuron_modtests::spikes_py_gpu
84/142 Test #114: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 28.75 sec
Start 116: testcorenrn_watch::coreneuron_cpu_online
85/142 Test #113: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 42.95 sec
Start 117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
86/142 Test #25: coreneuron_modtests::direct_py_gpu ................................. Passed 8.04 sec
Start 28: coreneuron_modtests::spikes_file_mode_py_gpu
87/142 Test #26: coreneuron_modtests::direct_hoc_gpu ................................ Passed 6.15 sec
Start 29: coreneuron_modtests::fast_imem_py_gpu
88/142 Test #29: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 3.12 sec
Start 30: coreneuron_modtests::datareturn_py_gpu
89/142 Test #27: coreneuron_modtests::spikes_py_gpu ................................. Passed 7.46 sec
Start 31: coreneuron_modtests::test_units_py_gpu
90/142 Test #116: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 10.36 sec
Start 118: testcorenrn_watch::coreneuron_cpu_offline
91/142 Test #31: coreneuron_modtests::test_units_py_gpu ............................. Passed 5.03 sec
Start 32: coreneuron_modtests::test_netmove_py_gpu
92/142 Test #28: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 10.39 sec
Start 33: coreneuron_modtests::test_watchrange_py_gpu
93/142 Test #117: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 12.16 sec
Start 121: testcorenrn_netstimdirect::direct_netstimdirect
94/142 Test #30: coreneuron_modtests::datareturn_py_gpu ............................. Passed 9.05 sec
Start 34: coreneuron_modtests::test_psolve_py_gpu
95/142 Test #118: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 5.87 sec
Start 122: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
96/142 Test #33: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 4.92 sec
Start 35: coreneuron_modtests::test_natrans_py_gpu
97/142 Test #34: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 3.13 sec
Start 39: external_nrntest
98/142 Test #32: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 11.52 sec
Start 64: testcorenrn_bbcore::compare_results
99/142 Test #64: testcorenrn_bbcore::compare_results ................................ Passed 0.26 sec
Start 74: testcorenrn_deriv::compare_results
100/142 Test #74: testcorenrn_deriv::compare_results ................................. Passed 0.28 sec
Start 84: testcorenrn_gf::compare_results
101/142 Test #84: testcorenrn_gf::compare_results .................................... Passed 0.28 sec
Start 90: testcorenrn_patstim::compare_results
102/142 Test #90: testcorenrn_patstim::compare_results ............................... Passed 0.36 sec
Start 100: testcorenrn_vecplay::compare_results
103/142 Test #100: testcorenrn_vecplay::compare_results ............................... Passed 0.26 sec
Start 120: testcorenrn_watch::compare_results
104/142 Test #120: testcorenrn_watch::compare_results ................................. Passed 0.15 sec
Start 129: channel_benchmark_hippo::compare_results
105/142 Test #129: channel_benchmark_hippo::compare_results ........................... Passed 0.26 sec
Start 135: channel_benchmark_sscx::compare_results
106/142 Test #135: channel_benchmark_sscx::compare_results ............................ Passed 0.19 sec
107/142 Test #35: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 35.45 sec
Start 22: coreneuron_modtests::spikes_mpi_py_cpu
108/142 Test #121: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 41.47 sec
Start 23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
109/142 Test #122: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 38.96 sec
Start 24: coreneuron_modtests::inputpresyn_py_cpu
110/142 Test #6: rxdmod_tests::rxd_mpi_tests ........................................ Passed 282.49 sec
Start 123: testcorenrn_netstimdirect::compare_results
111/142 Test #123: testcorenrn_netstimdirect::compare_results ......................... Passed 0.57 sec
112/142 Test #22: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 20.98 sec
Start 36: coreneuron_modtests::spikes_mpi_py_gpu
113/142 Test #23: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 18.59 sec
Start 37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
114/142 Test #24: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 18.22 sec
Start 38: coreneuron_modtests::inputpresyn_py_gpu
115/142 Test #38: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 11.15 sec
116/142 Test #36: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 12.85 sec
Start 105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
117/142 Test #37: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 12.67 sec
118/142 Test #105: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 3.18 sec
Start 109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
119/142 Test #109: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 6.83 sec
Start 137: olfactory-bulb-3d::neuron::preparation
120/142 Test #137: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.15 sec
Start 139: olfactory-bulb-3d::coreneuron_gpu_online::preparation
121/142 Test #139: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.22 sec
Start 141: olfactory-bulb-3d::coreneuron_cpu_online::preparation
122/142 Test #141: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.17 sec
Start 40: reduced_dentate::neuron
123/142 Test #40: reduced_dentate::neuron ............................................ Passed 10.67 sec
Start 41: reduced_dentate::coreneuron_cpu
124/142 Test #41: reduced_dentate::coreneuron_cpu .................................... Passed 22.11 sec
Start 42: reduced_dentate::coreneuron_gpu
125/142 Test #42: reduced_dentate::coreneuron_gpu .................................... Passed 18.86 sec
Start 49: external_ringtest::coreneuron_cpu_mpi_threads
Start 43: reduced_dentate::compare_results
126/142 Test #43: reduced_dentate::compare_results ................................... Passed 0.14 sec
127/142 Test #49: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 2.90 sec
Start 53: external_ringtest::coreneuron_gpu_mpi_threads
128/142 Test #53: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 4.66 sec
Start 101: testcorenrn_vecevent::neuron
Start 54: external_ringtest::compare_results
129/142 Test #54: external_ringtest::compare_results ................................. Passed 0.36 sec
130/142 Test #101: testcorenrn_vecevent::neuron ....................................... Passed 2.46 sec
Start 102: testcorenrn_vecevent::coreneuron_gpu_online
131/142 Test #102: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 6.57 sec
Start 103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
132/142 Test #39: external_nrntest ................................................... Passed 154.45 sec
Start 104: testcorenrn_vecevent::coreneuron_gpu_offline
133/142 Test #103: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 6.82 sec
Start 106: testcorenrn_vecevent::coreneuron_cpu_online
134/142 Test #104: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 3.44 sec
Start 107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
135/142 Test #106: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 3.78 sec
Start 108: testcorenrn_vecevent::coreneuron_cpu_offline
136/142 Test #108: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 12.47 sec
Start 136: olfactory-bulb-3d::neuron
137/142 Test #107: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 13.29 sec
Start 138: olfactory-bulb-3d::coreneuron_gpu_online
138/142 Test #138: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 69.84 sec
Start 140: olfactory-bulb-3d::coreneuron_cpu_online
139/142 Test #136: olfactory-bulb-3d::neuron .......................................... Passed 99.76 sec
Start 110: testcorenrn_vecevent::compare_results
140/142 Test #110: testcorenrn_vecevent::compare_results .............................. Passed 0.69 sec
141/142 Test #140: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 69.65 sec
Start 142: olfactory-bulb-3d::compare_results
142/142 Test #142: olfactory-bulb-3d::compare_results ................................. Passed 0.27 sec
100% tests passed, 0 tests failed out of 142
Total Test time (real) = 825.98 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.8.3
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1640262906:step_script section_start:1640262906:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188384 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=114851 responseStatus=201 Created token=MpCsshx-
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188416 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=114851 responseStatus=201 Created token=MpCsshx-
section_end:1640262908:upload_artifacts_on_success section_start:1640262908:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640262909:cleanup_file_variables Job succeeded
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment