Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created March 9, 2022 12:41
Show Gist options
  • Save bbpbuildbot/23e2ef91bbd82ae1d5248339b69ba64d to your computer and use it in GitHub Desktop.
Save bbpbuildbot/23e2ef91bbd82ae1d5248339b69ba64d to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/42032 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#772.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825729:resolve_secrets Resolving secrets
section_end:1646825729:resolve_secrets section_start:1646825729:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor658699611, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179966
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179966_PROD_P112_CP6_C9
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319491
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179966_PROD_P112_CP6_C9 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319491 --cpus-per-task=8 --mem=76G
section_end:1646825756:prepare_executor section_start:1646825756:prepare_script Preparing environment
Running on r1i7n31 via bbpv1.epfl.ch...
section_end:1646825758:prepare_script section_start:1646825758:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825759:get_sources section_start:1646825759:restore_cache Restoring cache
Checking cache for build:coreneuron:mod2c:intel-8...
Runtime platform  arch=amd64 os=linux pid=197610 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646825762:restore_cache section_start:1646825762:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (179959)...
Runtime platform  arch=amd64 os=linux pid=197682 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179959 responseStatus=200 OK token=-7SAWh_S
section_end:1646825763:download_artifacts section_start:1646825763:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179966/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179966/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179966/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179966/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179966/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179966_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron%intel +tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be hsyhen5wbojr4dsx5rf32wndj3dpm5nb
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319491/ccache
Primary config: /nvme/bbpcihpcproj12/319491/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:36:30 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.27 / 0.51 (52.01 %)
Files: 5470
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'hsyhen5wbojr4dsx5rf32wndj3dpm5nb'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- hsyhen5 coreneuron@develop%intel@2021.4.0~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=Debug arch=linux-rhel7-skylake
- dwdch6b ^bison@3.8.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] dl7pfht ^boost@1.78.0%intel@2021.4.0+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
- z3q5f3x ^cmake@3.21.4%intel@2021.4.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
- s4ueg72 ^flex@2.6.3%intel@2021.4.0+lex~nls arch=linux-rhel7-skylake
[^] 3narjkw ^hpe-mpi@2.25.hmpt%intel@2021.4.0 arch=linux-rhel7-skylake
[^] nfrzrlo ^libsonata-report@1.1%intel@2021.4.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ofveh3j ^hdf5@1.10.7%intel@2021.4.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] xys6npz ^pkgconf@1.8.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] e7w5nez ^zlib@1.2.11%intel@2021.4.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] wk3uenv ^spdlog@1.9.2%intel@2021.4.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
- 6ggc5yr ^ninja@1.10.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] f27a7nn ^python@3.9.7%intel@2021.4.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] gdhqypa ^reportinglib@2.5.6%intel@2021.4.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-dwdch6bmdeclr2novthsywtrryotawwz)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-dl7pfhtsvyaq3273gr2g3l5vr37eeydc)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-z3q5f3xwpuibd3qbgdscqmu3efarbu42)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-s4ueg72j7l6vkdyvfxj2tweo7v7s3otx)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-3narjkwjh6i2jr3zl3g5wdjlqi52hkwh)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/pkgconf-1.8.0-xys6np
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-e7w5nezpwf572epfhbosqfzboztysout)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-6ggc5yre7qddwxdjmn7sfptpdoiy4dtp)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-f27a7nnhppeztxijpispnaedcfo2vjxi)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/spdlog-1.9.2-wk3uen
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/reportinglib-2.5.6-gdhqyp
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/hdf5-1.10.7-ofveh3
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/libsonata-report-1.1-nfrzrl
==> Installing coreneuron-develop-hsyhen5wbojr4dsx5rf32wndj3dpm5nb
==> No binary for coreneuron-develop-hsyhen5wbojr4dsx5rf32wndj3dpm5nb found: installing from source
==> No patches needed for coreneuron
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
==> coreneuron: Successfully installed coreneuron-develop-hsyhen5wbojr4dsx5rf32wndj3dpm5nb
Fetch: 4.71s. Build: 47.24s. Total: 51.95s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_intel-2021.4.0-skylake/coreneuron-develop-hsyhen
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319491/ccache
Primary config: /nvme/bbpcihpcproj12/319491/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:38:09 2022
Hits: 109 / 115 (94.78 %)
Direct: 91 / 116 (78.45 %)
Preprocessed: 18 / 25 (72.00 %)
Misses: 6
Direct: 25
Preprocessed: 7
Uncacheable: 18
Primary storage:
Hits: 200 / 232 (86.21 %)
Misses: 32
Cache size (GB): 0.27 / 0.51 (52.17 %)
Files: 5482
Uncacheable:
Called for linking: 14
Compiler produced no output: 1
No input file: 3
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646825893:step_script section_start:1646825893:archive_cache Saving cache for successful job
Creating cache build:coreneuron:mod2c:intel-8...
Runtime platform  arch=amd64 os=linux pid=199739 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Acoreneuron%3Amod2c%3Aintel-8
Created cache
section_end:1646825904:archive_cache section_start:1646825904:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=199867 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179966 responseStatus=201 Created token=2_MWRqfN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=199906 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179966 responseStatus=201 Created token=2_MWRqfN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=199941 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179966 responseStatus=201 Created token=2_MWRqfN
section_end:1646825906:upload_artifacts_on_success section_start:1646825906:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646825907:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825729:resolve_secrets Resolving secrets
section_end:1646825729:resolve_secrets section_start:1646825729:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor152483201, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179963
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179963_PROD_P112_CP5_C8
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319492
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179963_PROD_P112_CP5_C8 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319492 --cpus-per-task=8 --mem=76G
section_end:1646825756:prepare_executor section_start:1646825756:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646825760:prepare_script section_start:1646825760:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825761:get_sources section_start:1646825761:restore_cache Restoring cache
Checking cache for build:coreneuron:mod2c:nvhpc:acc:unified-8...
Runtime platform  arch=amd64 os=linux pid=296402 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646825764:restore_cache section_start:1646825764:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (179959)...
Runtime platform  arch=amd64 os=linux pid=296544 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179959 responseStatus=200 OK token=-7SAWh_S
section_end:1646825765:download_artifacts section_start:1646825765:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179963/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179963/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179963/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179963/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179963/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179963_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron%nvhpc +gpu+unified+openmp+tests~legacy-unit build_type=RelWithDebInfo
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be 5u3hb5563fiewjkvz6z6mzftkoy4lmwk
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319492/ccache
Primary config: /nvme/bbpcihpcproj12/319492/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:36:36 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.16 / 0.51 (30.70 %)
Files: 6114
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: '5u3hb5563fiewjkvz6z6mzftkoy4lmwk'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron%nvhpc+gpu~legacy-unit+openmp+tests+unified build_type=RelWithDebInfo
Concretized
--------------------------------
- 5u3hb55 coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile+report+shared~sympy~sympyopt+tests+unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
- 55wtnz6 ^cmake@3.21.4%nvhpc@22.2~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] yjmlhh2 ^hpe-mpi@2.25.hmpt%nvhpc@22.2 arch=linux-rhel7-skylake
[^] r5wt3dh ^libsonata-report@1.1%nvhpc@22.2~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ytku65t ^hdf5@1.10.7%nvhpc@22.2+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] kzqllej ^pkgconf@1.8.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] tayew4i ^zlib@1.2.11%nvhpc@22.2+optimize+pic+shared arch=linux-rhel7-skylake
[^] 6bohspr ^spdlog@1.9.2%nvhpc@22.2~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] anlnosv ^python@3.9.7%nvhpc@22.2+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 4mciih7 ^reportinglib@2.5.6%nvhpc@22.2~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-55wtnz6tfxjhgdgfbzzwzuhyl746wv7j)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-yjmlhh2qrwgth4mrrn3f72mynalveqr5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/pkgconf-1.8.0-kzqlle
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-tayew4indju53v3ylyin7shvfpp5genf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-anlnosvxv5pmzlxnwx77gmjmmlsmov7b)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/spdlog-1.9.2-6bohsp
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/reportinglib-2.5.6-4mciih
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/hdf5-1.10.7-ytku65
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/libsonata-report-1.1-r5wt3d
==> Installing coreneuron-develop-5u3hb5563fiewjkvz6z6mzftkoy4lmwk
==> No binary for coreneuron-develop-5u3hb5563fiewjkvz6z6mzftkoy4lmwk found: installing from source
==> No patches needed for coreneuron
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
==> coreneuron: Successfully installed coreneuron-develop-5u3hb5563fiewjkvz6z6mzftkoy4lmwk
Fetch: 4.82s. Build: 2m 34.31s. Total: 2m 39.13s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-5u3hb5
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319492/ccache
Primary config: /nvme/bbpcihpcproj12/319492/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:40:16 2022
Hits: 109 / 118 (92.37 %)
Direct: 90 / 118 (76.27 %)
Preprocessed: 19 / 28 (67.86 %)
Misses: 9
Direct: 28
Preprocessed: 9
Uncacheable: 19
Primary storage:
Hits: 200 / 236 (84.75 %)
Misses: 36
Cache size (GB): 0.16 / 0.51 (30.77 %)
Files: 6132
Uncacheable:
Called for linking: 16
No input file: 3
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646826018:step_script section_start:1646826018:archive_cache Saving cache for successful job
Creating cache build:coreneuron:mod2c:nvhpc:acc:unified-8...
Runtime platform  arch=amd64 os=linux pid=3783 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Acoreneuron%3Amod2c%3Anvhpc%3Aacc%3Aunified-8
Created cache
section_end:1646826027:archive_cache section_start:1646826027:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=4797 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179963 responseStatus=201 Created token=HHCPVuHs
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=4861 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179963 responseStatus=201 Created token=HHCPVuHs
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=4942 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179963 responseStatus=201 Created token=HHCPVuHs
section_end:1646826029:upload_artifacts_on_success section_start:1646826029:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826030:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825728:resolve_secrets Resolving secrets
section_end:1646825728:resolve_secrets section_start:1646825728:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor010153015, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179962
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179962_PROD_P112_CP4_C6
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319493
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179962_PROD_P112_CP4_C6 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319493 --cpus-per-task=8 --mem=76G
section_end:1646825756:prepare_executor section_start:1646825756:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646825759:prepare_script section_start:1646825759:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825760:get_sources section_start:1646825760:restore_cache Restoring cache
Checking cache for build:coreneuron:mod2c:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=296319 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646825764:restore_cache section_start:1646825764:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (179959)...
Runtime platform  arch=amd64 os=linux pid=296471 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179959 responseStatus=200 OK token=-7SAWh_S
section_end:1646825764:download_artifacts section_start:1646825764:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179962/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179962/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179962/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179962/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179962/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179962_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron%nvhpc +gpu+openmp+tests~legacy-unit build_type=RelWithDebInfo
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be qvmfnnxhw57tyce665xfpgrivex6jdyr
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319493/ccache
Primary config: /nvme/bbpcihpcproj12/319493/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:36:36 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.19 / 0.51 (37.80 %)
Files: 7487
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'qvmfnnxhw57tyce665xfpgrivex6jdyr'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron%nvhpc+gpu~legacy-unit+openmp+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- qvmfnnx coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
- 55wtnz6 ^cmake@3.21.4%nvhpc@22.2~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] yjmlhh2 ^hpe-mpi@2.25.hmpt%nvhpc@22.2 arch=linux-rhel7-skylake
[^] r5wt3dh ^libsonata-report@1.1%nvhpc@22.2~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ytku65t ^hdf5@1.10.7%nvhpc@22.2+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] kzqllej ^pkgconf@1.8.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] tayew4i ^zlib@1.2.11%nvhpc@22.2+optimize+pic+shared arch=linux-rhel7-skylake
[^] 6bohspr ^spdlog@1.9.2%nvhpc@22.2~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] anlnosv ^python@3.9.7%nvhpc@22.2+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 4mciih7 ^reportinglib@2.5.6%nvhpc@22.2~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-55wtnz6tfxjhgdgfbzzwzuhyl746wv7j)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-yjmlhh2qrwgth4mrrn3f72mynalveqr5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/pkgconf-1.8.0-kzqlle
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-tayew4indju53v3ylyin7shvfpp5genf)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-anlnosvxv5pmzlxnwx77gmjmmlsmov7b)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/spdlog-1.9.2-6bohsp
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/reportinglib-2.5.6-4mciih
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/hdf5-1.10.7-ytku65
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/libsonata-report-1.1-r5wt3d
==> Installing coreneuron-develop-qvmfnnxhw57tyce665xfpgrivex6jdyr
==> No binary for coreneuron-develop-qvmfnnxhw57tyce665xfpgrivex6jdyr found: installing from source
==> No patches needed for coreneuron
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
==> coreneuron: Successfully installed coreneuron-develop-qvmfnnxhw57tyce665xfpgrivex6jdyr
Fetch: 4.78s. Build: 2m 54.13s. Total: 2m 58.91s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-qvmfnn
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319493/ccache
Primary config: /nvme/bbpcihpcproj12/319493/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:40:56 2022
Hits: 109 / 118 (92.37 %)
Direct: 90 / 118 (76.27 %)
Preprocessed: 19 / 28 (67.86 %)
Misses: 9
Direct: 28
Preprocessed: 9
Uncacheable: 19
Primary storage:
Hits: 200 / 236 (84.75 %)
Misses: 36
Cache size (GB): 0.19 / 0.51 (37.88 %)
Files: 7505
Uncacheable:
Called for linking: 16
No input file: 3
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646826057:step_script section_start:1646826057:archive_cache Saving cache for successful job
Creating cache build:coreneuron:mod2c:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=6830 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Acoreneuron%3Amod2c%3Anvhpc%3Aacc-8
Created cache
section_end:1646826065:archive_cache section_start:1646826065:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=7045 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179962 responseStatus=201 Created token=BnVZjzKN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=7085 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179962 responseStatus=201 Created token=BnVZjzKN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=7163 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179962 responseStatus=201 Created token=BnVZjzKN
section_end:1646826067:upload_artifacts_on_success section_start:1646826067:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826068:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826010:resolve_secrets Resolving secrets
section_end:1646826010:resolve_secrets section_start:1646826010:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor077711350, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179967
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179967_PROD_P112_CP11_C13
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319560
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179967_PROD_P112_CP11_C13 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319560 --cpus-per-task=8 --mem=76G
section_end:1646826033:prepare_executor section_start:1646826033:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646826035:prepare_script section_start:1646826035:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826036:get_sources section_start:1646826036:restore_cache Restoring cache
Checking cache for build:coreneuron:nmodl:intel-8...
Runtime platform  arch=amd64 os=linux pid=5631 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826039:restore_cache section_start:1646826039:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl (179961)...
Runtime platform  arch=amd64 os=linux pid=5710 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179961 responseStatus=200 OK token=8y7dxwFF
section_end:1646826040:download_artifacts section_start:1646826040:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179967/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179967/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179967/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179967/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179967/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179967_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron%intel +nmodl+tests~legacy-unit build_type=Debug ^hpe-mpi%gcc ^/cnhmkfzsucqnmy6dfxyfikno2yj57grf
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be f2bfytl2xzstchvaem4gflxln4r6z4cz
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319560/ccache
Primary config: /nvme/bbpcihpcproj12/319560/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:41:05 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.30 / 0.51 (58.02 %)
Files: 6752
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'f2bfytl2xzstchvaem4gflxln4r6z4cz'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron%intel~legacy-unit+nmodl+tests build_type=Debug
- ^hpe-mpi%gcc
[+] ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
Concretized
--------------------------------
- f2bfytl coreneuron@develop%intel@2021.4.0~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=Debug arch=linux-rhel7-skylake
- dwdch6b ^bison@3.8.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] dl7pfht ^boost@1.78.0%intel@2021.4.0+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] 2qmvlfy ^cmake@3.21.4%gcc@11.2.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
- s4ueg72 ^flex@2.6.3%intel@2021.4.0+lex~nls arch=linux-rhel7-skylake
[^] hyunzkn ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vutuzbn ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] utj47fz ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ihxi5rl ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] evtnqzd ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] x72vveu ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
- 6ggc5yr ^ninja@1.10.2%intel@2021.4.0 arch=linux-rhel7-skylake
[+] cnhmkfz ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5fkun4i ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-dwdch6bmdeclr2novthsywtrryotawwz)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-dl7pfhtsvyaq3273gr2g3l5vr37eeydc)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-2qmvlfyylrv3t5ankluyr5cqey2nlfzd)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-s4ueg72j7l6vkdyvfxj2tweo7v7s3otx)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-hyunzknktdzri34bx26bupkvapehonql)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/pkgconf-1.8.0-ihxi5r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-evtnqzdtuvprwnbd2nljimpzywrhw4uo)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-6ggc5yre7qddwxdjmn7sfptpdoiy4dtp)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/spdlog-1.9.2-x72vve
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/reportinglib-2.5.6-5fkun4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/hdf5-1.10.7-utj47f
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libsonata-report-1.1-vutuzb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
==> Installing coreneuron-develop-f2bfytl2xzstchvaem4gflxln4r6z4cz
==> No binary for coreneuron-develop-f2bfytl2xzstchvaem4gflxln4r6z4cz found: installing from source
==> No patches needed for coreneuron
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
==> coreneuron: Successfully installed coreneuron-develop-f2bfytl2xzstchvaem4gflxln4r6z4cz
Fetch: 4.78s. Build: 46.47s. Total: 51.26s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_intel-2021.4.0-skylake/coreneuron-develop-f2bfyt
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319560/ccache
Primary config: /nvme/bbpcihpcproj12/319560/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:42:52 2022
Hits: 88 / 94 (93.62 %)
Direct: 78 / 95 (82.11 %)
Preprocessed: 10 / 17 (58.82 %)
Misses: 6
Direct: 17
Preprocessed: 7
Uncacheable: 16
Primary storage:
Hits: 167 / 190 (87.89 %)
Misses: 23
Cache size (GB): 0.30 / 0.51 (58.19 %)
Files: 6772
Uncacheable:
Called for linking: 12
Compiler produced no output: 1
No input file: 3
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646826173:step_script section_start:1646826173:archive_cache Saving cache for successful job
Creating cache build:coreneuron:nmodl:intel-8...
Runtime platform  arch=amd64 os=linux pid=13735 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Acoreneuron%3Anmodl%3Aintel-8
Created cache
section_end:1646826186:archive_cache section_start:1646826186:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=14235 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179967 responseStatus=201 Created token=2FX3PAsd
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=14280 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179967 responseStatus=201 Created token=2FX3PAsd
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=14329 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179967 responseStatus=201 Created token=2FX3PAsd
section_end:1646826188:upload_artifacts_on_success section_start:1646826188:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826188:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826009:resolve_secrets Resolving secrets
section_end:1646826009:resolve_secrets section_start:1646826009:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor828516132, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179965
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179965_PROD_P112_CP10_C12
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319559
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179965_PROD_P112_CP10_C12 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319559 --cpus-per-task=8 --mem=76G
section_end:1646826033:prepare_executor section_start:1646826033:prepare_script Preparing environment
Running on r1i7n31 via bbpv1.epfl.ch...
section_end:1646826035:prepare_script section_start:1646826035:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826036:get_sources section_start:1646826036:restore_cache Restoring cache
Checking cache for build:coreneuron:nmodl:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=200603 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826039:restore_cache section_start:1646826039:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl (179961)...
Runtime platform  arch=amd64 os=linux pid=200679 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179961 responseStatus=200 OK token=8y7dxwFF
section_end:1646826039:download_artifacts section_start:1646826039:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179965/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179965/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179965/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179965/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179965/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179965_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron%nvhpc +nmodl~openmp+gpu+tests~legacy-unit+sympy build_type=RelWithDebInfo ^hpe-mpi%gcc ^/cnhmkfzsucqnmy6dfxyfikno2yj57grf
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be clohwtjjwrfpo4z4oreptyb2jbe3wrcs
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319559/ccache
Primary config: /nvme/bbpcihpcproj12/319559/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:41:05 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.22 / 0.51 (43.68 %)
Files: 8061
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'clohwtjjwrfpo4z4oreptyb2jbe3wrcs'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron%nvhpc+gpu~legacy-unit+nmodl~openmp+sympy+tests build_type=RelWithDebInfo
- ^hpe-mpi%gcc
[+] ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
Concretized
--------------------------------
- clohwtj coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared+sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] 2qmvlfy ^cmake@3.21.4%gcc@11.2.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] hyunzkn ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vutuzbn ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] utj47fz ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ihxi5rl ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] evtnqzd ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] x72vveu ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[+] cnhmkfz ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5fkun4i ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-2qmvlfyylrv3t5ankluyr5cqey2nlfzd)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-hyunzknktdzri34bx26bupkvapehonql)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/pkgconf-1.8.0-ihxi5r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-evtnqzdtuvprwnbd2nljimpzywrhw4uo)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/spdlog-1.9.2-x72vve
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/reportinglib-2.5.6-5fkun4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/hdf5-1.10.7-utj47f
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libsonata-report-1.1-vutuzb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
==> Installing coreneuron-develop-clohwtjjwrfpo4z4oreptyb2jbe3wrcs
==> No binary for coreneuron-develop-clohwtjjwrfpo4z4oreptyb2jbe3wrcs found: installing from source
==> No patches needed for coreneuron
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
==> coreneuron: Successfully installed coreneuron-develop-clohwtjjwrfpo4z4oreptyb2jbe3wrcs
Fetch: 4.43s. Build: 3m 43.01s. Total: 3m 47.44s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-clohwt
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319559/ccache
Primary config: /nvme/bbpcihpcproj12/319559/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:45:52 2022
Hits: 88 / 96 (91.67 %)
Direct: 78 / 96 (81.25 %)
Preprocessed: 10 / 18 (55.56 %)
Misses: 8
Direct: 18
Preprocessed: 8
Uncacheable: 16
Primary storage:
Hits: 167 / 192 (86.98 %)
Misses: 25
Cache size (GB): 0.22 / 0.51 (43.78 %)
Files: 8086
Uncacheable:
Called for linking: 13
No input file: 3
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646826353:step_script section_start:1646826353:archive_cache Saving cache for successful job
Creating cache build:coreneuron:nmodl:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=203485 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Acoreneuron%3Anmodl%3Anvhpc%3Aacc-8
Created cache
section_end:1646826364:archive_cache section_start:1646826364:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=203567 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179965 responseStatus=201 Created token=atY9Zsk4
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=203606 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179965 responseStatus=201 Created token=atY9Zsk4
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=203649 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179965 responseStatus=201 Created token=atY9Zsk4
section_end:1646826366:upload_artifacts_on_success section_start:1646826366:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826366:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826009:resolve_secrets Resolving secrets
section_end:1646826009:resolve_secrets section_start:1646826009:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor779224482, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179964
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179964_PROD_P112_CP2_C4
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319561
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179964_PROD_P112_CP2_C4 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319561 --cpus-per-task=8 --mem=76G
section_end:1646826033:prepare_executor section_start:1646826033:prepare_script Preparing environment
Running on r1i5n31 via bbpv1.epfl.ch...
section_end:1646826035:prepare_script section_start:1646826035:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826036:get_sources section_start:1646826036:restore_cache Restoring cache
Checking cache for build:coreneuron:nmodl:nvhpc:omp-8...
Runtime platform  arch=amd64 os=linux pid=44161 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826039:restore_cache section_start:1646826039:download_artifacts Downloading artifacts
Downloading artifacts for build:nmodl (179961)...
Runtime platform  arch=amd64 os=linux pid=44270 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179961 responseStatus=200 OK token=8y7dxwFF
section_end:1646826039:download_artifacts section_start:1646826039:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179964/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179964/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179964/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179964/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179964/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179964_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron%nvhpc +nmodl+openmp+gpu+tests~legacy-unit~sympy build_type=RelWithDebInfo ^hpe-mpi%gcc ^/cnhmkfzsucqnmy6dfxyfikno2yj57grf
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319561/ccache
Primary config: /nvme/bbpcihpcproj12/319561/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:41:06 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.24 / 0.51 (46.00 %)
Files: 8623
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron%nvhpc+gpu~legacy-unit+nmodl+openmp~sympy+tests build_type=RelWithDebInfo
- ^hpe-mpi%gcc
[+] ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
Concretized
--------------------------------
- jnp6ftw coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl+openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] 2qmvlfy ^cmake@3.21.4%gcc@11.2.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] hyunzkn ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vutuzbn ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] utj47fz ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ihxi5rl ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] evtnqzd ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] x72vveu ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[+] cnhmkfz ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5fkun4i ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-2qmvlfyylrv3t5ankluyr5cqey2nlfzd)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-hyunzknktdzri34bx26bupkvapehonql)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/pkgconf-1.8.0-ihxi5r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-evtnqzdtuvprwnbd2nljimpzywrhw4uo)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/spdlog-1.9.2-x72vve
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/reportinglib-2.5.6-5fkun4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/hdf5-1.10.7-utj47f
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libsonata-report-1.1-vutuzb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
==> Installing coreneuron-develop-jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt
==> No binary for coreneuron-develop-jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt found: installing from source
==> No patches needed for coreneuron
==> coreneuron: Executing phase: 'cmake'
==> coreneuron: Executing phase: 'build'
==> coreneuron: Executing phase: 'install'
==> coreneuron: Successfully installed coreneuron-develop-jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt
Fetch: 4.52s. Build: 3m 29.74s. Total: 3m 34.26s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-jnp6ft
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319561/ccache
Primary config: /nvme/bbpcihpcproj12/319561/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:45:57 2022
Hits: 89 / 98 (90.82 %)
Direct: 80 / 98 (81.63 %)
Preprocessed: 9 / 18 (50.00 %)
Misses: 9
Direct: 18
Preprocessed: 9
Uncacheable: 17
Primary storage:
Hits: 169 / 196 (86.22 %)
Misses: 27
Cache size (GB): 0.24 / 0.51 (46.10 %)
Files: 8649
Uncacheable:
Called for linking: 14
No input file: 3
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646826358:step_script section_start:1646826358:archive_cache Saving cache for successful job
Creating cache build:coreneuron:nmodl:nvhpc:omp-8...
Runtime platform  arch=amd64 os=linux pid=49122 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Acoreneuron%3Anmodl%3Anvhpc%3Aomp-8
Created cache
section_end:1646826369:archive_cache section_start:1646826369:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=49201 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179964 responseStatus=201 Created token=PrgH_RpU
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=49239 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179964 responseStatus=201 Created token=PrgH_RpU
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=49283 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179964 responseStatus=201 Created token=PrgH_RpU
section_end:1646826370:upload_artifacts_on_success section_start:1646826370:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826371:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825910:resolve_secrets Resolving secrets
section_end:1646825910:resolve_secrets section_start:1646825910:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor949249448, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179971
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179971_PROD_P112_CP6_C1
Job parameters: memory=76G, cpus_per_task=8, duration=2:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319552
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179971_PROD_P112_CP6_C1 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=2:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319552 --cpus-per-task=8 --mem=76G
section_end:1646825940:prepare_executor section_start:1646825940:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646825944:prepare_script section_start:1646825944:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825945:get_sources section_start:1646825945:restore_cache Restoring cache
Checking cache for build:neuron:mod2c:intel-8...
Runtime platform  arch=amd64 os=linux pid=639 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646825952:restore_cache section_start:1646825952:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:mod2c:intel (179966)...
Runtime platform  arch=amd64 os=linux pid=1276 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179966 responseStatus=200 OK token=2_MWRqfN
section_end:1646825953:download_artifacts section_start:1646825953:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179971/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179971/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179971/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179971/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179971/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179971_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron%intel +coreneuron+debug+tests~legacy-unit~rx3d model_tests=channel-benchmark,olfactory,tqperf-heavy ^/hsyhen5wbojr4dsx5rf32wndj3dpm5nb
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be 47kwkdqbfahzhd6mgo3d7lvidjenlcwo
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319552/ccache
Primary config: /nvme/bbpcihpcproj12/319552/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:40:18 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.46 / 0.51 (90.20 %)
Files: 29264
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: '47kwkdqbfahzhd6mgo3d7lvidjenlcwo'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron%intel+coreneuron+debug~legacy-unit~rx3d+tests model_tests=channel-benchmark,olfactory,tqperf-heavy
[+] ^coreneuron@develop%intel@2021.4.0~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=Debug arch=linux-rhel7-skylake
[^] ^boost@1.78.0%intel@2021.4.0+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] ^hpe-mpi@2.25.hmpt%intel@2021.4.0 arch=linux-rhel7-skylake
[^] ^libsonata-report@1.1%intel@2021.4.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^hdf5@1.10.7%intel@2021.4.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^pkgconf@1.8.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] ^zlib@1.2.11%intel@2021.4.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] ^spdlog@1.9.2%intel@2021.4.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^python@3.9.7%intel@2021.4.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^reportinglib@2.5.6%intel@2021.4.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
Concretized
--------------------------------
- 47kwkdq neuron@develop%intel@2021.4.0+binary~caliper+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python~rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory,tqperf-heavy patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-skylake
- dwdch6b ^bison@3.8.2%intel@2021.4.0 arch=linux-rhel7-skylake
- z3q5f3x ^cmake@3.21.4%intel@2021.4.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[+] hsyhen5 ^coreneuron@develop%intel@2021.4.0~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=Debug arch=linux-rhel7-skylake
[^] dl7pfht ^boost@1.78.0%intel@2021.4.0+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] 3narjkw ^hpe-mpi@2.25.hmpt%intel@2021.4.0 arch=linux-rhel7-skylake
[^] nfrzrlo ^libsonata-report@1.1%intel@2021.4.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ofveh3j ^hdf5@1.10.7%intel@2021.4.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] xys6npz ^pkgconf@1.8.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] e7w5nez ^zlib@1.2.11%intel@2021.4.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] wk3uenv ^spdlog@1.9.2%intel@2021.4.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] f27a7nn ^python@3.9.7%intel@2021.4.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] gdhqypa ^reportinglib@2.5.6%intel@2021.4.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
- s4ueg72 ^flex@2.6.3%intel@2021.4.0+lex~nls arch=linux-rhel7-skylake
[^] bjxwlfq ^gettext@0.21%intel@2021.4.0+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-skylake
[^] dvyfbbf ^bzip2@1.0.8%intel@2021.4.0~debug~pic+shared arch=linux-rhel7-skylake
[^] ka2cfu4 ^libiconv@1.16%intel@2021.4.0 libs=shared,static arch=linux-rhel7-skylake
[^] w3ob7m2 ^libxml2@2.9.12%intel@2021.4.0~python arch=linux-rhel7-skylake
[^] ahg6hq4 ^xz@5.2.5%intel@2021.4.0~pic libs=shared,static arch=linux-rhel7-skylake
[^] q3rwuez ^ncurses@6.2%intel@2021.4.0~symlinks+termlib abi=none arch=linux-rhel7-skylake
[^] 2fli66n ^tar@1.28%intel@2021.4.0 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-skylake
- 6ggc5yr ^ninja@1.10.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] qj3vvxk ^py-mpi4py@3.1.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] 5flpilw ^py-setuptools@57.4.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] ipsbwzp ^py-numpy@1.19.5%intel@2021.4.0+blas+lapack patches=8a9d5d1b3f145c043b8b04869e7d46c6ff95c3f486d84f69693017c7e6190c7d arch=linux-rhel7-skylake
[^] rl5ojfn ^intel-mkl@2020.4.304%intel@2021.4.0~ilp64+shared threads=none arch=linux-rhel7-skylake
[^] taxuisw ^py-cython@0.29.24%intel@2021.4.0 arch=linux-rhel7-skylake
[^] tzmlo5v ^py-pytest@6.2.4%intel@2021.4.0 arch=linux-rhel7-skylake
[^] d5szgli ^py-attrs@21.2.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] huky5p4 ^py-iniconfig@1.1.1%intel@2021.4.0 arch=linux-rhel7-skylake
[^] wli7caj ^py-packaging@21.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] 3a3ralt ^py-pyparsing@2.4.7%intel@2021.4.0 arch=linux-rhel7-skylake
[^] rh6zvev ^py-pluggy@0.13.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] kpwupa3 ^py-setuptools-scm@6.3.2%intel@2021.4.0+toml arch=linux-rhel7-skylake
[^] apu667d ^py-tomli@1.2.1%intel@2021.4.0 arch=linux-rhel7-skylake
[^] jesa65u ^py-pip@21.1.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] skrpmyr ^py-py@1.9.0%intel@2021.4.0 arch=linux-rhel7-skylake
[^] ktthpzx ^py-toml@0.10.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] tzl5sq5 ^py-pytest-cov@2.8.1%intel@2021.4.0 arch=linux-rhel7-skylake
[^] zkd7o6d ^py-coverage@5.5%intel@2021.4.0 arch=linux-rhel7-skylake
[^] 5abs2t7 ^readline@8.1%intel@2021.4.0 arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-dwdch6bmdeclr2novthsywtrryotawwz)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-z3q5f3xwpuibd3qbgdscqmu3efarbu42)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-dl7pfhtsvyaq3273gr2g3l5vr37eeydc)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-3narjkwjh6i2jr3zl3g5wdjlqi52hkwh)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/pkgconf-1.8.0-xys6np
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-e7w5nezpwf572epfhbosqfzboztysout)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/spdlog-1.9.2-wk3uen
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-f27a7nnhppeztxijpispnaedcfo2vjxi)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-s4ueg72j7l6vkdyvfxj2tweo7v7s3otx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bzip2-1.0.8-eu2d6e (external bzip2-1.0.8-dvyfbbfdan33i7wyydyeskb3legztopm)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/libiconv-1.16-ka2cfu
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/xz-5.2.5-ahg6hq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ncurses-6.2-nsve5x (external ncurses-6.2-q3rwuezhc2j56kexunypjpejzketozmc)
[+] /usr (external tar-1.28-2fli66nkkv35g34exwd2xifp5w3gtgo6)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-6ggc5yre7qddwxdjmn7sfptpdoiy4dtp)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/intel-mkl-2020.4.304-rzr3hj (external intel-mkl-2020.4.304-rl5ojfngtc7sffwyz7v6ek6eceq53wed)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/readline-8.1-we2frg (external readline-8.1-5abs2t7f6dtgbejv6kjzd4gjwhdlr7qr)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/reportinglib-2.5.6-gdhqyp
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/hdf5-1.10.7-ofveh3
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-setuptools-57.4.0-5flpil
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/libxml2-2.9.12-w3ob7m
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/libsonata-report-1.1-nfrzrl
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-coverage-5.5-zkd7o6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-iniconfig-1.1.1-huky5p
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-mpi4py-3.1.2-qj3vvx
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-cython-0.29.24-taxuis
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-toml-0.10.2-ktthpz
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-attrs-21.2.0-d5szgl
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-pip-21.1.2-jesa65
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-pyparsing-2.4.7-3a3ral
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/gettext-0.21-bjxwlf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_intel-2021.4.0-skylake/coreneuron-develop-hsyhen
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-numpy-1.19.5-ipsbwz
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-tomli-1.2.1-apu667
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-packaging-21.0-wli7ca
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-setuptools-scm-6.3.2-kpwupa
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-pluggy-0.13.0-rh6zve
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-py-1.9.0-skrpmy
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-pytest-6.2.4-tzmlo5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_intel-2021.4.0-skylake/py-pytest-cov-2.8.1-tzl5sq
==> Installing neuron-develop-47kwkdqbfahzhd6mgo3d7lvidjenlcwo
==> No binary for neuron-develop-47kwkdqbfahzhd6mgo3d7lvidjenlcwo found: installing from source
==> Applied patch /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/bluebrain/repo-patches/packages/neuron/revert_Import3d_numerical_format.master.patch
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
==> neuron: Successfully installed neuron-develop-47kwkdqbfahzhd6mgo3d7lvidjenlcwo
Fetch: 40.16s. Build: 10m 57.18s. Total: 11m 37.34s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_intel-2021.4.0-skylake/neuron-develop-47kwkd
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319552/ccache
Primary config: /nvme/bbpcihpcproj12/319552/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:53:07 2022
Hits: 727 / 826 (88.01 %)
Direct: 331 / 835 (39.64 %)
Preprocessed: 396 / 498 (79.52 %)
Misses: 99
Direct: 504
Preprocessed: 102
Uncacheable: 132
Primary storage:
Hits: 1378 / 1664 (82.81 %)
Misses: 286
Cache size (GB): 0.46 / 0.51 (90.50 %)
Files: 29459
Uncacheable:
Autoconf compile/link: 7
Called for linking: 109
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646826791:step_script section_start:1646826791:archive_cache Saving cache for successful job
Creating cache build:neuron:mod2c:intel-8...
Runtime platform  arch=amd64 os=linux pid=40055 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Aneuron%3Amod2c%3Aintel-8
Created cache
section_end:1646826811:archive_cache section_start:1646826811:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=40372 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179971 responseStatus=201 Created token=LD3u8sHm
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=40420 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179971 responseStatus=201 Created token=LD3u8sHm
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=40463 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179971 responseStatus=201 Created token=LD3u8sHm
section_end:1646826812:upload_artifacts_on_success section_start:1646826812:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826813:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826072:resolve_secrets Resolving secrets
section_end:1646826072:resolve_secrets section_start:1646826072:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor365123990, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179968
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179968_PROD_P112_CP4_C6
Job parameters: memory=76G, cpus_per_task=8, duration=2:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319564
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179968_PROD_P112_CP4_C6 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=2:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319564 --cpus-per-task=8 --mem=76G
section_end:1646826083:prepare_executor section_start:1646826083:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646826086:prepare_script section_start:1646826086:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826087:get_sources section_start:1646826087:restore_cache Restoring cache
Checking cache for build:neuron:mod2c:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=7878 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826093:restore_cache section_start:1646826093:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:mod2c:nvhpc:acc (179962)...
Runtime platform  arch=amd64 os=linux pid=7955 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179962 responseStatus=200 OK token=BnVZjzKN
section_end:1646826093:download_artifacts section_start:1646826093:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179968/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179968/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179968/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179968/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179968/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179968_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron%nvhpc +coreneuron+debug+tests~legacy-unit~rx3d model_tests=channel-benchmark,olfactory,tqperf-heavy ^/qvmfnnxhw57tyce665xfpgrivex6jdyr
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be b3uxm6bweygovmzordzjkevzwfwfbb7k
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319564/ccache
Primary config: /nvme/bbpcihpcproj12/319564/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:41:56 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.46 / 0.51 (90.37 %)
Files: 34893
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'b3uxm6bweygovmzordzjkevzwfwfbb7k'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron%nvhpc+coreneuron+debug~legacy-unit~rx3d+tests model_tests=channel-benchmark,olfactory,tqperf-heavy
[+] ^coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
[^] ^hpe-mpi@2.25.hmpt%nvhpc@22.2 arch=linux-rhel7-skylake
[^] ^libsonata-report@1.1%nvhpc@22.2~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^hdf5@1.10.7%nvhpc@22.2+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^pkgconf@1.8.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] ^zlib@1.2.11%nvhpc@22.2+optimize+pic+shared arch=linux-rhel7-skylake
[^] ^spdlog@1.9.2%nvhpc@22.2~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^python@3.9.7%nvhpc@22.2+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^reportinglib@2.5.6%nvhpc@22.2~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
Concretized
--------------------------------
- b3uxm6b neuron@develop%nvhpc@22.2+binary~caliper+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python~rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory,tqperf-heavy patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
- 55wtnz6 ^cmake@3.21.4%nvhpc@22.2~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[+] qvmfnnx ^coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
[^] yjmlhh2 ^hpe-mpi@2.25.hmpt%nvhpc@22.2 arch=linux-rhel7-skylake
[^] r5wt3dh ^libsonata-report@1.1%nvhpc@22.2~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ytku65t ^hdf5@1.10.7%nvhpc@22.2+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] kzqllej ^pkgconf@1.8.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] tayew4i ^zlib@1.2.11%nvhpc@22.2+optimize+pic+shared arch=linux-rhel7-skylake
[^] 6bohspr ^spdlog@1.9.2%nvhpc@22.2~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] anlnosv ^python@3.9.7%nvhpc@22.2+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 4mciih7 ^reportinglib@2.5.6%nvhpc@22.2~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] sr4zfin ^gettext@0.21%nvhpc@22.2+bzip2+curses+git~libunistring+libxml2+tar+xz patches=6e530daaae14725d578d6cafbf7d523accc9ed29fd817bd421cf98a5f51e9e1b,bbe9f0539aa504966ac104224d25a9260faa1015ed3adda936467be9c7de4eae,fb27a3fb5e414bdc50ffebbbe2da986473df70a493caa4396226f51a67c55424 arch=linux-rhel7-skylake
[^] ajb4w4f ^bzip2@1.0.8%nvhpc@22.2~debug~pic+shared arch=linux-rhel7-skylake
[^] 4twyk6r ^libiconv@1.16%nvhpc@22.2 libs=shared,static arch=linux-rhel7-skylake
[^] fpazbku ^libxml2@2.9.12%nvhpc@22.2~python patches=05ff238cf435825ef835c7ae39376b52dc83d8caf19e962f0766c841386a305a,10a88ad47f9797cf7cf2d7d07241f665a3b6d1f31fa026728c8c2ae93e1664e9 arch=linux-rhel7-skylake
[^] qzjkqgu ^xz@5.2.5%nvhpc@22.2~pic libs=shared,static arch=linux-rhel7-skylake
[^] w5fylgg ^ncurses@6.2%nvhpc@22.2~symlinks+termlib abi=none arch=linux-rhel7-skylake
[^] rbb3dop ^tar@1.28%nvhpc@22.2 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] lpmwkvu ^py-mpi4py@3.1.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] pa37ni6 ^py-setuptools@57.4.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] nlsjsjj ^py-numpy@1.17.5%gcc@11.2.0+blas+lapack patches=cf407c1024b0878c4222dd352aa9dece412073bb15b138243a2893725434c7b6 arch=linux-rhel7-skylake
[^] r5cvgru ^intel-mkl@2020.4.304%gcc@11.2.0~ilp64+shared threads=none arch=linux-rhel7-skylake
[^] gabxpj6 ^py-pytest@6.2.4%nvhpc@22.2 arch=linux-rhel7-skylake
[^] sqvzpxf ^py-attrs@21.2.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] lzjp5na ^py-iniconfig@1.1.1%nvhpc@22.2 arch=linux-rhel7-skylake
[^] qg4saj7 ^py-packaging@21.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] dqjk4r6 ^py-pyparsing@2.4.7%nvhpc@22.2 arch=linux-rhel7-skylake
[^] e75mnog ^py-pluggy@0.13.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] rotu6n4 ^py-setuptools-scm@6.3.2%nvhpc@22.2+toml arch=linux-rhel7-skylake
[^] uf52c5s ^py-tomli@1.2.1%nvhpc@22.2 arch=linux-rhel7-skylake
[^] mj6gtgm ^py-pip@21.1.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] f3hqsi6 ^py-py@1.9.0%nvhpc@22.2 arch=linux-rhel7-skylake
[^] fto3mxh ^py-toml@0.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] aoyvjwm ^py-pytest-cov@2.8.1%nvhpc@22.2 arch=linux-rhel7-skylake
[^] yyszraq ^py-coverage@5.5%nvhpc@22.2 arch=linux-rhel7-skylake
[^] vwedalx ^readline@8.1%nvhpc@22.2 arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-55wtnz6tfxjhgdgfbzzwzuhyl746wv7j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-yjmlhh2qrwgth4mrrn3f72mynalveqr5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/pkgconf-1.8.0-kzqlle
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-tayew4indju53v3ylyin7shvfpp5genf)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/spdlog-1.9.2-6bohsp
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-anlnosvxv5pmzlxnwx77gmjmmlsmov7b)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bzip2-1.0.8-eu2d6e (external bzip2-1.0.8-ajb4w4fal7ri67giif6kgx5ks4ammoe3)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/libiconv-1.16-4twyk6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/xz-5.2.5-qzjkqg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ncurses-6.2-nsve5x (external ncurses-6.2-w5fylggejc6gf75pltr5gsjdjsthzt3w)
[+] /usr (external tar-1.28-rbb3dopg6uj5eje6nc6qjoywga4vn23d)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/intel-mkl-2020.4.304-rzr3hj (external intel-mkl-2020.4.304-r5cvgrurdnt6y267arsmmmgqi75ouxd2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/readline-8.1-we2frg (external readline-8.1-vwedalxfrcxjaatlnup77gynyx6weav5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/reportinglib-2.5.6-4mciih
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/hdf5-1.10.7-ytku65
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-setuptools-57.4.0-pa37ni
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/libxml2-2.9.12-fpazbk
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/libsonata-report-1.1-r5wt3d
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-pyparsing-2.4.7-dqjk4r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-iniconfig-1.1.1-lzjp5n
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-toml-0.10.2-fto3mx
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-attrs-21.2.0-sqvzpx
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-pip-21.1.2-mj6gtg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-numpy-1.17.5-nlsjsj
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-coverage-5.5-yyszra
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-mpi4py-3.1.2-lpmwkv
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/gettext-0.21-sr4zfi
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-qvmfnn
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-packaging-21.0-qg4saj
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-tomli-1.2.1-uf52c5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-setuptools-scm-6.3.2-rotu6n
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-pluggy-0.13.0-e75mno
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-py-1.9.0-f3hqsi
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-pytest-6.2.4-gabxpj
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_nvhpc-22.2-skylake/py-pytest-cov-2.8.1-aoyvjw
==> Installing neuron-develop-b3uxm6bweygovmzordzjkevzwfwfbb7k
==> No binary for neuron-develop-b3uxm6bweygovmzordzjkevzwfwfbb7k found: installing from source
==> Applied patch /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/bluebrain/repo-patches/packages/neuron/revert_Import3d_numerical_format.master.patch
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
==> neuron: Successfully installed neuron-develop-b3uxm6bweygovmzordzjkevzwfwfbb7k
Fetch: 13.13s. Build: 18m 30.66s. Total: 18m 43.79s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/neuron-develop-b3uxm6
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319564/ccache
Primary config: /nvme/bbpcihpcproj12/319564/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 13:01:52 2022
Hits: 728 / 825 (88.24 %)
Direct: 343 / 834 (41.13 %)
Preprocessed: 385 / 485 (79.38 %)
Misses: 97
Direct: 491
Preprocessed: 100
Uncacheable: 123
Primary storage:
Hits: 1377 / 1662 (82.85 %)
Misses: 285
Cache size (GB): 0.46 / 0.51 (90.60 %)
Files: 35083
Uncacheable:
Autoconf compile/link: 7
Called for linking: 100
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646827318:step_script section_start:1646827318:archive_cache Saving cache for successful job
Creating cache build:neuron:mod2c:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=59442 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Aneuron%3Amod2c%3Anvhpc%3Aacc-8
Created cache
section_end:1646827337:archive_cache section_start:1646827337:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=59699 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179968 responseStatus=201 Created token=mYR7bDZN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=59740 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179968 responseStatus=201 Created token=mYR7bDZN
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=59783 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179968 responseStatus=201 Created token=mYR7bDZN
section_end:1646827338:upload_artifacts_on_success section_start:1646827338:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646827339:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826192:resolve_secrets Resolving secrets
section_end:1646826192:resolve_secrets section_start:1646826192:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor487600746, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179972
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179972_PROD_P112_CP11_C13
Job parameters: memory=76G, cpus_per_task=8, duration=2:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319594
job state: PD
job state: PD
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179972_PROD_P112_CP11_C13 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=2:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319594 --cpus-per-task=8 --mem=76G
section_end:1646826288:prepare_executor section_start:1646826288:prepare_script Preparing environment
Running on r1i5n31 via bbpv1.epfl.ch...
section_end:1646826290:prepare_script section_start:1646826290:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826291:get_sources section_start:1646826291:restore_cache Restoring cache
Checking cache for build:neuron:nmodl:intel-8...
Runtime platform  arch=amd64 os=linux pid=47930 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826297:restore_cache section_start:1646826297:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:nmodl:intel (179967)...
Runtime platform  arch=amd64 os=linux pid=48006 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179967 responseStatus=200 OK token=2FX3PAsd
section_end:1646826298:download_artifacts section_start:1646826298:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179972/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179972/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179972/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179972/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179972/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179972_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron%intel +coreneuron+debug+tests~legacy-unit~rx3d model_tests=channel-benchmark,olfactory,tqperf-heavy ^/f2bfytl2xzstchvaem4gflxln4r6z4cz
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be 7vuuxvdwm3mams7szrb4snbsppttef4h
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319594/ccache
Primary config: /nvme/bbpcihpcproj12/319594/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:45:30 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.46 / 0.51 (90.72 %)
Files: 26378
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: '7vuuxvdwm3mams7szrb4snbsppttef4h'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron%intel+coreneuron+debug~legacy-unit~rx3d+tests model_tests=channel-benchmark,olfactory,tqperf-heavy
[+] ^coreneuron@develop%intel@2021.4.0~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=Debug arch=linux-rhel7-skylake
[^] ^boost@1.78.0%intel@2021.4.0+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[+] ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
Concretized
--------------------------------
- 7vuuxvd neuron@develop%intel@2021.4.0+binary~caliper+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python~rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory,tqperf-heavy patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-skylake
- dwdch6b ^bison@3.8.2%intel@2021.4.0 arch=linux-rhel7-skylake
- z3q5f3x ^cmake@3.21.4%intel@2021.4.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[+] f2bfytl ^coreneuron@develop%intel@2021.4.0~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=Debug arch=linux-rhel7-skylake
[^] dl7pfht ^boost@1.78.0%intel@2021.4.0+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] hyunzkn ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vutuzbn ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] utj47fz ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ihxi5rl ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] evtnqzd ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] x72vveu ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[+] cnhmkfz ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5fkun4i ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
- s4ueg72 ^flex@2.6.3%intel@2021.4.0+lex~nls arch=linux-rhel7-skylake
[^] iu2b5hx ^gettext@0.21%gcc@11.2.0+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-skylake
[^] 3rmq3zx ^bzip2@1.0.8%gcc@11.2.0~debug~pic+shared arch=linux-rhel7-skylake
[^] hxxlexb ^libiconv@1.16%gcc@11.2.0 libs=shared,static arch=linux-rhel7-skylake
[^] dnxqn2k ^libxml2@2.9.12%gcc@11.2.0~python arch=linux-rhel7-skylake
[^] jzpqn5y ^xz@5.2.5%gcc@11.2.0~pic libs=shared,static arch=linux-rhel7-skylake
[^] ams67cx ^ncurses@6.2%gcc@11.2.0~symlinks+termlib abi=none arch=linux-rhel7-skylake
[^] ir7xtbl ^tar@1.28%gcc@11.2.0 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-skylake
- 6ggc5yr ^ninja@1.10.2%intel@2021.4.0 arch=linux-rhel7-skylake
[^] n6q4vfz ^py-mpi4py@3.1.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] gjm7kkq ^py-numpy@1.19.5%gcc@11.2.0+blas+lapack patches=8a9d5d1b3f145c043b8b04869e7d46c6ff95c3f486d84f69693017c7e6190c7d arch=linux-rhel7-skylake
[^] r5cvgru ^intel-mkl@2020.4.304%gcc@11.2.0~ilp64+shared threads=none arch=linux-rhel7-skylake
[^] h2fsi6i ^py-cython@0.29.24%gcc@11.2.0 arch=linux-rhel7-skylake
[^] q5n7ofc ^py-pytest-cov@2.8.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] fudvy5v ^py-coverage@5.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5abs2t7 ^readline@8.1%intel@2021.4.0 arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-dwdch6bmdeclr2novthsywtrryotawwz)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-z3q5f3xwpuibd3qbgdscqmu3efarbu42)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-dl7pfhtsvyaq3273gr2g3l5vr37eeydc)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-hyunzknktdzri34bx26bupkvapehonql)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/pkgconf-1.8.0-ihxi5r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-evtnqzdtuvprwnbd2nljimpzywrhw4uo)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/spdlog-1.9.2-x72vve
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-s4ueg72j7l6vkdyvfxj2tweo7v7s3otx)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bzip2-1.0.8-eu2d6e (external bzip2-1.0.8-3rmq3zxuntsiphthnvty6gtydbmbkwr5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libiconv-1.16-hxxlex
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/xz-5.2.5-jzpqn5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ncurses-6.2-nsve5x (external ncurses-6.2-ams67cxbq5vc7wiay2ndr2ksce2igbfw)
[+] /usr (external tar-1.28-ir7xtblauhq3vtkpjrl7ou3nzevcsi3u)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-6ggc5yre7qddwxdjmn7sfptpdoiy4dtp)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/intel-mkl-2020.4.304-rzr3hj (external intel-mkl-2020.4.304-r5cvgrurdnt6y267arsmmmgqi75ouxd2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/readline-8.1-we2frg (external readline-8.1-5abs2t7f6dtgbejv6kjzd4gjwhdlr7qr)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/reportinglib-2.5.6-5fkun4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/hdf5-1.10.7-utj47f
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libxml2-2.9.12-dnxqn2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libsonata-report-1.1-vutuzb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-cython-0.29.24-h2fsi6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpi4py-3.1.2-n6q4vf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-coverage-5.5-fudvy5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/gettext-0.21-iu2b5h
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-numpy-1.19.5-gjm7kk
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-cov-2.8.1-q5n7of
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_intel-2021.4.0-skylake/coreneuron-develop-f2bfyt
==> Installing neuron-develop-7vuuxvdwm3mams7szrb4snbsppttef4h
==> No binary for neuron-develop-7vuuxvdwm3mams7szrb4snbsppttef4h found: installing from source
==> Applied patch /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/bluebrain/repo-patches/packages/neuron/revert_Import3d_numerical_format.master.patch
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
==> neuron: Successfully installed neuron-develop-7vuuxvdwm3mams7szrb4snbsppttef4h
Fetch: 19.32s. Build: 12m 41.36s. Total: 13m 0.67s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_intel-2021.4.0-skylake/neuron-develop-7vuuxv
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319594/ccache
Primary config: /nvme/bbpcihpcproj12/319594/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:59:43 2022
Hits: 711 / 810 (87.78 %)
Direct: 168 / 819 (20.51 %)
Preprocessed: 543 / 645 (84.19 %)
Misses: 99
Direct: 651
Preprocessed: 102
Uncacheable: 128
Primary storage:
Hits: 1187 / 1632 (72.73 %)
Misses: 445
Cache size (GB): 0.47 / 0.51 (91.37 %)
Files: 26715
Uncacheable:
Autoconf compile/link: 7
Called for linking: 105
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646827188:step_script section_start:1646827188:archive_cache Saving cache for successful job
Creating cache build:neuron:nmodl:intel-8...
Runtime platform  arch=amd64 os=linux pid=68826 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Aneuron%3Anmodl%3Aintel-8
Created cache
section_end:1646827209:archive_cache section_start:1646827209:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=69056 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179972 responseStatus=201 Created token=ZKSJTxkY
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=69096 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179972 responseStatus=201 Created token=ZKSJTxkY
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=69140 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179972 responseStatus=201 Created token=ZKSJTxkY
section_end:1646827210:upload_artifacts_on_success section_start:1646827210:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646827211:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826369:resolve_secrets Resolving secrets
section_end:1646826369:resolve_secrets section_start:1646826369:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor163484361, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179970
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179970_PROD_P112_CP9_C3
Job parameters: memory=76G, cpus_per_task=8, duration=2:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319604
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179970_PROD_P112_CP9_C3 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=2:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319604 --cpus-per-task=8 --mem=76G
section_end:1646826401:prepare_executor section_start:1646826401:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646826404:prepare_script section_start:1646826404:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826404:get_sources section_start:1646826404:restore_cache Restoring cache
Checking cache for build:neuron:nmodl:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=24363 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826411:restore_cache section_start:1646826411:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:nmodl:nvhpc:acc (179965)...
Runtime platform  arch=amd64 os=linux pid=24594 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179965 responseStatus=200 OK token=atY9Zsk4
section_end:1646826411:download_artifacts section_start:1646826411:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179970/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179970/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179970/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179970/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179970/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179970_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron%nvhpc +coreneuron+debug+tests~legacy-unit~rx3d model_tests=channel-benchmark,olfactory,tqperf-heavy ^/clohwtjjwrfpo4z4oreptyb2jbe3wrcs
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be dwkjkuknoiprgdt5yhhj7uooz4rce2vl
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319604/ccache
Primary config: /nvme/bbpcihpcproj12/319604/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:47:36 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (91.61 %)
Files: 29927
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'dwkjkuknoiprgdt5yhhj7uooz4rce2vl'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron%nvhpc+coreneuron+debug~legacy-unit~rx3d+tests model_tests=channel-benchmark,olfactory,tqperf-heavy
[+] ^coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared+sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
[^] ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[+] ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
Concretized
--------------------------------
- dwkjkuk neuron@develop%nvhpc@22.2+binary~caliper+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python~rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory,tqperf-heavy patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
- 55wtnz6 ^cmake@3.21.4%nvhpc@22.2~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[+] clohwtj ^coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl~openmp~profile+report+shared+sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
[^] hyunzkn ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vutuzbn ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] utj47fz ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ihxi5rl ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] evtnqzd ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] x72vveu ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[+] cnhmkfz ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5fkun4i ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] iu2b5hx ^gettext@0.21%gcc@11.2.0+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-skylake
[^] 3rmq3zx ^bzip2@1.0.8%gcc@11.2.0~debug~pic+shared arch=linux-rhel7-skylake
[^] hxxlexb ^libiconv@1.16%gcc@11.2.0 libs=shared,static arch=linux-rhel7-skylake
[^] dnxqn2k ^libxml2@2.9.12%gcc@11.2.0~python arch=linux-rhel7-skylake
[^] jzpqn5y ^xz@5.2.5%gcc@11.2.0~pic libs=shared,static arch=linux-rhel7-skylake
[^] ams67cx ^ncurses@6.2%gcc@11.2.0~symlinks+termlib abi=none arch=linux-rhel7-skylake
[^] ir7xtbl ^tar@1.28%gcc@11.2.0 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] n6q4vfz ^py-mpi4py@3.1.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] gjm7kkq ^py-numpy@1.19.5%gcc@11.2.0+blas+lapack patches=8a9d5d1b3f145c043b8b04869e7d46c6ff95c3f486d84f69693017c7e6190c7d arch=linux-rhel7-skylake
[^] r5cvgru ^intel-mkl@2020.4.304%gcc@11.2.0~ilp64+shared threads=none arch=linux-rhel7-skylake
[^] h2fsi6i ^py-cython@0.29.24%gcc@11.2.0 arch=linux-rhel7-skylake
[^] q5n7ofc ^py-pytest-cov@2.8.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] fudvy5v ^py-coverage@5.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vwedalx ^readline@8.1%nvhpc@22.2 arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-55wtnz6tfxjhgdgfbzzwzuhyl746wv7j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-hyunzknktdzri34bx26bupkvapehonql)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/pkgconf-1.8.0-ihxi5r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-evtnqzdtuvprwnbd2nljimpzywrhw4uo)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/spdlog-1.9.2-x72vve
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bzip2-1.0.8-eu2d6e (external bzip2-1.0.8-3rmq3zxuntsiphthnvty6gtydbmbkwr5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libiconv-1.16-hxxlex
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/xz-5.2.5-jzpqn5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ncurses-6.2-nsve5x (external ncurses-6.2-ams67cxbq5vc7wiay2ndr2ksce2igbfw)
[+] /usr (external tar-1.28-ir7xtblauhq3vtkpjrl7ou3nzevcsi3u)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/intel-mkl-2020.4.304-rzr3hj (external intel-mkl-2020.4.304-r5cvgrurdnt6y267arsmmmgqi75ouxd2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/readline-8.1-we2frg (external readline-8.1-vwedalxfrcxjaatlnup77gynyx6weav5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/reportinglib-2.5.6-5fkun4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/hdf5-1.10.7-utj47f
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libxml2-2.9.12-dnxqn2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libsonata-report-1.1-vutuzb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-cython-0.29.24-h2fsi6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-coverage-5.5-fudvy5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpi4py-3.1.2-n6q4vf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/gettext-0.21-iu2b5h
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-numpy-1.19.5-gjm7kk
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-cov-2.8.1-q5n7of
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-clohwt
==> Installing neuron-develop-dwkjkuknoiprgdt5yhhj7uooz4rce2vl
==> No binary for neuron-develop-dwkjkuknoiprgdt5yhhj7uooz4rce2vl found: installing from source
==> Applied patch /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/bluebrain/repo-patches/packages/neuron/revert_Import3d_numerical_format.master.patch
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
==> neuron: Successfully installed neuron-develop-dwkjkuknoiprgdt5yhhj7uooz4rce2vl
Fetch: 29.74s. Build: 37m 22.90s. Total: 37m 52.64s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/neuron-develop-dwkjku
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319604/ccache
Primary config: /nvme/bbpcihpcproj12/319604/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 13:27:14 2022
Hits: 705 / 807 (87.36 %)
Direct: 169 / 816 (20.71 %)
Preprocessed: 536 / 641 (83.62 %)
Misses: 102
Direct: 647
Preprocessed: 105
Uncacheable: 120
Primary storage:
Hits: 1178 / 1626 (72.45 %)
Misses: 448
Cache size (GB): 0.46 / 0.51 (89.81 %)
Files: 29349
Cleanups: 2
Uncacheable:
Autoconf compile/link: 7
Called for linking: 97
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646828836:step_script section_start:1646828836:archive_cache Saving cache for successful job
Creating cache build:neuron:nmodl:nvhpc:acc-8...
Runtime platform  arch=amd64 os=linux pid=107992 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Aneuron%3Anmodl%3Anvhpc%3Aacc-8
Created cache
section_end:1646828855:archive_cache section_start:1646828855:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=108535 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179970 responseStatus=201 Created token=NmQw1Qfg
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=108570 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179970 responseStatus=201 Created token=NmQw1Qfg
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=109001 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179970 responseStatus=201 Created token=NmQw1Qfg
section_end:1646828857:upload_artifacts_on_success section_start:1646828857:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646828858:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826375:resolve_secrets Resolving secrets
section_end:1646826375:resolve_secrets section_start:1646826375:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor153823752, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179969
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179969_PROD_P112_CP2_C4
Job parameters: memory=76G, cpus_per_task=8, duration=2:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319602
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179969_PROD_P112_CP2_C4 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=2:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319602 --cpus-per-task=8 --mem=76G
section_end:1646826401:prepare_executor section_start:1646826401:prepare_script Preparing environment
Running on r1i7n31 via bbpv1.epfl.ch...
section_end:1646826404:prepare_script section_start:1646826404:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826404:get_sources section_start:1646826404:restore_cache Restoring cache
Checking cache for build:neuron:nmodl:nvhpc:omp-8...
Runtime platform  arch=amd64 os=linux pid=204095 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646826410:restore_cache section_start:1646826410:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:nmodl:nvhpc:omp (179964)...
Runtime platform  arch=amd64 os=linux pid=204177 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179964 responseStatus=200 OK token=PrgH_RpU
section_end:1646826411:download_artifacts section_start:1646826411:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179969/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179969/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179969/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179969/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179969/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179969_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install neuron%nvhpc +coreneuron+debug+tests~legacy-unit~rx3d model_tests=channel-benchmark,olfactory,tqperf-heavy ^/jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be ik54mlr5japlprt37kesnyjymcdgaqgh
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319602/ccache
Primary config: /nvme/bbpcihpcproj12/319602/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:47:17 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.45 / 0.51 (88.52 %)
Files: 31025
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'ik54mlr5japlprt37kesnyjymcdgaqgh'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- neuron%nvhpc+coreneuron+debug~legacy-unit~rx3d+tests model_tests=channel-benchmark,olfactory,tqperf-heavy
[+] ^coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl+openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
[^] ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[+] ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
Concretized
--------------------------------
- ik54mlr neuron@develop%nvhpc@22.2+binary~caliper+cmake~codechecks+coreneuron~cross-compile+debug~interviews~ipo+legacy-fr~legacy-unit+memacs+mod-compatibility+mpi+multisend~profile+pysetup+python~rx3d+shared+tests build_type=RelWithDebInfo model_tests=channel-benchmark,olfactory,tqperf-heavy patches=708cb04826b394a858069d93e8c08e1e81e914c23e1ef3da0486e8233834ff6c arch=linux-rhel7-skylake
- ocv5kkj ^bison@3.8.2%nvhpc@22.2 arch=linux-rhel7-skylake
- 55wtnz6 ^cmake@3.21.4%nvhpc@22.2~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
[+] jnp6ftw ^coreneuron@develop%nvhpc@22.2~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi+nmodl+openmp~profile+report+shared~sympy~sympyopt+tests~unified build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] bfwiaoz ^boost@1.78.0%nvhpc@22.2+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 visibility=hidden arch=linux-rhel7-skylake
[^] wd5k5wi ^cuda@11.6.0%nvhpc@22.2~dev arch=linux-rhel7-skylake
[^] hyunzkn ^hpe-mpi@2.25.hmpt%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vutuzbn ^libsonata-report@1.1%gcc@11.2.0~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] utj47fz ^hdf5@1.10.7%gcc@11.2.0+cxx~fortran+hl~ipo~java+mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] ihxi5rl ^pkgconf@1.8.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] evtnqzd ^zlib@1.2.11%gcc@11.2.0+optimize+pic+shared arch=linux-rhel7-skylake
[^] x72vveu ^spdlog@1.9.2%gcc@11.2.0~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-skylake
[+] cnhmkfz ^nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 5fkun4i ^reportinglib@2.5.6%gcc@11.2.0~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-skylake
- xzdnug7 ^flex@2.6.3%nvhpc@22.2+lex~nls arch=linux-rhel7-skylake
[^] iu2b5hx ^gettext@0.21%gcc@11.2.0+bzip2+curses+git~libunistring+libxml2+tar+xz arch=linux-rhel7-skylake
[^] 3rmq3zx ^bzip2@1.0.8%gcc@11.2.0~debug~pic+shared arch=linux-rhel7-skylake
[^] hxxlexb ^libiconv@1.16%gcc@11.2.0 libs=shared,static arch=linux-rhel7-skylake
[^] dnxqn2k ^libxml2@2.9.12%gcc@11.2.0~python arch=linux-rhel7-skylake
[^] jzpqn5y ^xz@5.2.5%gcc@11.2.0~pic libs=shared,static arch=linux-rhel7-skylake
[^] ams67cx ^ncurses@6.2%gcc@11.2.0~symlinks+termlib abi=none arch=linux-rhel7-skylake
[^] ir7xtbl ^tar@1.28%gcc@11.2.0 patches=08921fcbd732050c74ddf1de7d8ad95ffdbc09f8b4342456fa2f6a0dd02a957c,125cd6142fac2cc339e9aebfe79e40f90766022b8e8401532b1729e84fc148c2,5c314db58d005043bf407abaf25eb9823b9032a22fd12a0b142d4bf548130fa4,d428578be7fb99b831eb61e53b8d88a859afe08b479a21238180899707d79ce4 arch=linux-rhel7-skylake
- ij6isvr ^ninja@1.10.2%nvhpc@22.2 arch=linux-rhel7-skylake
[^] n6q4vfz ^py-mpi4py@3.1.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] gjm7kkq ^py-numpy@1.19.5%gcc@11.2.0+blas+lapack patches=8a9d5d1b3f145c043b8b04869e7d46c6ff95c3f486d84f69693017c7e6190c7d arch=linux-rhel7-skylake
[^] r5cvgru ^intel-mkl@2020.4.304%gcc@11.2.0~ilp64+shared threads=none arch=linux-rhel7-skylake
[^] h2fsi6i ^py-cython@0.29.24%gcc@11.2.0 arch=linux-rhel7-skylake
[^] q5n7ofc ^py-pytest-cov@2.8.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] fudvy5v ^py-coverage@5.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] vwedalx ^readline@8.1%nvhpc@22.2 arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-ocv5kkjjvqshvbpp4gh3xrg4aj3xxh2k)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-55wtnz6tfxjhgdgfbzzwzuhyl746wv7j)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/boost-1.78.0-hiorc7 (external boost-1.78.0-bfwiaozbrpjr7blzjkfcz67vabdnspxj)
==> cuda@11.6.0 : has external module in ['cuda/11.6.0']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cuda-11.6.0-34qjta (external cuda-11.6.0-wd5k5wioelahwux72y3g3bytolebtkoh)
==> hpe-mpi@2.25.hmpt : has external module in ['hpe-mpi/2.25.hmpt']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/hpe-mpi-2.25.hmpt-4ukyxt (external hpe-mpi-2.25.hmpt-hyunzknktdzri34bx26bupkvapehonql)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/pkgconf-1.8.0-ihxi5r
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/zlib-1.2.11-mswjss (external zlib-1.2.11-evtnqzdtuvprwnbd2nljimpzywrhw4uo)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/spdlog-1.9.2-x72vve
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-xzdnug7pkmqiem4ll6p4chgbnwyt7epd)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bzip2-1.0.8-eu2d6e (external bzip2-1.0.8-3rmq3zxuntsiphthnvty6gtydbmbkwr5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libiconv-1.16-hxxlex
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/xz-5.2.5-jzpqn5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ncurses-6.2-nsve5x (external ncurses-6.2-ams67cxbq5vc7wiay2ndr2ksce2igbfw)
[+] /usr (external tar-1.28-ir7xtblauhq3vtkpjrl7ou3nzevcsi3u)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-ij6isvr7fpc6nbooavdi3abtviuzpngb)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/intel-mkl-2020.4.304-rzr3hj (external intel-mkl-2020.4.304-r5cvgrurdnt6y267arsmmmgqi75ouxd2)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/readline-8.1-we2frg (external readline-8.1-vwedalxfrcxjaatlnup77gynyx6weav5)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/reportinglib-2.5.6-5fkun4
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/hdf5-1.10.7-utj47f
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libxml2-2.9.12-dnxqn2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libsonata-report-1.1-vutuzb
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpi4py-3.1.2-n6q4vf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-cython-0.29.24-h2fsi6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-coverage-5.5-fudvy5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/gettext-0.21-iu2b5h
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-numpy-1.19.5-gjm7kk
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-cov-2.8.1-q5n7of
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/coreneuron-develop-jnp6ft
==> Installing neuron-develop-ik54mlr5japlprt37kesnyjymcdgaqgh
==> No binary for neuron-develop-ik54mlr5japlprt37kesnyjymcdgaqgh found: installing from source
==> Applied patch /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/bluebrain/repo-patches/packages/neuron/revert_Import3d_numerical_format.master.patch
==> neuron: Executing phase: 'cmake'
==> neuron: Executing phase: 'build'
==> neuron: Executing phase: 'install'
==> neuron: Successfully installed neuron-develop-ik54mlr5japlprt37kesnyjymcdgaqgh
Fetch: 13.63s. Build: 29m 34.28s. Total: 29m 47.91s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_nvhpc-22.2-skylake/neuron-develop-ik54ml
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319602/ccache
Primary config: /nvme/bbpcihpcproj12/319602/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 13:18:03 2022
Hits: 710 / 807 (87.98 %)
Direct: 169 / 816 (20.71 %)
Preprocessed: 541 / 641 (84.40 %)
Misses: 97
Direct: 647
Preprocessed: 100
Uncacheable: 120
Primary storage:
Hits: 1183 / 1626 (72.76 %)
Misses: 443
Cache size (GB): 0.46 / 0.51 (89.21 %)
Files: 31359
Uncacheable:
Autoconf compile/link: 7
Called for linking: 97
Called for preprocessing: 1
Compilation failed: 3
No input file: 6
Preprocessing failed: 6
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646828285:step_script section_start:1646828285:archive_cache Saving cache for successful job
Creating cache build:neuron:nmodl:nvhpc:omp-8...
Runtime platform  arch=amd64 os=linux pid=224045 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Aneuron%3Anmodl%3Anvhpc%3Aomp-8
Created cache
section_end:1646828305:archive_cache section_start:1646828305:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=224157 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179969 responseStatus=201 Created token=NtFoy6Ji
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=224199 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179969 responseStatus=201 Created token=NtFoy6Ji
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=224237 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179969 responseStatus=201 Created token=NtFoy6Ji
section_end:1646828306:upload_artifacts_on_success section_start:1646828306:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646828307:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825727:resolve_secrets Resolving secrets
section_end:1646825727:resolve_secrets section_start:1646825727:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor386983677, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179961
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=8
A slurm job will be created with name GL_J179961_PROD_P112_CP2_C4
Job parameters: memory=76G, cpus_per_task=8, duration=1:00:00, constraint=cpu ntasks=2 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319494
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=2 --cpus-per-task=8 --mem=76G --job-name=GL_J179961_PROD_P112_CP2_C4 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=2 --jobid=319494 --cpus-per-task=8 --mem=76G
section_end:1646825756:prepare_executor section_start:1646825756:prepare_script Preparing environment
Running on r1i5n31 via bbpv1.epfl.ch...
section_end:1646825758:prepare_script section_start:1646825758:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825759:get_sources section_start:1646825759:restore_cache Restoring cache
Checking cache for build:nmodl-8...
Runtime platform  arch=amd64 os=linux pid=40382 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1646825764:restore_cache section_start:1646825764:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (179959)...
Runtime platform  arch=amd64 os=linux pid=40451 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179959 responseStatus=200 OK token=-7SAWh_S
section_end:1646825765:download_artifacts section_start:1646825765:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export SPACK_USER_CONFIG_PATH=${PWD}/spack-config
$ mkdir ${SPACK_USER_CONFIG_PATH}
$ cat > ${SPACK_USER_CONFIG_PATH}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179961/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179961/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179961/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179961/spack-config/config.yaml:4 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179961/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/config.yaml:2 ccache: True
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:2 install_tree:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:3 root: $user_cache_path/software
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:5 all: install_{compiler.name}-{compiler.version}-{target}/{name}-{version}-{hash:6}
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:6 module_roots:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:7 tcl: $user_cache_path/modules
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:9 environments:
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:10 root: $user_cache_path/environments
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:88 concretization: separately
/gpfs/bbp.cscs.ch/ssd/apps/bsd//config/config.yaml:12 build_jobs: 8
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 extensions:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:18 - $spack/bluebrain/spack-scripting
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # This is the path to the root of the Spack install tree.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:19 # You can use $spack here to refer to the root of the spack instance.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:37 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Temporary locations Spack can try to use for builds.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Recommended options are given below.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Builds can be faster in temporary directories on some (e.g., HPC) systems.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Specifying `$tempdir` will ensure use of the default temporary directory
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # (i.e., ``$TMP` or ``$TMPDIR``).
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # Another option that prevents conflicts and potential permission issues is
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # to specify `$user_cache_path/stage`, which ensures each user builds in their
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # home directory.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # A more traditional path uses the value of `$spack/var/spack/stage`, which
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # builds directly inside Spack's instance without staging them in a
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # temporary space. Problems with specifying a path inside a Spack instance
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # are that it precludes its use as a system package and its ability to be
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # pip installable.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # In any case, if the username is not already in the path, Spack will append
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # the value of `$user` in an attempt to avoid potential conflicts between
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # users in shared temporary spaces.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 #
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # The build stage can be purged with `spack clean --stage` and
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # `spack clean -a`, so it is important that the specified directory uniquely
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:38 # identifies Spack staging to avoid accidentally wiping out non-Spack work.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:73 test_stage: $user_cache_path/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:82 misc_cache: $user_cache_path/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:94 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:99 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:107 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:113 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:118 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:123 deprecated: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:128 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:136 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:145 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:150 url_fetch_method: urllib
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:176 concretizer: clingo
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:183 db_lock_timeout: 300
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:191 package_lock_timeout: null
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:197 shared_linking: rpath
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:202 allow_sgid: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959/spack/etc/spack/defaults/config.yaml:207 terminal_title: False
_builtin debug: False
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179961_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER} ${SPACK_PACKAGE_SPEC} ${SPACK_PACKAGE_DEPENDENCIES} ${SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install nmodl%gcc ~legacy-unit
$ JSON_SPEC=$(spack spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(module load unstable python; echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][\"nodes\"][0][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be cnhmkfzsucqnmy6dfxyfikno2yj57grf
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=$(realpath -P ${CI_BUILDS_DIR})
$ echo CCACHE_BASEDIR=${CCACHE_BASEDIR}
CCACHE_BASEDIR=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032
$ export CCACHE_MAXSIZE=512M
$ export CCACHE_DIR="${TMPDIR}/ccache"
$ mkdir -p ${CCACHE_DIR}
$ if [ -f ${CI_PROJECT_DIR}/ccache.tar ]; then
$ tar -C "${CCACHE_DIR}" -xf "${CI_PROJECT_DIR}/ccache.tar"
$ fi
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319494/ccache
Primary config: /nvme/bbpcihpcproj12/319494/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:36:28 2022
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.47 / 0.51 (90.94 %)
Files: 1429
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'cnhmkfzsucqnmy6dfxyfikno2yj57grf'
$ spack spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- nmodl%gcc~legacy-unit
Concretized
--------------------------------
- cnhmkfz nmodl@develop%gcc@11.2.0~ipo~legacy-unit~python build_type=RelWithDebInfo arch=linux-rhel7-skylake
- cppb7al ^bison@3.8.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 2qmvlfy ^cmake@3.21.4%gcc@11.2.0~doc+ncurses+openssl+ownlibs~qt build_type=Release arch=linux-rhel7-skylake
- 4bt76dp ^flex@2.6.3%gcc@11.2.0+lex~nls arch=linux-rhel7-skylake
- utrxbc3 ^ninja@1.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] onq3mhg ^py-jinja2@3.0.1%gcc@11.2.0~i18n arch=linux-rhel7-skylake
[^] 4ectow5 ^py-markupsafe@2.0.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] v4z3s5e ^py-setuptools@57.4.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 72xzp3v ^python@3.9.7%gcc@11.2.0+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87,4c2457325f2b608b1b6a2c63087df8c26e07db3e3d493caf36a56f0ecf6fb768,f2fd060afc4b4618fe8104c4c5d771f36dc55b1db5a4623785a4ea707ec72fb4 arch=linux-rhel7-skylake
[^] 22arfs4 ^py-pytest@6.2.4%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ascbeii ^py-attrs@21.2.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] kvw3vhm ^py-iniconfig@1.1.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] 7iyiygo ^py-packaging@21.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] c7qvw2q ^py-pyparsing@2.4.7%gcc@11.2.0 arch=linux-rhel7-skylake
[^] mazoiox ^py-pluggy@0.13.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ciusbmc ^py-setuptools-scm@6.3.2%gcc@11.2.0+toml arch=linux-rhel7-skylake
[^] hmcew6w ^py-tomli@1.2.1%gcc@11.2.0 arch=linux-rhel7-skylake
[^] sxd7srs ^py-pip@21.1.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] y7rfzdj ^py-py@1.9.0%gcc@11.2.0 arch=linux-rhel7-skylake
[^] w4gddqx ^py-toml@0.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
[^] ci5oe5b ^py-pyyaml@5.3.1%gcc@11.2.0+libyaml arch=linux-rhel7-skylake
[^] xj2wlac ^libyaml@0.2.5%gcc@11.2.0 arch=linux-rhel7-skylake
[^] xtett6q ^py-sympy@1.8%gcc@11.2.0 arch=linux-rhel7-skylake
[^] dzb2mfs ^py-mpmath@1.1.0%gcc@11.2.0 arch=linux-rhel7-skylake
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC} || install_failed=1
==> bison@3.8.2 : has external module in ['bison/3.8.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/bison-3.8.2-ej2cew (external bison-3.8.2-cppb7alftvhxbedsuxqv72z2thjuoizw)
==> cmake@3.21.4 : has external module in ['cmake/3.21.4']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/cmake-3.21.4-cdyb7k (external cmake-3.21.4-2qmvlfyylrv3t5ankluyr5cqey2nlfzd)
==> flex@2.6.3 : has external module in ['flex/2.6.3']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/flex-2.6.3-3mtl7j (external flex-2.6.3-4bt76dpxbix6ep4qtz3mv5i2iddilv53)
==> ninja@1.10.2 : has external module in ['ninja/1.10.2']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ninja-1.10.2-eh33rh (external ninja-1.10.2-utrxbc3aohnru5eynalc3hyv4ca4jqte)
==> python@3.9.7 : has external module in ['python/3.9.7']
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/python-3.9.7-yj5alh (external python-3.9.7-72xzp3vgzh5b424qevkfruhs3ajzqbiy)
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/libyaml-0.2.5-xj2wla
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-mpmath-1.1.0-dzb2mf
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-57.4.0-v4z3s5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyyaml-5.3.1-ci5oe5
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-sympy-1.8-xtett6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pip-21.1.2-sxd7sr
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-iniconfig-1.1.1-kvw3vh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-markupsafe-2.0.1-4ectow
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-attrs-21.2.0-ascbei
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-toml-0.10.2-w4gddq
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pyparsing-2.4.7-c7qvw2
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-tomli-1.2.1-hmcew6
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-jinja2-3.0.1-onq3mh
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-packaging-21.0-7iyiyg
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-setuptools-scm-6.3.2-ciusbm
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-py-1.9.0-y7rfzd
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pluggy-0.13.0-mazoio
[+] /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_applications/install_gcc-11.2.0-skylake/py-pytest-6.2.4-22arfs
==> Installing nmodl-develop-cnhmkfzsucqnmy6dfxyfikno2yj57grf
==> No binary for nmodl-develop-cnhmkfzsucqnmy6dfxyfikno2yj57grf found: installing from source
==> No patches needed for nmodl
==> nmodl: Executing phase: 'cmake'
==> nmodl: Executing phase: 'build'
==> nmodl: Executing phase: 'install'
==> nmodl: Successfully installed nmodl-develop-cnhmkfzsucqnmy6dfxyfikno2yj57grf
Fetch: 32.90s. Build: 1m 55.69s. Total: 2m 28.59s.
[+] /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/software/install_gcc-11.2.0-skylake/nmodl-develop-cnhmkf
$ chmod -R g+rX "${SPACK_BUILD}"
$ if [[ ${install_failed} == 1 ]]; then exit 1; fi
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ ccache --cleanup
$ ccache --show-stats --verbose
Summary:
Cache directory: /nvme/bbpcihpcproj12/319494/ccache
Primary config: /nvme/bbpcihpcproj12/319494/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/bsd/2022-01-10/stage_externals/install_gcc-11.2.0-skylake/ccache-4.4.2-6qbndl/etc/ccache.conf
Stats updated: Wed Mar 9 12:39:41 2022
Hits: 133 / 135 (98.52 %)
Direct: 31 / 135 (22.96 %)
Preprocessed: 102 / 104 (98.08 %)
Misses: 2
Direct: 104
Preprocessed: 2
Uncacheable: 27
Primary storage:
Hits: 164 / 270 (60.74 %)
Misses: 106
Cache size (GB): 0.47 / 0.51 (90.97 %)
Files: 1433
Uncacheable:
Called for linking: 26
No input file: 1
$ tar -C "${CCACHE_DIR}" -cf "${CI_PROJECT_DIR}/ccache.tar" .
$ fi
$ touch ${SPACK_STAGE_DIR}/spack-configure-args.txt
$ cp ${SPACK_STAGE_DIR}/spack-{build-env,build-out,configure-args}.txt ${CI_PROJECT_DIR}/
$ echo "SPACK_BUILD_DIR=${SPACK_BUILD_DIR}" > ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_FULL_SPEC=${SPACK_FULL_SPEC}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_SOURCE_DIR=${SPACK_SOURCE_DIR}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_INSTALLED_HASH=${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ echo "SPACK_PACKAGE_DEPENDENCY_ON_PREVIOUS_JOB=^/${SPACK_INSTALLED_HASH}" >> ${CI_PROJECT_DIR}/spack_build_info.env
$ num_failures=$(module load unstable python-dev; python -c "from lxml import etree; xml = etree.parse('${CI_PROJECT_DIR}/install.xml'); print(sum(1 for _ in xml.getroot().iter('failure')) + sum(1 for _ in xml.getroot().iter('error')))")
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ if [[ ${num_failures} > 0 ]]; then exit ${num_failures}; fi
section_end:1646825983:step_script section_start:1646825983:archive_cache Saving cache for successful job
Creating cache build:nmodl-8...
Runtime platform  arch=amd64 os=linux pid=42859 revision=58ba2b95 version=14.2.0
ccache.tar: found 1 matching files and directories
Uploading cache.zip to https://bbpobjectstorage.epfl.ch/gitlab-runners-cache/project/112/build%3Anmodl-8
Created cache
section_end:1646826003:archive_cache section_start:1646826003:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=43216 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
spack-build-env.txt: found 1 matching files and directories
spack-build-out.txt: found 1 matching files and directories
spack-configure-args.txt: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179961 responseStatus=201 Created token=8y7dxwFF
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=43256 revision=58ba2b95 version=14.2.0
install.xml: found 1 matching files and directories
Uploading artifacts as "junit" to coordinator... ok id=179961 responseStatus=201 Created token=8y7dxwFF
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=43300 revision=58ba2b95 version=14.2.0
spack_build_info.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179961 responseStatus=201 Created token=8y7dxwFF
section_end:1646826005:upload_artifacts_on_success section_start:1646826005:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826005:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825641:resolve_secrets Resolving secrets
section_end:1646825641:resolve_secrets section_start:1646825641:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor591810627, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179959
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=6
A slurm job will be created with name GL_J179959_PROD_P112_CP2_C4
Job parameters: memory=30750M, cpus_per_task=6, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319487
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=1 --cpus-per-task=6 --mem=30750M --job-name=GL_J179959_PROD_P112_CP2_C4 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=1 --jobid=319487 --cpus-per-task=6 --mem=30750M
section_end:1646825642:prepare_executor section_start:1646825642:prepare_script Preparing environment
Running on r1i7n31 via bbpv1.epfl.ch...
section_end:1646825644:prepare_script section_start:1646825644:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825645:get_sources section_start:1646825645:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ if [[ -n "${SPACK_ENV_FILE_URL}" && "${PARSE_GITHUB_PR_DESCRIPTIONS,,}" == "true" ]]; then
$ cat > parse_description.py << END_SCRIPT # collapsed multi-line command
$ cat parse_description.py
import os
import re
import requests
pr_info = requests.get("https://api.github.com/repos/{}/pulls/{}".format(
os.environ['CI_EXTERNAL_PULL_REQUEST_TARGET_REPOSITORY'],
os.environ['CI_EXTERNAL_PULL_REQUEST_IID']),
headers={'Accept': 'application/vnd.github.v3+json'})
pr_body = pr_info.json()["body"]
# match something like NEURON_BRANCH=foo/bar
pat = re.compile('^([A-Z0-9_]+)_([A-Z]+)=([A-Z0-9\-\_\/\+]+)$', re.IGNORECASE)
def parse_term(m):
ref_type = m.group(2).lower()
if ref_type not in {'branch', 'tag', 'ref'}: return
print(m.group(1).upper() + '_' + ref_type.upper() + '=' + m.group(3))
if pr_body is not None:
for pr_body_line in pr_body.splitlines():
if not pr_body_line.startswith('CI_BRANCHES:'): continue
for config_term in pr_body_line[12:].split(','):
pat.sub(parse_term, config_term)
$ (module load unstable python-dev; python parse_description.py) > input_variables.env
Autoloading python/3.9.7
Autoloading py-virtualenv/16.7.6
Autoloading py-scipy/1.7.1
Autoloading py-numpy/1.19.5
Autoloading py-mpi4py/3.1.2
Autoloading hpe-mpi/2.25.hmpt
Autoloading py-h5py/3.4.0
Autoloading hdf5/1.10.7
$ else
$ cat input_variables.env
NEURON_BRANCH=hines/POINTER-to-RANGE
$ for var_to_unset in $(sed 's/^\(.*\?\)_\(BRANCH\|COMMIT\|TAG\)=.*$/\1_BRANCH\n\1_COMMIT\n\1_TAG/' input_variables.env); do # collapsed multi-line command
Unsetting NEURON_BRANCH
$ set -o allexport
$ . input_variables.env
$ set +o allexport
$ unset MODULEPATH
$ . /gpfs/bbp.cscs.ch/ssd/apps/bsd/${SPACK_DEPLOYMENT_SUFFIX}/config/modules.sh
$ echo "MODULEPATH=${MODULEPATH}" > spack_clone_variables.env
$ echo Preparing to clone Spack into ${PWD}
Preparing to clone Spack into /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179959
$ if [[ -z "${SPACK_BRANCH}" && ( -n "${SPACK_COMMIT}" || -n "${SPACK_TAG}" ) ]]; then
$ echo Checking out the ${SPACK_BRANCH} of Spack...
Checking out the develop of Spack...
$ module load unstable git
$ git clone -c feature.manyFiles=true --depth 1 --single-branch --branch ${SPACK_BRANCH} ${SPACK_URL} spack
Cloning into 'spack'...
Updating files: 21% (1927/9132) Updating files: 22% (2010/9132) Updating files: 23% (2101/9132) Updating files: 24% (2192/9132) Updating files: 25% (2283/9132) Updating files: 26% (2375/9132) Updating files: 27% (2466/9132) Updating files: 28% (2557/9132) Updating files: 29% (2649/9132) Updating files: 30% (2740/9132) Updating files: 31% (2831/9132) Updating files: 31% (2838/9132) Updating files: 32% (2923/9132) Updating files: 33% (3014/9132) Updating files: 34% (3105/9132) Updating files: 35% (3197/9132) Updating files: 36% (3288/9132) Updating files: 37% (3379/9132) Updating files: 38% (3471/9132) Updating files: 39% (3562/9132) Updating files: 40% (3653/9132) Updating files: 41% (3745/9132) Updating files: 41% (3746/9132) Updating files: 42% (3836/9132) Updating files: 43% (3927/9132) Updating files: 44% (4019/9132) Updating files: 45% (4110/9132) Updating files: 46% (4201/9132) Updating files: 47% (4293/9132) Updating files: 48% (4384/9132) Updating files: 49% (4475/9132) Updating files: 50% (4566/9132) Updating files: 51% (4658/9132) Updating files: 51% (4703/9132) Updating files: 52% (4749/9132) Updating files: 53% (4840/9132) Updating files: 54% (4932/9132) Updating files: 55% (5023/9132) Updating files: 56% (5114/9132) Updating files: 57% (5206/9132) Updating files: 58% (5297/9132) Updating files: 59% (5388/9132) Updating files: 60% (5480/9132) Updating files: 61% (5571/9132) Updating files: 62% (5662/9132) Updating files: 62% (5730/9132) Updating files: 63% (5754/9132) Updating files: 64% (5845/9132) Updating files: 65% (5936/9132) Updating files: 66% (6028/9132) Updating files: 67% (6119/9132) Updating files: 68% (6210/9132) Updating files: 69% (6302/9132) Updating files: 70% (6393/9132) Updating files: 71% (6484/9132) Updating files: 72% (6576/9132) Updating files: 73% (6667/9132) Updating files: 74% (6758/9132) Updating files: 75% (6849/9132) Updating files: 76% (6941/9132) Updating files: 77% (7032/9132) Updating files: 78% (7123/9132) Updating files: 78% (7125/9132) Updating files: 79% (7215/9132) Updating files: 80% (7306/9132) Updating files: 81% (7397/9132) Updating files: 82% (7489/9132) Updating files: 83% (7580/9132) Updating files: 84% (7671/9132) Updating files: 85% (7763/9132) Updating files: 86% (7854/9132) Updating files: 87% (7945/9132) Updating files: 88% (8037/9132) Updating files: 89% (8128/9132) Updating files: 90% (8219/9132) Updating files: 91% (8311/9132) Updating files: 92% (8402/9132) Updating files: 93% (8493/9132) Updating files: 93% (8518/9132) Updating files: 94% (8585/9132) Updating files: 95% (8676/9132) Updating files: 96% (8767/9132) Updating files: 97% (8859/9132) Updating files: 98% (8950/9132) Updating files: 99% (9041/9132) Updating files: 100% (9132/9132) Updating files: 100% (9132/9132), done.
$ export SPACK_ROOT=${PWD}/spack
$ export SPACK_USER_CACHE_PATH="${CI_BUILDS_DIR}"
$ export SPACK_SYSTEM_CONFIG_PATH="/gpfs/bbp.cscs.ch/ssd/apps/bsd/${SPACK_DEPLOYMENT_SUFFIX}/config"
$ echo "SPACK_ROOT=${SPACK_ROOT}" >> spack_clone_variables.env
$ echo "SPACK_USER_CACHE_PATH=${SPACK_USER_CACHE_PATH}" >> spack_clone_variables.env
$ echo "SPACK_SYSTEM_CONFIG_PATH=${SPACK_SYSTEM_CONFIG_PATH}" >> spack_clone_variables.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ export XDG_CONFIG_HOME=${CI_BUILDS_DIR}/J${CI_JOB_ID}_local_config
$ echo "Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (${XDG_CONFIG_HOME})"
Configuring git to use CI_JOB_TOKEN to access git@bbpgitlab.epfl.ch (/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032/J179959_local_config)
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ env -0 | sed -nz '/^CUSTOM_ENV_/d;/^[^=]\+_\(BRANCH\|COMMIT\|TAG\)=.\+/p' | xargs -0t spack configure-pipeline --ignore-packages CI_COMMIT CI_DEFAULT GITLAB_PIPELINES SPACK ${SPACK_SETUP_IGNORE_PACKAGE_VARIABLES} --write-commit-file=commit-mapping.env
spack configure-pipeline --ignore-packages CI_COMMIT CI_DEFAULT GITLAB_PIPELINES SPACK --write-commit-file=commit-mapping.env CI_COMMIT_BRANCH=hines/POINTER-to-RANGE GITLAB_PIPELINES_BRANCH=main NEURON_BRANCH=hines/POINTER-to-RANGE NMODL_BRANCH=master SPACK_BRANCH=develop CI_DEFAULT_BRANCH=master CORENEURON_COMMIT=99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28
==> CI_COMMIT: ignoring CI_COMMIT_BRANCH=hines/POINTER-to-RANGE
==> GITLAB_PIPELINES: ignoring GITLAB_PIPELINES_BRANCH=main
==> SPACK: ignoring SPACK_BRANCH=develop
==> CI_DEFAULT: ignoring CI_DEFAULT_BRANCH=master
==> neuron: resolved branch hines/POINTER-to-RANGE to c823fbf8b9fc8e6557764935dfad17f14cf766d0
==> nmodl: resolved branch master to 9de6a5d59b2861402d50ef27e8fba4a39abbbf70
==> neuron@develop: remove branch/commit/tag
==> neuron@develop: use commit="c823fbf8b9fc8e6557764935dfad17f14cf766d0"
==> neuron@develop: add preferred=True
==> nmodl@develop: remove branch/commit/tag
==> nmodl@develop: use commit="9de6a5d59b2861402d50ef27e8fba4a39abbbf70"
==> nmodl@develop: add preferred=True
==> coreneuron@develop: remove branch/commit/tag
==> coreneuron@develop: use commit="99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28"
==> coreneuron@develop: add preferred=True
$ (cd "${SPACK_ROOT}" && git diff)
diff --git a/bluebrain/repo-bluebrain/packages/coreneuron/package.py b/bluebrain/repo-bluebrain/packages/coreneuron/package.py
index 88e0cc5..35cd11b 100644
--- a/bluebrain/repo-bluebrain/packages/coreneuron/package.py
+++ b/bluebrain/repo-bluebrain/packages/coreneuron/package.py
@@ -20,7 +20,7 @@ class Coreneuron(CMakePackage):
# This simplifies testing the gitlab-pipelines repository:
git = "git@bbpgitlab.epfl.ch:hpc/coreneuron.git"
- version('develop', branch='master')
+ version('develop', preferred=True, commit='99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28') # old: branch='master'
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20220304', commit='2d08705')
version('1.0.0.20220218', commit='102ebde')
diff --git a/bluebrain/repo-bluebrain/packages/nmodl/package.py b/bluebrain/repo-bluebrain/packages/nmodl/package.py
index 2baf3d1..3dcae14 100644
--- a/bluebrain/repo-bluebrain/packages/nmodl/package.py
+++ b/bluebrain/repo-bluebrain/packages/nmodl/package.py
@@ -14,7 +14,7 @@ class Nmodl(CMakePackage):
git = "https://github.com/BlueBrain/nmodl.git"
# 0.3.1 > 0.3.0.20220110 > 0.3.0 > 0.3b > 0.3 to Spack
- version('develop', branch='master', submodules=True)
+ version('develop', preferred=True, commit='9de6a5d59b2861402d50ef27e8fba4a39abbbf70', submodules=True) # old: branch='master'
# For deployment; nmodl@0.3.0%nvhpc@21.11 doesn't build with eigen/intrinsics errors
version('0.3.0.20220110', commit='9e0a6f260ac2e6fad068a39ea3bdf7aa7a6f4ee0')
version('0.3.0', tag='0.3')
diff --git a/bluebrain/repo-patches/packages/neuron/package.py b/bluebrain/repo-patches/packages/neuron/package.py
index 3f44d8c..6bb14d0 100644
--- a/bluebrain/repo-patches/packages/neuron/package.py
+++ b/bluebrain/repo-patches/packages/neuron/package.py
@@ -34,7 +34,7 @@ class Neuron(CMakePackage):
# Patch for recent CMake versions that don't identify NVHPC as PGI
patch("patch-v800-cmake-nvhpc.patch", when="@8.0.0%nvhpc^cmake@3.20:")
- version("develop", branch="master")
+ version('develop', preferred=True, commit='c823fbf8b9fc8e6557764935dfad17f14cf766d0') # old: branch="master"
version("8.0.2", tag="8.0.2")
version("8.0.1", tag="8.0.1")
version("8.0.0", tag="8.0.0")
$ cat commit-mapping.env
NEURON_COMMIT=c823fbf8b9fc8e6557764935dfad17f14cf766d0
NMODL_COMMIT=9de6a5d59b2861402d50ef27e8fba4a39abbbf70
CORENEURON_COMMIT=99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28
$ echo "SPACK_BRANCH=${SPACK_BRANCH}" >> commit-mapping.env
$ echo "SPACK_DEPLOYMENT_SUFFIX=${SPACK_DEPLOYMENT_SUFFIX}" >> commit-mapping.env
$ cat commit-mapping.env >> spack_clone_variables.env
$ spack spec -IL ninja
Input spec
--------------------------------
- ninja
Concretized
--------------------------------
==> Bootstrapping clingo from pre-built binaries
- utrxbc3aohnru5eynalc3hyv4ca4jqte ninja@1.10.2%gcc@11.2.0 arch=linux-rhel7-skylake
$ echo "SPACK_SETUP_COMMIT_MAPPING_URL=${CI_API_V4_URL}/projects/${CI_PROJECT_ID}/jobs/${CI_JOB_ID}/artifacts/commit-mapping.env" >> spack_clone_variables.env
$ spack config --scope site add "config:ccache:true"
$ echo "SPACK_USE_CCACHE=true" >> spack_clone_variables.env
section_end:1646825721:step_script section_start:1646825721:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=197146 revision=58ba2b95 version=14.2.0
commit-mapping.env: found 1 matching files and directories
input_variables.env: found 1 matching files and directories
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "archive" to coordinator... ok id=179959 responseStatus=201 Created token=-7SAWh_S
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=197170 revision=58ba2b95 version=14.2.0
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=179959 responseStatus=201 Created token=-7SAWh_S
section_end:1646825722:upload_artifacts_on_success section_start:1646825722:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646825723:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646825910:resolve_secrets Resolving secrets
section_end:1646825910:resolve_secrets section_start:1646825910:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor353719578, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179977
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179977_PROD_P112_CP7_C7
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319553
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J179977_PROD_P112_CP7_C7 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=8 --jobid=319553 --cpus-per-task=1 --mem=30750M
section_end:1646825940:prepare_executor section_start:1646825940:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646825944:prepare_script section_start:1646825944:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646825946:get_sources section_start:1646825946:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:mod2c:intel (179966)...
Runtime platform  arch=amd64 os=linux pid=774 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179966 responseStatus=200 OK token=2_MWRqfN
section_end:1646825948:download_artifacts section_start:1646825948:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n31
Build name: Linux-icpc
Create new tag: 20220309-1140 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179966/spack-build/spack-stage-coreneuron-develop-hsyhen5wbojr4dsx5rf32wndj3dpm5nb/spack-build-hsyhen5
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #6: ring_TEST .......................... Passed 2.20 sec
Start 7: ring_binqueue_TEST
2/17 Test #17: reporting_1 ........................ Passed 2.21 sec
3/17 Test #1: cmd_interface_test ................. Passed 2.38 sec
Start 8: ring_multisend_TEST
4/17 Test #3: alignment_test ..................... Passed 2.85 sec
5/17 Test #2: interleave_info_constructor_test ... Passed 2.90 sec
Start 9: ring_spike_buffer_TEST
6/17 Test #4: queuing_test ....................... Passed 2.91 sec
7/17 Test #5: lfp_test ........................... Passed 3.09 sec
Start 10: ring_permute1_TEST
8/17 Test #7: ring_binqueue_TEST ................. Passed 4.72 sec
Start 11: ring_permute2_TEST
9/17 Test #10: ring_permute1_TEST ................. Passed 4.12 sec
Start 12: ring_gap_TEST
10/17 Test #8: ring_multisend_TEST ................ Passed 4.86 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #13: ring_gap_binqueue_TEST ............. Passed 2.52 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 3.43 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #12: ring_gap_TEST ...................... Passed 3.51 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #9: ring_spike_buffer_TEST ............. Passed 8.15 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 2.06 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 1.68 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 1.62 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 12.47 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646826034:step_script section_start:1646826034:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=5446 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179977 responseStatus=201 Created token=_kQtgkW3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=5501 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179977 responseStatus=201 Created token=_kQtgkW3
section_end:1646826035:upload_artifacts_on_success section_start:1646826035:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826036:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826033:resolve_secrets Resolving secrets
section_end:1646826033:resolve_secrets section_start:1646826033:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor059737182, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179974
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179974_PROD_P112_CP5_C8
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319562
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J179974_PROD_P112_CP5_C8 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=8 --jobid=319562 --cpus-per-task=1 --mem=30750M
section_end:1646826042:prepare_executor section_start:1646826042:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646826045:prepare_script section_start:1646826045:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826046:get_sources section_start:1646826046:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:mod2c:nvhpc:acc:unified (179963)...
Runtime platform  arch=amd64 os=linux pid=182060 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179963 responseStatus=200 OK token=HHCPVuHs
section_end:1646826047:download_artifacts section_start:1646826047:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n17
Build name: Linux-nvc++
Create new tag: 20220309-1141 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179963/spack-build/spack-stage-coreneuron-develop-5u3hb5563fiewjkvz6z6mzftkoy4lmwk/spack-build-5u3hb55
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 19: reporting_1
1/19 Test #4: queuing_test ........................... Passed 6.71 sec
2/19 Test #1: cmd_interface_test ..................... Passed 6.82 sec
Start 7: ring_binqueue_TEST
3/19 Test #5: lfp_test ............................... Passed 7.01 sec
4/19 Test #19: reporting_1 ............................ Passed 44.93 sec
Start 8: ring_multisend_TEST
5/19 Test #2: interleave_info_constructor_test ....... Passed 45.50 sec
6/19 Test #3: alignment_test ......................... Passed 45.67 sec
Start 9: ring_spike_buffer_TEST
7/19 Test #6: ring_TEST .............................. Passed 45.87 sec
Start 10: ring_permute1_TEST
8/19 Test #7: ring_binqueue_TEST ..................... Passed 47.59 sec
Start 11: ring_permute2_TEST
9/19 Test #9: ring_spike_buffer_TEST ................. Passed 27.45 sec
Start 12: ring_gap_TEST
10/19 Test #10: ring_permute1_TEST ..................... Passed 27.27 sec
Start 13: ring_gap_binqueue_TEST
11/19 Test #8: ring_multisend_TEST .................... Passed 28.30 sec
Start 14: ring_gap_multisend_TEST
12/19 Test #11: ring_permute2_TEST ..................... Passed 34.03 sec
Start 15: ring_gap_permute1_TEST
13/19 Test #12: ring_gap_TEST .......................... Passed 65.84 sec
Start 16: ring_gap_permute2_TEST
14/19 Test #14: ring_gap_multisend_TEST ................ Passed 246.57 sec
Start 17: ring_permute2_cudaInterface_TEST
15/19 Test #13: ring_gap_binqueue_TEST ................. Passed 247.33 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
16/19 Test #15: ring_gap_permute1_TEST ................. Passed 233.57 sec
17/19 Test #16: ring_gap_permute2_TEST ................. Passed 183.34 sec
18/19 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 32.29 sec
19/19 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 40.60 sec
100% tests passed, 0 tests failed out of 19
Total Test time (real) = 361.12 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646826473:step_script section_start:1646826473:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=198180 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179974 responseStatus=201 Created token=CrQx55C-
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=198212 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179974 responseStatus=201 Created token=CrQx55C-
section_end:1646826474:upload_artifacts_on_success section_start:1646826474:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826475:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826073:resolve_secrets Resolving secrets
section_end:1646826073:resolve_secrets section_start:1646826073:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor771979576, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179973
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179973_PROD_P112_CP7_C7
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319563
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J179973_PROD_P112_CP7_C7 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=8 --jobid=319563 --cpus-per-task=1 --mem=30750M
section_end:1646826083:prepare_executor section_start:1646826083:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646826086:prepare_script section_start:1646826086:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826088:get_sources section_start:1646826088:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:mod2c:nvhpc:acc (179962)...
Runtime platform  arch=amd64 os=linux pid=183730 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179962 responseStatus=200 OK token=BnVZjzKN
section_end:1646826089:download_artifacts section_start:1646826089:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n17
Build name: Linux-nvc++
Create new tag: 20220309-1142 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179962/spack-build/spack-stage-coreneuron-develop-qvmfnnxhw57tyce665xfpgrivex6jdyr/spack-build-qvmfnnx
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 19: reporting_1
1/19 Test #3: alignment_test ......................... Passed 5.39 sec
2/19 Test #4: queuing_test ........................... Passed 5.58 sec
Start 7: ring_binqueue_TEST
3/19 Test #2: interleave_info_constructor_test ....... Passed 5.81 sec
4/19 Test #1: cmd_interface_test ..................... Passed 5.90 sec
Start 8: ring_multisend_TEST
5/19 Test #5: lfp_test ............................... Passed 6.13 sec
6/19 Test #19: reporting_1 ............................ Passed 41.63 sec
Start 9: ring_spike_buffer_TEST
7/19 Test #6: ring_TEST .............................. Passed 41.86 sec
Start 10: ring_permute1_TEST
8/19 Test #8: ring_multisend_TEST .................... Passed 36.16 sec
Start 11: ring_permute2_TEST
9/19 Test #7: ring_binqueue_TEST ..................... Passed 36.99 sec
Start 12: ring_gap_TEST
10/19 Test #9: ring_spike_buffer_TEST ................. Passed 33.94 sec
Start 13: ring_gap_binqueue_TEST
11/19 Test #10: ring_permute1_TEST ..................... Passed 33.73 sec
Start 14: ring_gap_multisend_TEST
12/19 Test #11: ring_permute2_TEST ..................... Passed 33.78 sec
Start 15: ring_gap_permute1_TEST
13/19 Test #12: ring_gap_TEST .......................... Passed 33.43 sec
Start 16: ring_gap_permute2_TEST
14/19 Test #16: ring_gap_permute2_TEST ................. Passed 37.30 sec
Start 17: ring_permute2_cudaInterface_TEST
15/19 Test #13: ring_gap_binqueue_TEST ................. Passed 37.79 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
16/19 Test #15: ring_gap_permute1_TEST ................. Passed 37.87 sec
17/19 Test #14: ring_gap_multisend_TEST ................ Passed 38.14 sec
18/19 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 4.19 sec
19/19 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 4.47 sec
100% tests passed, 0 tests failed out of 19
Total Test time (real) = 117.93 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646826243:step_script section_start:1646826243:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=189522 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179973 responseStatus=201 Created token=pbYW6erT
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=189580 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179973 responseStatus=201 Created token=pbYW6erT
section_end:1646826245:upload_artifacts_on_success section_start:1646826245:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826246:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826193:resolve_secrets Resolving secrets
section_end:1646826193:resolve_secrets section_start:1646826193:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor001499948, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179978
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179978_PROD_P112_CP12_C21
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319593
job state: PD
job state: PD
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J179978_PROD_P112_CP12_C21 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=8 --jobid=319593 --cpus-per-task=1 --mem=30750M
section_end:1646826288:prepare_executor section_start:1646826288:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1646826291:prepare_script section_start:1646826291:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826292:get_sources section_start:1646826292:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:nmodl:intel (179967)...
Runtime platform  arch=amd64 os=linux pid=19860 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179967 responseStatus=200 OK token=2FX3PAsd
section_end:1646826293:download_artifacts section_start:1646826293:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n17
Build name: Linux-icpc
Create new tag: 20220309-1146 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179967/spack-build/spack-stage-coreneuron-develop-f2bfytl2xzstchvaem4gflxln4r6z4cz/spack-build-f2bfytl
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 17: reporting_1
1/17 Test #2: interleave_info_constructor_test ... Passed 4.13 sec
2/17 Test #4: queuing_test ....................... Passed 4.37 sec
Start 7: ring_binqueue_TEST
3/17 Test #6: ring_TEST .......................... Passed 4.61 sec
Start 8: ring_multisend_TEST
4/17 Test #1: cmd_interface_test ................. Passed 4.64 sec
5/17 Test #17: reporting_1 ........................ Passed 4.62 sec
Start 9: ring_spike_buffer_TEST
6/17 Test #3: alignment_test ..................... Passed 4.64 sec
7/17 Test #5: lfp_test ........................... Passed 4.79 sec
Start 10: ring_permute1_TEST
8/17 Test #7: ring_binqueue_TEST ................. Passed 2.32 sec
Start 11: ring_permute2_TEST
9/17 Test #8: ring_multisend_TEST ................ Passed 3.35 sec
Start 12: ring_gap_TEST
10/17 Test #10: ring_permute1_TEST ................. Passed 3.50 sec
Start 13: ring_gap_binqueue_TEST
11/17 Test #9: ring_spike_buffer_TEST ............. Passed 3.71 sec
Start 14: ring_gap_multisend_TEST
12/17 Test #11: ring_permute2_TEST ................. Passed 2.32 sec
Start 15: ring_gap_permute1_TEST
13/17 Test #12: ring_gap_TEST ...................... Passed 2.81 sec
Start 16: ring_gap_permute2_TEST
14/17 Test #13: ring_gap_binqueue_TEST ............. Passed 4.03 sec
15/17 Test #14: ring_gap_multisend_TEST ............ Passed 4.37 sec
16/17 Test #15: ring_gap_permute1_TEST ............. Passed 3.77 sec
17/17 Test #16: ring_gap_permute2_TEST ............. Passed 2.73 sec
100% tests passed, 0 tests failed out of 17
Total Test time (real) = 13.60 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646826375:step_script section_start:1646826375:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=23296 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179978 responseStatus=201 Created token=fxkXj4BU
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=23338 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179978 responseStatus=201 Created token=fxkXj4BU
section_end:1646826377:upload_artifacts_on_success section_start:1646826377:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826378:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826370:resolve_secrets Resolving secrets
section_end:1646826370:resolve_secrets section_start:1646826370:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor083145699, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179976
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179976_PROD_P112_CP10_C10
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319603
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J179976_PROD_P112_CP10_C10 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=8 --jobid=319603 --cpus-per-task=1 --mem=30750M
section_end:1646826401:prepare_executor section_start:1646826401:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646826405:prepare_script section_start:1646826405:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826406:get_sources section_start:1646826406:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:nmodl:nvhpc:acc (179965)...
Runtime platform  arch=amd64 os=linux pid=194784 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179965 responseStatus=200 OK token=atY9Zsk4
section_end:1646826408:download_artifacts section_start:1646826408:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n31
Build name: Linux-nvc++
Create new tag: 20220309-1147 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179965/spack-build/spack-stage-coreneuron-develop-clohwtjjwrfpo4z4oreptyb2jbe3wrcs/spack-build-clohwtj
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 19: reporting_1
1/19 Test #1: cmd_interface_test ..................... Passed 2.31 sec
2/19 Test #3: alignment_test ......................... Passed 5.76 sec
Start 7: ring_binqueue_TEST
3/19 Test #2: interleave_info_constructor_test ....... Passed 6.42 sec
4/19 Test #4: queuing_test ........................... Passed 6.79 sec
Start 8: ring_multisend_TEST
5/19 Test #5: lfp_test ............................... Passed 7.03 sec
6/19 Test #19: reporting_1 ............................ Passed 34.30 sec
Start 9: ring_spike_buffer_TEST
7/19 Test #6: ring_TEST .............................. Passed 34.91 sec
Start 10: ring_permute1_TEST
8/19 Test #7: ring_binqueue_TEST ..................... Passed 52.28 sec
Start 11: ring_permute2_TEST
9/19 Test #8: ring_multisend_TEST .................... Passed 53.94 sec
Start 12: ring_gap_TEST
10/19 Test #9: ring_spike_buffer_TEST ................. Passed 47.23 sec
Start 13: ring_gap_binqueue_TEST
11/19 Test #10: ring_permute1_TEST ..................... Passed 46.84 sec
Start 14: ring_gap_multisend_TEST
12/19 Test #11: ring_permute2_TEST ..................... Passed 30.31 sec
Start 15: ring_gap_permute1_TEST
13/19 Test #12: ring_gap_TEST .......................... Passed 36.97 sec
Start 16: ring_gap_permute2_TEST
14/19 Test #13: ring_gap_binqueue_TEST ................. Passed 38.56 sec
Start 17: ring_permute2_cudaInterface_TEST
15/19 Test #14: ring_gap_multisend_TEST ................ Passed 38.75 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
16/19 Test #15: ring_gap_permute1_TEST ................. Passed 39.59 sec
17/19 Test #16: ring_gap_permute2_TEST ................. Passed 30.45 sec
18/19 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 15.08 sec
19/19 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 16.77 sec
100% tests passed, 0 tests failed out of 19
Total Test time (real) = 137.30 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646826575:step_script section_start:1646826575:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=200003 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179976 responseStatus=201 Created token=ZP9w7Bt3
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=200037 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179976 responseStatus=201 Created token=ZP9w7Bt3
section_end:1646826577:upload_artifacts_on_success section_start:1646826577:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826578:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826376:resolve_secrets Resolving secrets
section_end:1646826376:resolve_secrets section_start:1646826376:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor355510673, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179975
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179975_PROD_P112_CP14_C12
Job parameters: memory=30750M, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=8 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319605
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=8 --cpus-per-task=1 --mem=30750M --job-name=GL_J179975_PROD_P112_CP14_C12 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=8 --jobid=319605 --cpus-per-task=1 --mem=30750M
section_end:1646826401:prepare_executor section_start:1646826401:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646826405:prepare_script section_start:1646826405:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646826406:get_sources section_start:1646826406:download_artifacts Downloading artifacts
Downloading artifacts for build:coreneuron:nmodl:nvhpc:omp (179964)...
Runtime platform  arch=amd64 os=linux pid=194726 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179964 responseStatus=200 OK token=PrgH_RpU
section_end:1646826407:download_artifacts section_start:1646826407:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n31
Build name: Linux-nvc++
Create new tag: 20220309-1147 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179964/spack-build/spack-stage-coreneuron-develop-jnp6ftwa2yzkkhnwk6ebarxcp5sqkwtt/spack-build-jnp6ftw
Start 1: cmd_interface_test
Start 2: interleave_info_constructor_test
Start 3: alignment_test
Start 4: queuing_test
Start 5: lfp_test
Start 6: ring_TEST
Start 19: reporting_1
1/19 Test #1: cmd_interface_test ..................... Passed 3.32 sec
2/19 Test #2: interleave_info_constructor_test ....... Passed 6.02 sec
Start 7: ring_binqueue_TEST
3/19 Test #4: queuing_test ........................... Passed 6.17 sec
4/19 Test #3: alignment_test ......................... Passed 6.61 sec
Start 8: ring_multisend_TEST
5/19 Test #5: lfp_test ............................... Passed 7.21 sec
6/19 Test #19: reporting_1 ............................ Passed 34.62 sec
Start 9: ring_spike_buffer_TEST
7/19 Test #6: ring_TEST .............................. Passed 37.24 sec
Start 10: ring_permute1_TEST
8/19 Test #7: ring_binqueue_TEST ..................... Passed 84.91 sec
Start 11: ring_permute2_TEST
9/19 Test #8: ring_multisend_TEST .................... Passed 88.09 sec
Start 12: ring_gap_TEST
10/19 Test #9: ring_spike_buffer_TEST ................. Passed 62.08 sec
Start 13: ring_gap_binqueue_TEST
11/19 Test #10: ring_permute1_TEST ..................... Passed 59.64 sec
Start 14: ring_gap_multisend_TEST
12/19 Test #11: ring_permute2_TEST ..................... Passed 15.20 sec
Start 15: ring_gap_permute1_TEST
13/19 Test #12: ring_gap_TEST .......................... Passed 144.51 sec
Start 16: ring_gap_permute2_TEST
14/19 Test #14: ring_gap_multisend_TEST ................ Passed 154.08 sec
Start 17: ring_permute2_cudaInterface_TEST
15/19 Test #13: ring_gap_binqueue_TEST ................. Passed 166.21 sec
Start 18: ring_gap_permute2_cudaInterface_TEST
16/19 Test #17: ring_permute2_cudaInterface_TEST ....... Passed 15.36 sec
17/19 Test #15: ring_gap_permute1_TEST ................. Passed 160.28 sec
18/19 Test #16: ring_gap_permute2_TEST ................. Passed 27.29 sec
19/19 Test #18: ring_gap_permute2_cudaInterface_TEST ... Passed 5.32 sec
100% tests passed, 0 tests failed out of 19
Total Test time (real) = 268.26 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646826706:step_script section_start:1646826706:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=200965 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179975 responseStatus=201 Created token=u6oKM2Lz
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=200999 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179975 responseStatus=201 Created token=u6oKM2Lz
section_end:1646826708:upload_artifacts_on_success section_start:1646826708:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646826708:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646826816:resolve_secrets Resolving secrets
section_end:1646826816:resolve_secrets section_start:1646826816:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor402836746, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179982
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179982_PROD_P112_CP1_C1
Job parameters: memory=76G, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319692
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=76G --job-name=GL_J179982_PROD_P112_CP1_C1 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=16 --jobid=319692 --cpus-per-task=1 --mem=76G
section_end:1646827057:prepare_executor section_start:1646827057:prepare_script Preparing environment
Running on r1i4n10 via bbpv1.epfl.ch...
section_end:1646827060:prepare_script section_start:1646827060:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646827061:get_sources section_start:1646827061:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:mod2c:intel (179971)...
Runtime platform  arch=amd64 os=linux pid=281222 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179971 responseStatus=200 OK token=LD3u8sHm
section_end:1646827063:download_artifacts section_start:1646827063:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n17
Build name: Linux-icpc
Create new tag: 20220309-1158 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179971/spack-build/spack-stage-neuron-develop-47kwkdqbfahzhd6mgo3d7lvidjenlcwo/spack-build-47kwkdq
Start 43: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 50: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 62: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 67: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 73: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
Start 79: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
Start 85: testcorenrn_watch::coreneuron_cpu_offline::preparation
1/115 Test #50: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.98 sec
Start 91: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/115 Test #56: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 3.14 sec
Start 97: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/115 Test #62: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 3.47 sec
Start 38: external_ringtest::neuron
Start 46: testcorenrn_bbcore::neuron
4/115 Test #73: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 4.76 sec
Start 39: external_ringtest::neuron_mpi
5/115 Test #67: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 4.92 sec
Start 40: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
6/115 Test #85: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 5.33 sec
Start 41: external_ringtest::coreneuron_cpu_mpi
7/115 Test #46: testcorenrn_bbcore::neuron ......................................... Passed 2.19 sec
Start 47: testcorenrn_bbcore::coreneuron_cpu_online
8/115 Test #91: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 2.70 sec
Start 48: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
9/115 Test #97: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 2.71 sec
Start 49: testcorenrn_bbcore::coreneuron_cpu_offline
10/115 Test #38: external_ringtest::neuron .......................................... Passed 2.69 sec
Start 52: testcorenrn_deriv::neuron
11/115 Test #43: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 6.36 sec
Start 42: external_ringtest::coreneuron_cpu_mpi_offline
12/115 Test #52: testcorenrn_deriv::neuron .......................................... Passed 2.59 sec
Start 53: testcorenrn_deriv::coreneuron_cpu_online
13/115 Test #49: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 3.09 sec
Start 54: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
14/115 Test #47: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 4.54 sec
Start 55: testcorenrn_deriv::coreneuron_cpu_offline
15/115 Test #55: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 1.72 sec
Start 87: testcorenrn_conc::neuron
16/115 Test #53: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 3.44 sec
Start 88: testcorenrn_conc::coreneuron_cpu_online
17/115 Test #54: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 3.96 sec
Start 89: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
18/115 Test #42: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 7.23 sec
Start 58: testcorenrn_gf::neuron
19/115 Test #39: external_ringtest::neuron_mpi ...................................... Passed 8.98 sec
Start 59: testcorenrn_gf::coreneuron_cpu_online
20/115 Test #41: external_ringtest::coreneuron_cpu_mpi .............................. Passed 8.49 sec
Start 60: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
21/115 Test #88: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 1.95 sec
Start 90: testcorenrn_conc::coreneuron_cpu_offline
22/115 Test #79: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 14.47 sec
Start 112: olfactory-bulb-3d::neuron::preparation
23/115 Test #112: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.04 sec
Start 114: olfactory-bulb-3d::coreneuron_cpu_online::preparation
24/115 Test #114: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.03 sec
Start 35: reduced_dentate::neuron
25/115 Test #48: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 9.20 sec
Start 93: testcorenrn_kin::neuron
26/115 Test #89: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 2.53 sec
Start 94: testcorenrn_kin::coreneuron_cpu_online
27/115 Test #90: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 1.88 sec
Start 95: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
28/115 Test #59: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 3.45 sec
Start 61: testcorenrn_gf::coreneuron_cpu_offline
29/115 Test #93: testcorenrn_kin::neuron ............................................ Passed 3.49 sec
Start 96: testcorenrn_kin::coreneuron_cpu_offline
30/115 Test #94: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 4.59 sec
Start 103: channel_benchmark_hippo::neuron
31/115 Test #95: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 4.90 sec
Start 104: channel_benchmark_hippo::coreneuron_cpu_online
32/115 Test #40: external_ringtest::coreneuron_cpu_mpi_offline_saverestore .......... Passed 17.27 sec
Start 64: testcorenrn_patstim::neuron
33/115 Test #61: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 5.18 sec
Start 65: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
34/115 Test #60: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 10.46 sec
Start 66: testcorenrn_patstim::coreneuron_cpu_offline
35/115 Test #65: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............ Passed 7.85 sec
Start 69: testcorenrn_vecplay::neuron
36/115 Test #96: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 17.44 sec
Start 105: channel_benchmark_hippo::coreneuron_cpu_filemode
37/115 Test #64: testcorenrn_patstim::neuron ........................................ Passed 32.92 sec
Start 70: testcorenrn_vecplay::coreneuron_cpu_online
38/115 Test #70: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 6.82 sec
Start 71: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
39/115 Test #58: testcorenrn_gf::neuron ............................................. Passed 51.46 sec
Start 72: testcorenrn_vecplay::coreneuron_cpu_offline
40/115 Test #72: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 3.24 sec
Start 81: testcorenrn_watch::neuron
41/115 Test #71: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 8.75 sec
Start 82: testcorenrn_watch::coreneuron_cpu_online
42/115 Test #81: testcorenrn_watch::neuron .......................................... Passed 3.66 sec
Start 83: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
43/115 Test #82: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 5.89 sec
Start 84: testcorenrn_watch::coreneuron_cpu_offline
44/115 Test #84: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 3.07 sec
Start 99: testcorenrn_netstimdirect::direct_netstimdirect
45/115 Test #83: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 8.07 sec
Start 100: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
46/115 Test #66: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 61.99 sec
Start 107: channel_benchmark_sscx::neuron
Start 108: channel_benchmark_sscx::coreneuron_cpu_online
47/115 Test #99: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 6.89 sec
Start 109: channel_benchmark_sscx::coreneuron_cpu_filemode
Start 1: testneuron
48/115 Test #1: testneuron ......................................................... Passed 0.08 sec
Start 2: ringtest
49/115 Test #2: ringtest ........................................................... Passed 0.54 sec
Start 3: connect_dend
50/115 Test #3: connect_dend ....................................................... Passed 1.11 sec
Start 4: mpi_init::nrniv_mpiopt
51/115 Test #4: mpi_init::nrniv_mpiopt ............................................. Passed 0.66 sec
Start 5: mpi_init::nrniv_nrnmpi_init
52/115 Test #100: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 8.96 sec
Start 6: mpi_init::python_nrnmpi_init
Start 7: mpi_init::python_mpienv
53/115 Test #5: mpi_init::nrniv_nrnmpi_init ........................................ Passed 0.55 sec
Start 8: mpi_init::nrniv_mpiexec_mpiopt
54/115 Test #6: mpi_init::python_nrnmpi_init ....................................... Passed 1.46 sec
Start 9: mpi_init::nrniv_mpiexec_nrnmpi_init
55/115 Test #7: mpi_init::python_mpienv ............................................ Passed 3.32 sec
Start 10: mpi_init::python_mpiexec_nrnmpi_init
56/115 Test #9: mpi_init::nrniv_mpiexec_nrnmpi_init ................................ Passed 1.93 sec
Start 11: mpi_init::python_mpiexec_mpienv
57/115 Test #8: mpi_init::nrniv_mpiexec_mpiopt ..................................... Passed 3.78 sec
Start 12: pynrn_tests::basic_tests
58/115 Test #10: mpi_init::python_mpiexec_nrnmpi_init ............................... Passed 2.15 sec
Start 13: parallel_tests
59/115 Test #11: mpi_init::python_mpiexec_mpienv .................................... Passed 5.47 sec
Start 14: parallel_partrans
60/115 Test #69: testcorenrn_vecplay::neuron ........................................ Passed 69.19 sec
Start 15: parallel_netpar
Start 16: parallel_bas
61/115 Test #87: testcorenrn_conc::neuron ........................................... Passed 88.59 sec
Start 17: coreneuron_modtests::fornetcon_py_cpu
62/115 Test #12: pynrn_tests::basic_tests ........................................... Passed 12.70 sec
Start 18: coreneuron_modtests::direct_py_cpu
63/115 Test #14: parallel_partrans .................................................. Passed 11.68 sec
Start 19: coreneuron_modtests::direct_hoc_cpu
64/115 Test #15: parallel_netpar .................................................... Passed 11.91 sec
Start 20: coreneuron_modtests::spikes_py_cpu
65/115 Test #13: parallel_tests ..................................................... Passed 20.57 sec
Start 21: coreneuron_modtests::spikes_file_mode_py_cpu
66/115 Test #35: reduced_dentate::neuron ............................................ Passed 101.35 sec
Start 36: reduced_dentate::coreneuron_cpu
67/115 Test #19: coreneuron_modtests::direct_hoc_cpu ................................ Passed 15.07 sec
Start 22: coreneuron_modtests::fast_imem_py_cpu
68/115 Test #103: channel_benchmark_hippo::neuron .................................... Passed 112.23 sec
Start 23: coreneuron_modtests::datareturn_py_cpu
69/115 Test #104: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 112.98 sec
Start 24: coreneuron_modtests::test_units_py_cpu
70/115 Test #16: parallel_bas ....................................................... Passed 37.61 sec
Start 25: coreneuron_modtests::test_netmove_py_cpu
71/115 Test #17: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 69.60 sec
Start 26: coreneuron_modtests::test_pointer_py_cpu
72/115 Test #18: coreneuron_modtests::direct_py_cpu ................................. Passed 72.13 sec
Start 27: coreneuron_modtests::test_watchrange_py_cpu
73/115 Test #20: coreneuron_modtests::spikes_py_cpu ................................. Passed 75.84 sec
Start 28: coreneuron_modtests::test_psolve_py_cpu
74/115 Test #21: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 74.74 sec
Start 29: coreneuron_modtests::test_ba_py_cpu
75/115 Test #105: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 154.61 sec
Start 30: coreneuron_modtests::test_natrans_py_cpu
76/115 Test #22: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 76.17 sec
Start 34: external_nrntest
77/115 Test #24: coreneuron_modtests::test_units_py_cpu ............................. Passed 73.59 sec
Start 51: testcorenrn_bbcore::compare_results
78/115 Test #51: testcorenrn_bbcore::compare_results ................................ Passed 0.38 sec
Start 57: testcorenrn_deriv::compare_results
79/115 Test #57: testcorenrn_deriv::compare_results ................................. Passed 0.63 sec
Start 63: testcorenrn_gf::compare_results
80/115 Test #63: testcorenrn_gf::compare_results .................................... Passed 0.30 sec
Start 68: testcorenrn_patstim::compare_results
81/115 Test #68: testcorenrn_patstim::compare_results ............................... Passed 0.19 sec
Start 74: testcorenrn_vecplay::compare_results
82/115 Test #74: testcorenrn_vecplay::compare_results ............................... Passed 0.08 sec
Start 86: testcorenrn_watch::compare_results
83/115 Test #86: testcorenrn_watch::compare_results ................................. Passed 0.12 sec
Start 92: testcorenrn_conc::compare_results
84/115 Test #92: testcorenrn_conc::compare_results .................................. Passed 0.07 sec
Start 98: testcorenrn_kin::compare_results
85/115 Test #98: testcorenrn_kin::compare_results ................................... Passed 0.07 sec
Start 101: testcorenrn_netstimdirect::compare_results
86/115 Test #101: testcorenrn_netstimdirect::compare_results ......................... Passed 0.07 sec
Start 106: channel_benchmark_hippo::compare_results
87/115 Test #106: channel_benchmark_hippo::compare_results ........................... Passed 0.07 sec
88/115 Test #108: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 132.53 sec
Start 31: coreneuron_modtests::spikes_mpi_py_cpu
89/115 Test #25: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 81.85 sec
90/115 Test #23: coreneuron_modtests::datareturn_py_cpu ............................. Passed 86.88 sec
Start 32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
91/115 Test #107: channel_benchmark_sscx::neuron ..................................... Passed 133.76 sec
92/115 Test #32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 3.01 sec
Start 33: coreneuron_modtests::inputpresyn_py_cpu
93/115 Test #109: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 135.87 sec
Start 110: channel_benchmark_sscx::compare_results
94/115 Test #110: channel_benchmark_sscx::compare_results ............................ Passed 0.07 sec
95/115 Test #27: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 45.72 sec
96/115 Test #28: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 37.57 sec
Start 75: testcorenrn_vecevent::neuron
97/115 Test #29: coreneuron_modtests::test_ba_py_cpu ................................ Passed 35.03 sec
98/115 Test #26: coreneuron_modtests::test_pointer_py_cpu ........................... Passed 55.19 sec
99/115 Test #33: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 5.12 sec
Start 76: testcorenrn_vecevent::coreneuron_cpu_online
100/115 Test #30: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 37.26 sec
101/115 Test #31: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 12.10 sec
102/115 Test #75: testcorenrn_vecevent::neuron ....................................... Passed 6.66 sec
Start 44: external_ringtest::coreneuron_cpu_mpi_threads
103/115 Test #44: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 7.18 sec
Start 77: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
Start 45: external_ringtest::compare_results
104/115 Test #45: external_ringtest::compare_results ................................. Passed 0.09 sec
105/115 Test #77: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 13.11 sec
Start 78: testcorenrn_vecevent::coreneuron_cpu_offline
106/115 Test #36: reduced_dentate::coreneuron_cpu .................................... Passed 136.83 sec
Start 111: olfactory-bulb-3d::neuron
Start 37: reduced_dentate::compare_results
107/115 Test #37: reduced_dentate::compare_results ................................... Passed 0.08 sec
108/115 Test #78: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 3.67 sec
Start 113: olfactory-bulb-3d::coreneuron_cpu_online
109/115 Test #76: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 78.12 sec
Start 80: testcorenrn_vecevent::compare_results
110/115 Test #80: testcorenrn_vecevent::compare_results .............................. Passed 0.09 sec
111/115 Test #111: olfactory-bulb-3d::neuron .......................................... Passed 161.58 sec
112/115 Test #113: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 223.53 sec
Start 115: olfactory-bulb-3d::compare_results
113/115 Test #115: olfactory-bulb-3d::compare_results ................................. Passed 0.19 sec
114/115 Test #34: external_nrntest ................................................... Passed 584.20 sec
Start 102: tqperf::coreneuron
115/115 Test #102: tqperf::coreneuron ................................................. Passed 11.49 sec
100% tests passed, 0 tests failed out of 115
Total Test time (real) = 796.57 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646827888:step_script section_start:1646827888:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=290759 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179982 responseStatus=201 Created token=cxotevdE
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=290817 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179982 responseStatus=201 Created token=cxotevdE
section_end:1646827890:upload_artifacts_on_success section_start:1646827890:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646827892:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646827341:resolve_secrets Resolving secrets
section_end:1646827341:resolve_secrets section_start:1646827341:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor815512809, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179979
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179979_PROD_P112_CP4_C2
Job parameters: memory=76G, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319699
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=76G --job-name=GL_J179979_PROD_P112_CP4_C2 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=16 --jobid=319699 --cpus-per-task=1 --mem=76G
section_end:1646827390:prepare_executor section_start:1646827390:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646827394:prepare_script section_start:1646827394:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646827395:get_sources section_start:1646827395:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:mod2c:nvhpc:acc (179968)...
Runtime platform  arch=amd64 os=linux pid=205826 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179968 responseStatus=200 OK token=mYR7bDZN
section_end:1646827396:download_artifacts section_start:1646827396:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n17
Build name: Linux-nvc++
Create new tag: 20220309-1203 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179968/spack-build/spack-stage-neuron-develop-b3uxm6bweygovmzordzjkevzwfwfbb7k/spack-build-b3uxm6b
Start 61: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 66: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 73: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 77: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 83: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 87: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 93: testcorenrn_gf::coreneuron_gpu_offline::preparation
Start 97: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 102: testcorenrn_patstim::coreneuron_gpu_offline::preparation
Start 105: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 141: testcorenrn_conc::coreneuron_gpu_offline::preparation
1/179 Test #73: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 7.97 sec
Start 145: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/179 Test #83: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 9.12 sec
Start 151: testcorenrn_kin::coreneuron_gpu_offline::preparation
3/179 Test #93: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 9.35 sec
Start 111: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
4/179 Test #102: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 9.50 sec
Start 155: testcorenrn_kin::coreneuron_cpu_offline::preparation
5/179 Test #77: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 9.66 sec
Start 56: external_ringtest::neuron
6/179 Test #141: testcorenrn_conc::coreneuron_gpu_offline::preparation .............. Passed 10.36 sec
Start 69: testcorenrn_bbcore::neuron
7/179 Test #87: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 10.73 sec
Start 70: testcorenrn_bbcore::coreneuron_gpu_online
8/179 Test #97: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 11.07 sec
Start 115: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
9/179 Test #105: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 11.35 sec
Start 131: testcorenrn_watch::coreneuron_gpu_offline::preparation
10/179 Test #56: external_ringtest::neuron .......................................... Passed 10.65 sec
Start 71: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
11/179 Test #69: testcorenrn_bbcore::neuron ......................................... Passed 9.65 sec
Start 72: testcorenrn_bbcore::coreneuron_gpu_offline
12/179 Test #155: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 11.12 sec
Start 74: testcorenrn_bbcore::coreneuron_cpu_online
13/179 Test #145: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 12.63 sec
Start 75: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
14/179 Test #151: testcorenrn_kin::coreneuron_gpu_offline::preparation ............... Passed 11.74 sec
Start 76: testcorenrn_bbcore::coreneuron_cpu_offline
15/179 Test #111: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 11.69 sec
Start 135: testcorenrn_watch::coreneuron_cpu_offline::preparation
16/179 Test #115: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 9.96 sec
Start 57: external_ringtest::neuron_mpi
17/179 Test #131: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 9.80 sec
Start 58: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
18/179 Test #135: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 2.33 sec
Start 59: external_ringtest::coreneuron_cpu_mpi
19/179 Test #57: external_ringtest::neuron_mpi ...................................... Passed 3.43 sec
Start 63: external_ringtest::coreneuron_gpu_mpi_offline_saverestore
20/179 Test #61: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 51.39 sec
Start 60: external_ringtest::coreneuron_cpu_mpi_offline
21/179 Test #66: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 51.64 sec
Start 64: external_ringtest::coreneuron_gpu_mpi
22/179 Test #70: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 41.39 sec
Start 79: testcorenrn_deriv::neuron
23/179 Test #79: testcorenrn_deriv::neuron .......................................... Passed 1.91 sec
Start 80: testcorenrn_deriv::coreneuron_gpu_online
24/179 Test #72: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 35.71 sec
Start 81: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
25/179 Test #75: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 37.66 sec
Start 82: testcorenrn_deriv::coreneuron_gpu_offline
26/179 Test #76: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 37.68 sec
Start 84: testcorenrn_deriv::coreneuron_cpu_online
27/179 Test #74: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 37.94 sec
Start 85: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
28/179 Test #59: external_ringtest::coreneuron_cpu_mpi .............................. Passed 35.45 sec
Start 65: external_ringtest::coreneuron_gpu_mpi_offline
29/179 Test #71: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 51.91 sec
Start 86: testcorenrn_deriv::coreneuron_cpu_offline
30/179 Test #60: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 44.07 sec
Start 89: testcorenrn_gf::neuron
31/179 Test #85: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 36.93 sec
Start 100: testcorenrn_patstim::coreneuron_gpu_offline_saverestore
32/179 Test #64: external_ringtest::coreneuron_gpu_mpi .............................. Passed 44.43 sec
Start 90: testcorenrn_gf::coreneuron_gpu_online
33/179 Test #80: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 41.95 sec
Start 101: testcorenrn_patstim::coreneuron_gpu_offline
34/179 Test #65: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 37.25 sec
Start 91: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
35/179 Test #84: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 37.60 sec
Start 137: testcorenrn_conc::neuron
36/179 Test #82: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 37.76 sec
Start 138: testcorenrn_conc::coreneuron_gpu_online
37/179 Test #89: testcorenrn_gf::neuron ............................................. Passed 3.05 sec
Start 92: testcorenrn_gf::coreneuron_gpu_offline
38/179 Test #137: testcorenrn_conc::neuron ........................................... Passed 3.59 sec
Start 139: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate
39/179 Test #81: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 49.11 sec
Start 140: testcorenrn_conc::coreneuron_gpu_offline
40/179 Test #86: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 44.07 sec
Start 142: testcorenrn_conc::coreneuron_cpu_online
41/179 Test #101: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 42.24 sec
Start 143: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
42/179 Test #140: testcorenrn_conc::coreneuron_gpu_offline ........................... Passed 33.68 sec
Start 144: testcorenrn_conc::coreneuron_cpu_offline
43/179 Test #138: testcorenrn_conc::coreneuron_gpu_online ............................ Passed 43.50 sec
Start 147: testcorenrn_kin::neuron
44/179 Test #147: testcorenrn_kin::neuron ............................................ Passed 1.61 sec
Start 148: testcorenrn_kin::coreneuron_gpu_online
45/179 Test #92: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 42.93 sec
Start 94: testcorenrn_gf::coreneuron_cpu_online
46/179 Test #90: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 45.91 sec
Start 95: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
47/179 Test #139: testcorenrn_conc::coreneuron_gpu_online_psolve_alternate ........... Passed 61.60 sec
Start 149: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate
48/179 Test #91: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 65.41 sec
Start 96: testcorenrn_gf::coreneuron_cpu_offline
49/179 Test #142: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 51.13 sec
Start 150: testcorenrn_kin::coreneuron_gpu_offline
50/179 Test #63: external_ringtest::coreneuron_gpu_mpi_offline_saverestore .......... Passed 155.95 sec
Start 99: testcorenrn_patstim::neuron
51/179 Test #144: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 41.80 sec
Start 152: testcorenrn_kin::coreneuron_cpu_online
52/179 Test #143: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 42.33 sec
Start 153: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
53/179 Test #58: external_ringtest::coreneuron_cpu_mpi_offline_saverestore .......... Passed 159.17 sec
Start 103: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
54/179 Test #100: testcorenrn_patstim::coreneuron_gpu_offline_saverestore ............ Passed 85.10 sec
Start 154: testcorenrn_kin::coreneuron_cpu_offline
55/179 Test #148: testcorenrn_kin::coreneuron_gpu_online ............................. Passed 43.10 sec
Start 161: channel_benchmark_hippo::neuron
56/179 Test #99: testcorenrn_patstim::neuron ........................................ Passed 3.98 sec
Start 104: testcorenrn_patstim::coreneuron_cpu_offline
57/179 Test #94: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 43.18 sec
Start 107: testcorenrn_vecplay::neuron
58/179 Test #95: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 64.93 sec
Start 108: testcorenrn_vecplay::coreneuron_gpu_online
59/179 Test #161: channel_benchmark_hippo::neuron .................................... Passed 25.47 sec
Start 162: channel_benchmark_hippo::coreneuron_gpu_online
60/179 Test #96: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 52.81 sec
Start 109: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
61/179 Test #150: testcorenrn_kin::coreneuron_gpu_offline ............................ Passed 56.24 sec
Start 163: channel_benchmark_hippo::coreneuron_gpu_filemode
62/179 Test #154: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 49.26 sec
Start 164: channel_benchmark_hippo::coreneuron_cpu_online
63/179 Test #153: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 49.35 sec
Start 165: channel_benchmark_hippo::coreneuron_cpu_filemode
64/179 Test #152: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 49.52 sec
Start 167: channel_benchmark_sscx::neuron
65/179 Test #104: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 45.76 sec
Start 110: testcorenrn_vecplay::coreneuron_gpu_offline
66/179 Test #149: testcorenrn_kin::coreneuron_gpu_online_psolve_alternate ............ Passed 69.15 sec
Start 168: channel_benchmark_sscx::coreneuron_gpu_online
67/179 Test #108: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 59.03 sec
Start 112: testcorenrn_vecplay::coreneuron_cpu_online
68/179 Test #110: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 53.75 sec
Start 113: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
69/179 Test #107: testcorenrn_vecplay::neuron ........................................ Passed 101.22 sec
Start 114: testcorenrn_vecplay::coreneuron_cpu_offline
70/179 Test #162: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 82.18 sec
Start 169: channel_benchmark_sscx::coreneuron_gpu_filemode
71/179 Test #109: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 77.96 sec
Start 127: testcorenrn_watch::neuron
72/179 Test #127: testcorenrn_watch::neuron .......................................... Passed 7.86 sec
Start 128: testcorenrn_watch::coreneuron_gpu_online
73/179 Test #112: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 45.88 sec
Start 129: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
74/179 Test #114: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 58.70 sec
Start 130: testcorenrn_watch::coreneuron_gpu_offline
75/179 Test #167: channel_benchmark_sscx::neuron ..................................... Passed 122.45 sec
Start 170: channel_benchmark_sscx::coreneuron_cpu_online
76/179 Test #113: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 69.21 sec
Start 132: testcorenrn_watch::coreneuron_cpu_online
77/179 Test #128: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 59.00 sec
Start 133: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
78/179 Test #129: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 71.47 sec
Start 134: testcorenrn_watch::coreneuron_cpu_offline
79/179 Test #163: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 159.86 sec
Start 171: channel_benchmark_sscx::coreneuron_cpu_filemode
80/179 Test #168: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 153.12 sec
Start 1: testneuron
81/179 Test #1: testneuron ......................................................... Passed 0.06 sec
Start 2: ringtest
82/179 Test #2: ringtest ........................................................... Passed 0.28 sec
Start 3: connect_dend
83/179 Test #3: connect_dend ....................................................... Passed 0.18 sec
Start 4: mpi_init::nrniv_mpiopt
84/179 Test #4: mpi_init::nrniv_mpiopt ............................................. Passed 0.37 sec
Start 5: mpi_init::nrniv_nrnmpi_init
85/179 Test #5: mpi_init::nrniv_nrnmpi_init ........................................ Passed 0.23 sec
Start 6: mpi_init::python_nrnmpi_init
86/179 Test #6: mpi_init::python_nrnmpi_init ....................................... Passed 0.88 sec
Start 7: mpi_init::python_mpienv
87/179 Test #7: mpi_init::python_mpienv ............................................ Passed 2.21 sec
Start 8: mpi_init::nrniv_mpiexec_mpiopt
88/179 Test #8: mpi_init::nrniv_mpiexec_mpiopt ..................................... Passed 1.86 sec
Start 9: mpi_init::nrniv_mpiexec_nrnmpi_init
89/179 Test #9: mpi_init::nrniv_mpiexec_nrnmpi_init ................................ Passed 1.64 sec
Start 10: mpi_init::python_mpiexec_nrnmpi_init
90/179 Test #10: mpi_init::python_mpiexec_nrnmpi_init ............................... Passed 2.45 sec
Start 11: mpi_init::python_mpiexec_mpienv
91/179 Test #103: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............ Passed 213.95 sec
Start 157: testcorenrn_netstimdirect::direct_netstimdirect
92/179 Test #11: mpi_init::python_mpiexec_mpienv .................................... Passed 3.54 sec
Start 12: pynrn_tests::basic_tests
93/179 Test #164: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 168.74 sec
Start 13: parallel_tests
94/179 Test #165: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 168.76 sec
Start 14: parallel_partrans
95/179 Test #130: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 54.46 sec
Start 158: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
96/179 Test #14: parallel_partrans .................................................. Passed 8.27 sec
Start 15: parallel_netpar
97/179 Test #13: parallel_tests ..................................................... Passed 9.40 sec
Start 16: parallel_bas
98/179 Test #132: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 55.35 sec
Start 17: coreneuron_modtests::fornetcon_py_cpu
Start 18: coreneuron_modtests::direct_py_cpu
99/179 Test #169: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 116.84 sec
Start 19: coreneuron_modtests::direct_hoc_cpu
100/179 Test #133: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 50.24 sec
Start 20: coreneuron_modtests::spikes_py_cpu
Start 21: coreneuron_modtests::spikes_file_mode_py_cpu
101/179 Test #12: pynrn_tests::basic_tests ........................................... Passed 15.41 sec
Start 22: coreneuron_modtests::fast_imem_py_cpu
102/179 Test #15: parallel_netpar .................................................... Passed 5.91 sec
Start 23: coreneuron_modtests::datareturn_py_cpu
103/179 Test #22: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 5.43 sec
Start 24: coreneuron_modtests::test_units_py_cpu
104/179 Test #16: parallel_bas ....................................................... Passed 13.38 sec
Start 25: coreneuron_modtests::test_netmove_py_cpu
105/179 Test #134: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 38.29 sec
Start 26: coreneuron_modtests::test_pointer_py_cpu
Start 27: coreneuron_modtests::test_watchrange_py_cpu
106/179 Test #170: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 73.01 sec
Start 28: coreneuron_modtests::test_psolve_py_cpu
107/179 Test #157: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 34.56 sec
Start 29: coreneuron_modtests::test_ba_py_cpu
Start 30: coreneuron_modtests::test_natrans_py_cpu
108/179 Test #158: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 31.44 sec
Start 31: coreneuron_modtests::spikes_mpi_py_cpu
109/179 Test #19: coreneuron_modtests::direct_hoc_cpu ................................ Passed 22.76 sec
Start 34: coreneuron_modtests::fornetcon_py_gpu
110/179 Test #18: coreneuron_modtests::direct_py_cpu ................................. Passed 23.36 sec
Start 35: coreneuron_modtests::direct_py_gpu
111/179 Test #17: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 23.69 sec
Start 36: coreneuron_modtests::direct_hoc_gpu
112/179 Test #20: coreneuron_modtests::spikes_py_cpu ................................. Passed 22.94 sec
Start 37: coreneuron_modtests::spikes_py_gpu
113/179 Test #21: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 23.18 sec
Start 38: coreneuron_modtests::spikes_file_mode_py_gpu
114/179 Test #24: coreneuron_modtests::test_units_py_cpu ............................. Passed 17.94 sec
Start 39: coreneuron_modtests::fast_imem_py_gpu
115/179 Test #27: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 14.64 sec
Start 40: coreneuron_modtests::datareturn_py_gpu
116/179 Test #23: coreneuron_modtests::datareturn_py_cpu ............................. Passed 23.37 sec
Start 41: coreneuron_modtests::test_units_py_gpu
117/179 Test #25: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 14.86 sec
Start 42: coreneuron_modtests::test_netmove_py_gpu
118/179 Test #171: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 54.61 sec
Start 43: coreneuron_modtests::test_pointer_py_gpu
119/179 Test #28: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 13.47 sec
Start 44: coreneuron_modtests::test_watchrange_py_gpu
120/179 Test #30: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 11.03 sec
Start 45: coreneuron_modtests::test_psolve_py_gpu
121/179 Test #29: coreneuron_modtests::test_ba_py_cpu ................................ Passed 11.65 sec
Start 46: coreneuron_modtests::test_ba_py_gpu
122/179 Test #34: coreneuron_modtests::fornetcon_py_gpu .............................. Passed 9.83 sec
Start 47: coreneuron_modtests::test_natrans_py_gpu
123/179 Test #31: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 11.23 sec
Start 32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
124/179 Test #35: coreneuron_modtests::direct_py_gpu ................................. Passed 11.08 sec
Start 51: external_nrntest
125/179 Test #37: coreneuron_modtests::spikes_py_gpu ................................. Passed 11.06 sec
Start 78: testcorenrn_bbcore::compare_results
126/179 Test #38: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 12.56 sec
Start 88: testcorenrn_deriv::compare_results
127/179 Test #36: coreneuron_modtests::direct_hoc_gpu ................................ Passed 15.02 sec
Start 98: testcorenrn_gf::compare_results
128/179 Test #78: testcorenrn_bbcore::compare_results ................................ Passed 5.69 sec
Start 106: testcorenrn_patstim::compare_results
129/179 Test #88: testcorenrn_deriv::compare_results ................................. Passed 4.84 sec
Start 116: testcorenrn_vecplay::compare_results
130/179 Test #98: testcorenrn_gf::compare_results .................................... Passed 4.12 sec
Start 136: testcorenrn_watch::compare_results
131/179 Test #41: coreneuron_modtests::test_units_py_gpu ............................. Passed 16.47 sec
Start 146: testcorenrn_conc::compare_results
132/179 Test #106: testcorenrn_patstim::compare_results ............................... Passed 4.67 sec
Start 156: testcorenrn_kin::compare_results
133/179 Test #42: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 17.65 sec
Start 159: testcorenrn_netstimdirect::compare_results
134/179 Test #116: testcorenrn_vecplay::compare_results ............................... Passed 4.90 sec
Start 166: channel_benchmark_hippo::compare_results
135/179 Test #156: testcorenrn_kin::compare_results ................................... Passed 2.18 sec
Start 172: channel_benchmark_sscx::compare_results
136/179 Test #47: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 14.58 sec
137/179 Test #136: testcorenrn_watch::compare_results ................................. Passed 4.87 sec
Start 33: coreneuron_modtests::inputpresyn_py_cpu
138/179 Test #39: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 20.37 sec
139/179 Test #159: testcorenrn_netstimdirect::compare_results ......................... Passed 2.60 sec
Start 48: coreneuron_modtests::spikes_mpi_py_gpu
140/179 Test #166: channel_benchmark_hippo::compare_results ........................... Passed 2.89 sec
141/179 Test #146: testcorenrn_conc::compare_results .................................. Passed 5.73 sec
Start 49: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
142/179 Test #44: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 19.38 sec
143/179 Test #45: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 18.51 sec
Start 50: coreneuron_modtests::inputpresyn_py_gpu
144/179 Test #40: coreneuron_modtests::datareturn_py_gpu ............................. Passed 23.11 sec
145/179 Test #172: channel_benchmark_sscx::compare_results ............................ Passed 4.17 sec
146/179 Test #26: coreneuron_modtests::test_pointer_py_cpu ........................... Passed 38.90 sec
147/179 Test #46: coreneuron_modtests::test_ba_py_gpu ................................ Passed 22.53 sec
Start 121: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
148/179 Test #32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 36.87 sec
149/179 Test #121: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 28.43 sec
Start 125: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
150/179 Test #33: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 37.22 sec
Start 174: olfactory-bulb-3d::neuron::preparation
151/179 Test #174: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.34 sec
Start 176: olfactory-bulb-3d::coreneuron_gpu_online::preparation
152/179 Test #176: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.75 sec
Start 178: olfactory-bulb-3d::coreneuron_cpu_online::preparation
153/179 Test #50: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 36.25 sec
154/179 Test #178: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 1.13 sec
Start 52: reduced_dentate::neuron
155/179 Test #48: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 39.89 sec
Start 53: reduced_dentate::coreneuron_cpu
156/179 Test #49: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 38.05 sec
157/179 Test #43: coreneuron_modtests::test_pointer_py_gpu ........................... Passed 74.35 sec
158/179 Test #125: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 27.52 sec
Start 54: reduced_dentate::coreneuron_gpu
159/179 Test #52: reduced_dentate::neuron ............................................ Passed 41.03 sec
Start 62: external_ringtest::coreneuron_cpu_mpi_threads
160/179 Test #53: reduced_dentate::coreneuron_cpu .................................... Passed 66.65 sec
Start 117: testcorenrn_vecevent::neuron
161/179 Test #117: testcorenrn_vecevent::neuron ....................................... Passed 2.66 sec
Start 118: testcorenrn_vecevent::coreneuron_gpu_online
162/179 Test #62: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 69.88 sec
Start 67: external_ringtest::coreneuron_gpu_mpi_threads
163/179 Test #54: reduced_dentate::coreneuron_gpu .................................... Passed 89.21 sec
Start 119: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
Start 55: reduced_dentate::compare_results
164/179 Test #55: reduced_dentate::compare_results ................................... Passed 0.07 sec
165/179 Test #118: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 69.21 sec
Start 120: testcorenrn_vecevent::coreneuron_gpu_offline
166/179 Test #67: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 44.62 sec
Start 122: testcorenrn_vecevent::coreneuron_cpu_online
Start 68: external_ringtest::compare_results
167/179 Test #68: external_ringtest::compare_results ................................. Passed 0.62 sec
168/179 Test #51: external_nrntest ................................................... Passed 213.47 sec
Start 123: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
169/179 Test #119: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 72.03 sec
Start 124: testcorenrn_vecevent::coreneuron_cpu_offline
170/179 Test #120: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 46.95 sec
Start 173: olfactory-bulb-3d::neuron
171/179 Test #122: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 73.59 sec
Start 175: olfactory-bulb-3d::coreneuron_gpu_online
172/179 Test #123: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 77.38 sec
Start 177: olfactory-bulb-3d::coreneuron_cpu_online
173/179 Test #124: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 59.27 sec
Start 126: testcorenrn_vecevent::compare_results
174/179 Test #126: testcorenrn_vecevent::compare_results .............................. Passed 0.18 sec
175/179 Test #173: olfactory-bulb-3d::neuron .......................................... Passed 130.90 sec
176/179 Test #175: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 118.56 sec
177/179 Test #177: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 115.64 sec
Start 160: tqperf::coreneuron
178/179 Test #160: tqperf::coreneuron ................................................. Passed 29.40 sec
Start 179: olfactory-bulb-3d::compare_results
179/179 Test #179: olfactory-bulb-3d::compare_results ................................. Passed 0.41 sec
100% tests passed, 0 tests failed out of 179
Total Test time (real) = 879.96 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646828307:step_script section_start:1646828307:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=232372 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179979 responseStatus=201 Created token=nyd3NGv7
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=232435 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179979 responseStatus=201 Created token=nyd3NGv7
section_end:1646828309:upload_artifacts_on_success section_start:1646828309:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646828310:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646827215:resolve_secrets Resolving secrets
section_end:1646827215:resolve_secrets section_start:1646827215:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor044789100, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179983
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179983_PROD_P112_CP5_C8
Job parameters: memory=76G, cpus_per_task=1, duration=1:00:00, constraint=cpu ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 319695
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=76G --job-name=GL_J179983_PROD_P112_CP5_C8 -C cpu --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=16 --jobid=319695 --cpus-per-task=1 --mem=76G
section_end:1646827263:prepare_executor section_start:1646827263:prepare_script Preparing environment
Running on r1i7n21 via bbpv1.epfl.ch...
section_end:1646827266:prepare_script section_start:1646827266:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646827267:get_sources section_start:1646827267:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:nmodl:intel (179972)...
Runtime platform  arch=amd64 os=linux pid=198292 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179972 responseStatus=200 OK token=ZKSJTxkY
section_end:1646827268:download_artifacts section_start:1646827268:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i5n31
Build name: Linux-icpc
Create new tag: 20220309-1201 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179972/spack-build/spack-stage-neuron-develop-7vuuxvdwm3mams7szrb4snbsppttef4h/spack-build-7vuuxvd
Start 43: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 50: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 56: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 62: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 67: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 73: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
Start 79: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
Start 85: testcorenrn_watch::coreneuron_cpu_offline::preparation
1/114 Test #56: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 2.88 sec
Start 91: testcorenrn_conc::coreneuron_cpu_offline::preparation
2/114 Test #50: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 2.99 sec
Start 97: testcorenrn_kin::coreneuron_cpu_offline::preparation
3/114 Test #67: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 3.04 sec
Start 38: external_ringtest::neuron
Start 46: testcorenrn_bbcore::neuron
4/114 Test #85: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 4.81 sec
Start 39: external_ringtest::neuron_mpi
5/114 Test #62: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 5.28 sec
Start 40: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
6/114 Test #73: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 5.35 sec
Start 41: external_ringtest::coreneuron_cpu_mpi
7/114 Test #79: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 5.47 sec
Start 111: olfactory-bulb-3d::neuron::preparation
8/114 Test #111: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.02 sec
Start 113: olfactory-bulb-3d::coreneuron_cpu_online::preparation
9/114 Test #97: testcorenrn_kin::coreneuron_cpu_offline::preparation ............... Passed 2.55 sec
Start 47: testcorenrn_bbcore::coreneuron_cpu_online
10/114 Test #91: testcorenrn_conc::coreneuron_cpu_offline::preparation .............. Passed 2.69 sec
Start 48: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
11/114 Test #113: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.04 sec
Start 35: reduced_dentate::neuron
12/114 Test #43: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 5.66 sec
Start 42: external_ringtest::coreneuron_cpu_mpi_offline
13/114 Test #38: external_ringtest::neuron .......................................... Passed 3.29 sec
Start 49: testcorenrn_bbcore::coreneuron_cpu_offline
14/114 Test #39: external_ringtest::neuron_mpi ...................................... Passed 3.47 sec
Start 52: testcorenrn_deriv::neuron
Start 53: testcorenrn_deriv::coreneuron_cpu_online
15/114 Test #46: testcorenrn_bbcore::neuron ......................................... Passed 6.29 sec
Start 54: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
16/114 Test #42: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 4.01 sec
Start 55: testcorenrn_deriv::coreneuron_cpu_offline
Start 87: testcorenrn_conc::neuron
17/114 Test #47: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 5.11 sec
Start 88: testcorenrn_conc::coreneuron_cpu_online
18/114 Test #49: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 4.55 sec
Start 89: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate
19/114 Test #52: testcorenrn_deriv::neuron .......................................... Passed 2.87 sec
Start 90: testcorenrn_conc::coreneuron_cpu_offline
20/114 Test #55: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 1.91 sec
Start 93: testcorenrn_kin::neuron
21/114 Test #48: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 6.08 sec
Start 94: testcorenrn_kin::coreneuron_cpu_online
22/114 Test #87: testcorenrn_conc::neuron ........................................... Passed 2.32 sec
Start 95: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate
23/114 Test #53: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 4.08 sec
Start 96: testcorenrn_kin::coreneuron_cpu_offline
24/114 Test #90: testcorenrn_conc::coreneuron_cpu_offline ........................... Passed 1.85 sec
Start 102: channel_benchmark_hippo::neuron
25/114 Test #54: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 4.08 sec
Start 103: channel_benchmark_hippo::coreneuron_cpu_online
26/114 Test #93: testcorenrn_kin::neuron ............................................ Passed 2.34 sec
Start 104: channel_benchmark_hippo::coreneuron_cpu_filemode
27/114 Test #88: testcorenrn_conc::coreneuron_cpu_online ............................ Passed 3.94 sec
Start 106: channel_benchmark_sscx::neuron
28/114 Test #96: testcorenrn_kin::coreneuron_cpu_offline ............................ Passed 4.76 sec
Start 107: channel_benchmark_sscx::coreneuron_cpu_online
29/114 Test #94: testcorenrn_kin::coreneuron_cpu_online ............................. Passed 6.61 sec
Start 108: channel_benchmark_sscx::coreneuron_cpu_filemode
30/114 Test #41: external_ringtest::coreneuron_cpu_mpi .............................. Passed 14.73 sec
Start 58: testcorenrn_gf::neuron
31/114 Test #89: testcorenrn_conc::coreneuron_cpu_online_psolve_alternate ........... Passed 10.26 sec
Start 1: testneuron
32/114 Test #1: testneuron ......................................................... Passed 0.16 sec
Start 2: ringtest
33/114 Test #95: testcorenrn_kin::coreneuron_cpu_online_psolve_alternate ............ Passed 12.84 sec
Start 3: connect_dend
34/114 Test #2: ringtest ........................................................... Passed 4.25 sec
Start 4: mpi_init::nrniv_mpiopt
35/114 Test #3: connect_dend ....................................................... Passed 0.71 sec
Start 5: mpi_init::nrniv_nrnmpi_init
36/114 Test #4: mpi_init::nrniv_mpiopt ............................................. Passed 3.55 sec
Start 6: mpi_init::python_nrnmpi_init
37/114 Test #5: mpi_init::nrniv_nrnmpi_init ........................................ Passed 4.23 sec
Start 7: mpi_init::python_mpienv
38/114 Test #6: mpi_init::python_nrnmpi_init ....................................... Passed 3.76 sec
Start 8: mpi_init::nrniv_mpiexec_mpiopt
39/114 Test #8: mpi_init::nrniv_mpiexec_mpiopt ..................................... Passed 1.85 sec
Start 9: mpi_init::nrniv_mpiexec_nrnmpi_init
40/114 Test #7: mpi_init::python_mpienv ............................................ Passed 5.60 sec
Start 10: mpi_init::python_mpiexec_nrnmpi_init
41/114 Test #9: mpi_init::nrniv_mpiexec_nrnmpi_init ................................ Passed 4.21 sec
Start 11: mpi_init::python_mpiexec_mpienv
42/114 Test #10: mpi_init::python_mpiexec_nrnmpi_init ............................... Passed 4.52 sec
Start 12: pynrn_tests::basic_tests
43/114 Test #11: mpi_init::python_mpiexec_mpienv .................................... Passed 4.99 sec
Start 13: parallel_tests
44/114 Test #12: pynrn_tests::basic_tests ........................................... Passed 7.42 sec
Start 14: parallel_partrans
45/114 Test #58: testcorenrn_gf::neuron ............................................. Passed 45.53 sec
Start 59: testcorenrn_gf::coreneuron_cpu_online
46/114 Test #40: external_ringtest::coreneuron_cpu_mpi_offline_saverestore .......... Passed 61.63 sec
Start 60: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
47/114 Test #59: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 14.73 sec
Start 61: testcorenrn_gf::coreneuron_cpu_offline
48/114 Test #61: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 11.46 sec
Start 64: testcorenrn_patstim::neuron
49/114 Test #64: testcorenrn_patstim::neuron ........................................ Passed 4.37 sec
Start 65: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
50/114 Test #60: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 32.14 sec
Start 66: testcorenrn_patstim::coreneuron_cpu_offline
51/114 Test #66: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 5.63 sec
Start 69: testcorenrn_vecplay::neuron
52/114 Test #69: testcorenrn_vecplay::neuron ........................................ Passed 4.92 sec
Start 70: testcorenrn_vecplay::coreneuron_cpu_online
53/114 Test #65: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............ Passed 14.03 sec
Start 71: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
54/114 Test #14: parallel_partrans .................................................. Passed 56.22 sec
Start 15: parallel_netpar
55/114 Test #13: parallel_tests ..................................................... Passed 61.53 sec
Start 16: parallel_bas
56/114 Test #70: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 9.21 sec
Start 72: testcorenrn_vecplay::coreneuron_cpu_offline
57/114 Test #15: parallel_netpar .................................................... Passed 10.03 sec
Start 17: coreneuron_modtests::fornetcon_py_cpu
58/114 Test #72: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 6.91 sec
Start 81: testcorenrn_watch::neuron
59/114 Test #71: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 18.95 sec
Start 82: testcorenrn_watch::coreneuron_cpu_online
60/114 Test #81: testcorenrn_watch::neuron .......................................... Passed 4.86 sec
Start 83: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
61/114 Test #82: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 10.79 sec
Start 84: testcorenrn_watch::coreneuron_cpu_offline
62/114 Test #17: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 16.13 sec
Start 18: coreneuron_modtests::direct_py_cpu
63/114 Test #84: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 5.90 sec
Start 99: testcorenrn_netstimdirect::direct_netstimdirect
64/114 Test #83: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 18.49 sec
Start 100: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
65/114 Test #16: parallel_bas ....................................................... Passed 37.50 sec
Start 19: coreneuron_modtests::direct_hoc_cpu
66/114 Test #99: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 10.40 sec
Start 20: coreneuron_modtests::spikes_py_cpu
Start 21: coreneuron_modtests::spikes_file_mode_py_cpu
67/114 Test #100: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 13.33 sec
Start 22: coreneuron_modtests::fast_imem_py_cpu
Start 23: coreneuron_modtests::datareturn_py_cpu
68/114 Test #18: coreneuron_modtests::direct_py_cpu ................................. Passed 22.46 sec
Start 24: coreneuron_modtests::test_units_py_cpu
69/114 Test #19: coreneuron_modtests::direct_hoc_cpu ................................ Passed 20.68 sec
Start 25: coreneuron_modtests::test_netmove_py_cpu
70/114 Test #107: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 173.59 sec
Start 26: coreneuron_modtests::test_pointer_py_cpu
71/114 Test #106: channel_benchmark_sscx::neuron ..................................... Passed 179.59 sec
Start 27: coreneuron_modtests::test_watchrange_py_cpu
72/114 Test #108: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 176.61 sec
Start 28: coreneuron_modtests::test_psolve_py_cpu
73/114 Test #35: reduced_dentate::neuron ............................................ Passed 189.37 sec
Start 36: reduced_dentate::coreneuron_cpu
74/114 Test #103: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 182.13 sec
Start 29: coreneuron_modtests::test_ba_py_cpu
75/114 Test #102: channel_benchmark_hippo::neuron .................................... Passed 183.20 sec
Start 30: coreneuron_modtests::test_natrans_py_cpu
76/114 Test #104: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 185.38 sec
Start 34: external_nrntest
77/114 Test #21: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 49.27 sec
Start 51: testcorenrn_bbcore::compare_results
78/114 Test #51: testcorenrn_bbcore::compare_results ................................ Passed 0.09 sec
Start 57: testcorenrn_deriv::compare_results
79/114 Test #20: coreneuron_modtests::spikes_py_cpu ................................. Passed 49.95 sec
Start 63: testcorenrn_gf::compare_results
80/114 Test #57: testcorenrn_deriv::compare_results ................................. Passed 0.62 sec
Start 68: testcorenrn_patstim::compare_results
81/114 Test #63: testcorenrn_gf::compare_results .................................... Passed 0.30 sec
Start 74: testcorenrn_vecplay::compare_results
82/114 Test #68: testcorenrn_patstim::compare_results ............................... Passed 0.39 sec
Start 86: testcorenrn_watch::compare_results
83/114 Test #74: testcorenrn_vecplay::compare_results ............................... Passed 0.73 sec
Start 92: testcorenrn_conc::compare_results
84/114 Test #86: testcorenrn_watch::compare_results ................................. Passed 0.61 sec
Start 98: testcorenrn_kin::compare_results
85/114 Test #22: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 45.32 sec
Start 101: testcorenrn_netstimdirect::compare_results
86/114 Test #24: coreneuron_modtests::test_units_py_cpu ............................. Passed 43.58 sec
Start 105: channel_benchmark_hippo::compare_results
87/114 Test #98: testcorenrn_kin::compare_results ................................... Passed 0.83 sec
Start 109: channel_benchmark_sscx::compare_results
88/114 Test #92: testcorenrn_conc::compare_results .................................. Passed 0.89 sec
89/114 Test #101: testcorenrn_netstimdirect::compare_results ......................... Passed 0.50 sec
Start 31: coreneuron_modtests::spikes_mpi_py_cpu
90/114 Test #105: channel_benchmark_hippo::compare_results ........................... Passed 0.52 sec
91/114 Test #109: channel_benchmark_sscx::compare_results ............................ Passed 0.59 sec
Start 32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
92/114 Test #23: coreneuron_modtests::datareturn_py_cpu ............................. Passed 48.43 sec
93/114 Test #25: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 38.28 sec
Start 33: coreneuron_modtests::inputpresyn_py_cpu
94/114 Test #32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 5.67 sec
95/114 Test #27: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 20.49 sec
96/114 Test #28: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 20.42 sec
Start 75: testcorenrn_vecevent::neuron
97/114 Test #30: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 19.06 sec
98/114 Test #29: coreneuron_modtests::test_ba_py_cpu ................................ Passed 20.22 sec
99/114 Test #31: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 7.82 sec
Start 76: testcorenrn_vecevent::coreneuron_cpu_online
100/114 Test #26: coreneuron_modtests::test_pointer_py_cpu ........................... Passed 28.33 sec
101/114 Test #75: testcorenrn_vecevent::neuron ....................................... Passed 5.63 sec
Start 77: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
102/114 Test #76: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 8.94 sec
Start 78: testcorenrn_vecevent::coreneuron_cpu_offline
103/114 Test #78: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 5.19 sec
Start 110: olfactory-bulb-3d::neuron
104/114 Test #33: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 19.20 sec
105/114 Test #77: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 19.66 sec
Start 44: external_ringtest::coreneuron_cpu_mpi_threads
Start 80: testcorenrn_vecevent::compare_results
106/114 Test #80: testcorenrn_vecevent::compare_results .............................. Passed 0.08 sec
107/114 Test #44: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 7.38 sec
Start 112: olfactory-bulb-3d::coreneuron_cpu_online
Start 45: external_ringtest::compare_results
108/114 Test #45: external_ringtest::compare_results ................................. Passed 0.09 sec
109/114 Test #36: reduced_dentate::coreneuron_cpu .................................... Passed 57.13 sec
Start 37: reduced_dentate::compare_results
110/114 Test #37: reduced_dentate::compare_results ................................... Passed 0.12 sec
111/114 Test #110: olfactory-bulb-3d::neuron .......................................... Passed 179.99 sec
112/114 Test #112: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 164.67 sec
Start 114: olfactory-bulb-3d::compare_results
113/114 Test #114: olfactory-bulb-3d::compare_results ................................. Passed 0.20 sec
114/114 Test #34: external_nrntest ................................................... Passed 222.50 sec
100% tests passed, 0 tests failed out of 114
Total Test time (real) = 421.89 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646827725:step_script section_start:1646827725:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=206719 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179983 responseStatus=201 Created token=c_M6Txze
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=206774 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179983 responseStatus=201 Created token=c_M6Txze
section_end:1646827727:upload_artifacts_on_success section_start:1646827727:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646827728:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646828862:resolve_secrets Resolving secrets
section_end:1646828862:resolve_secrets section_start:1646828862:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor371090236, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179981
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179981_PROD_P112_CP2_C3
Job parameters: memory=76G, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319715
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=76G --job-name=GL_J179981_PROD_P112_CP2_C3 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=16 --jobid=319715 --cpus-per-task=1 --mem=76G
section_end:1646828953:prepare_executor section_start:1646828953:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646828956:prepare_script section_start:1646828956:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646828958:get_sources section_start:1646828958:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:nmodl:nvhpc:acc (179970)...
Runtime platform  arch=amd64 os=linux pid=245268 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179970 responseStatus=200 OK token=NmQw1Qfg
section_end:1646828960:download_artifacts section_start:1646828960:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i6n17
Build name: Linux-nvc++
Create new tag: 20220309-1230 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179970/spack-build/spack-stage-neuron-develop-dwkjkuknoiprgdt5yhhj7uooz4rce2vl/spack-build-dwkjkuk
Start 61: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 66: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 73: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 77: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 83: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 87: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 93: testcorenrn_gf::coreneuron_gpu_offline::preparation
Start 97: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 102: testcorenrn_patstim::coreneuron_gpu_offline::preparation
Start 105: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 56: external_ringtest::neuron
1/158 Test #102: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 5.28 sec
Start 69: testcorenrn_bbcore::neuron
2/158 Test #77: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 7.17 sec
Start 70: testcorenrn_bbcore::coreneuron_gpu_online
3/158 Test #87: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 7.20 sec
Start 71: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
4/158 Test #93: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 7.65 sec
Start 111: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
5/158 Test #73: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 8.03 sec
Start 72: testcorenrn_bbcore::coreneuron_gpu_offline
6/158 Test #105: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 8.34 sec
Start 115: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
7/158 Test #83: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 8.53 sec
Start 74: testcorenrn_bbcore::coreneuron_cpu_online
8/158 Test #97: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 9.48 sec
Start 131: testcorenrn_watch::coreneuron_gpu_offline::preparation
9/158 Test #56: external_ringtest::neuron .......................................... Passed 10.40 sec
Start 75: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
10/158 Test #69: testcorenrn_bbcore::neuron ......................................... Passed 5.65 sec
Start 76: testcorenrn_bbcore::coreneuron_cpu_offline
11/158 Test #61: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 11.20 sec
Start 135: testcorenrn_watch::coreneuron_cpu_offline::preparation
12/158 Test #66: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 12.12 sec
Start 57: external_ringtest::neuron_mpi
13/158 Test #72: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 4.24 sec
Start 79: testcorenrn_deriv::neuron
14/158 Test #111: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 6.16 sec
Start 58: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
15/158 Test #115: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 5.56 sec
Start 59: external_ringtest::coreneuron_cpu_mpi
16/158 Test #131: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 5.66 sec
Start 60: external_ringtest::coreneuron_cpu_mpi_offline
17/158 Test #70: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 8.31 sec
Start 80: testcorenrn_deriv::coreneuron_gpu_online
18/158 Test #79: testcorenrn_deriv::neuron .......................................... Passed 3.29 sec
Start 81: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
19/158 Test #76: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 4.73 sec
Start 82: testcorenrn_deriv::coreneuron_gpu_offline
20/158 Test #74: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 7.94 sec
Start 84: testcorenrn_deriv::coreneuron_cpu_online
21/158 Test #135: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 5.45 sec
Start 63: external_ringtest::coreneuron_gpu_mpi_offline_saverestore
22/158 Test #71: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 10.29 sec
Start 85: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
23/158 Test #75: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 7.25 sec
Start 86: testcorenrn_deriv::coreneuron_cpu_offline
24/158 Test #57: external_ringtest::neuron_mpi ...................................... Passed 9.20 sec
Start 64: external_ringtest::coreneuron_gpu_mpi
25/158 Test #86: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 3.88 sec
Start 100: testcorenrn_patstim::coreneuron_gpu_offline_saverestore
26/158 Test #60: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 8.27 sec
Start 65: external_ringtest::coreneuron_gpu_mpi_offline
27/158 Test #82: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 7.91 sec
Start 101: testcorenrn_patstim::coreneuron_gpu_offline
28/158 Test #59: external_ringtest::coreneuron_cpu_mpi .............................. Passed 27.57 sec
Start 89: testcorenrn_gf::neuron
29/158 Test #84: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 27.22 sec
Start 140: channel_benchmark_hippo::neuron
30/158 Test #85: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 27.95 sec
Start 141: channel_benchmark_hippo::coreneuron_gpu_online
31/158 Test #80: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 30.06 sec
Start 142: channel_benchmark_hippo::coreneuron_gpu_filemode
32/158 Test #81: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 32.65 sec
Start 143: channel_benchmark_hippo::coreneuron_cpu_online
33/158 Test #89: testcorenrn_gf::neuron ............................................. Passed 7.18 sec
Start 90: testcorenrn_gf::coreneuron_gpu_online
34/158 Test #101: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 26.69 sec
Start 144: channel_benchmark_hippo::coreneuron_cpu_filemode
35/158 Test #65: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 41.37 sec
Start 91: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
36/158 Test #64: external_ringtest::coreneuron_gpu_mpi .............................. Passed 45.84 sec
Start 92: testcorenrn_gf::coreneuron_gpu_offline
37/158 Test #100: testcorenrn_patstim::coreneuron_gpu_offline_saverestore ............ Passed 47.80 sec
Start 146: channel_benchmark_sscx::neuron
38/158 Test #90: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 42.94 sec
Start 94: testcorenrn_gf::coreneuron_cpu_online
39/158 Test #92: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 43.71 sec
Start 95: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
40/158 Test #94: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 31.92 sec
Start 96: testcorenrn_gf::coreneuron_cpu_offline
41/158 Test #58: external_ringtest::coreneuron_cpu_mpi_offline_saverestore .......... Passed 110.68 sec
Start 99: testcorenrn_patstim::neuron
42/158 Test #63: external_ringtest::coreneuron_gpu_mpi_offline_saverestore .......... Passed 108.37 sec
Start 103: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
43/158 Test #99: testcorenrn_patstim::neuron ........................................ Passed 4.27 sec
Start 104: testcorenrn_patstim::coreneuron_cpu_offline
44/158 Test #91: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 70.61 sec
Start 107: testcorenrn_vecplay::neuron
45/158 Test #107: testcorenrn_vecplay::neuron ........................................ Passed 4.10 sec
Start 108: testcorenrn_vecplay::coreneuron_gpu_online
46/158 Test #95: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 33.51 sec
Start 109: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
47/158 Test #96: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 23.66 sec
Start 110: testcorenrn_vecplay::coreneuron_gpu_offline
48/158 Test #104: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 26.64 sec
Start 112: testcorenrn_vecplay::coreneuron_cpu_online
49/158 Test #112: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 24.16 sec
Start 113: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
50/158 Test #103: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............ Passed 56.22 sec
Start 114: testcorenrn_vecplay::coreneuron_cpu_offline
51/158 Test #141: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 149.34 sec
Start 147: channel_benchmark_sscx::coreneuron_gpu_online
52/158 Test #108: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 55.50 sec
Start 127: testcorenrn_watch::neuron
53/158 Test #110: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 48.01 sec
Start 128: testcorenrn_watch::coreneuron_gpu_online
54/158 Test #140: channel_benchmark_hippo::neuron .................................... Passed 154.81 sec
Start 148: channel_benchmark_sscx::coreneuron_gpu_filemode
55/158 Test #127: testcorenrn_watch::neuron .......................................... Passed 3.89 sec
Start 129: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
56/158 Test #114: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 20.06 sec
Start 130: testcorenrn_watch::coreneuron_gpu_offline
57/158 Test #142: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 164.06 sec
Start 149: channel_benchmark_sscx::coreneuron_cpu_online
58/158 Test #143: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 165.43 sec
Start 150: channel_benchmark_sscx::coreneuron_cpu_filemode
59/158 Test #113: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 34.32 sec
Start 132: testcorenrn_watch::coreneuron_cpu_online
60/158 Test #144: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 164.01 sec
Start 1: testneuron
61/158 Test #1: testneuron ......................................................... Passed 0.18 sec
Start 2: ringtest
62/158 Test #146: channel_benchmark_sscx::neuron ..................................... Passed 145.25 sec
Start 3: connect_dend
63/158 Test #3: connect_dend ....................................................... Passed 0.38 sec
Start 4: mpi_init::nrniv_mpiopt
64/158 Test #2: ringtest ........................................................... Passed 0.63 sec
Start 5: mpi_init::nrniv_nrnmpi_init
65/158 Test #4: mpi_init::nrniv_mpiopt ............................................. Passed 0.68 sec
Start 6: mpi_init::python_nrnmpi_init
66/158 Test #5: mpi_init::nrniv_nrnmpi_init ........................................ Passed 0.50 sec
Start 7: mpi_init::python_mpienv
67/158 Test #6: mpi_init::python_nrnmpi_init ....................................... Passed 1.33 sec
Start 8: mpi_init::nrniv_mpiexec_mpiopt
68/158 Test #109: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 74.02 sec
Start 133: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
69/158 Test #7: mpi_init::python_mpienv ............................................ Passed 2.85 sec
Start 9: mpi_init::nrniv_mpiexec_nrnmpi_init
70/158 Test #8: mpi_init::nrniv_mpiexec_mpiopt ..................................... Passed 1.93 sec
Start 10: mpi_init::python_mpiexec_nrnmpi_init
71/158 Test #9: mpi_init::nrniv_mpiexec_nrnmpi_init ................................ Passed 1.57 sec
Start 11: mpi_init::python_mpiexec_mpienv
72/158 Test #10: mpi_init::python_mpiexec_nrnmpi_init ............................... Passed 2.24 sec
Start 12: pynrn_tests::basic_tests
73/158 Test #11: mpi_init::python_mpiexec_mpienv .................................... Passed 3.69 sec
Start 13: parallel_tests
74/158 Test #12: pynrn_tests::basic_tests ........................................... Passed 7.47 sec
Start 14: parallel_partrans
75/158 Test #14: parallel_partrans .................................................. Passed 7.63 sec
Start 15: parallel_netpar
76/158 Test #132: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 22.96 sec
Start 134: testcorenrn_watch::coreneuron_cpu_offline
77/158 Test #13: parallel_tests ..................................................... Passed 14.23 sec
Start 16: parallel_bas
78/158 Test #130: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 37.58 sec
Start 137: testcorenrn_netstimdirect::direct_netstimdirect
79/158 Test #128: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 43.74 sec
Start 138: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
80/158 Test #15: parallel_netpar .................................................... Passed 7.36 sec
Start 17: coreneuron_modtests::fornetcon_py_cpu
81/158 Test #134: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 17.13 sec
Start 18: coreneuron_modtests::direct_py_cpu
Start 19: coreneuron_modtests::direct_hoc_cpu
82/158 Test #133: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 40.80 sec
Start 20: coreneuron_modtests::spikes_py_cpu
Start 21: coreneuron_modtests::spikes_file_mode_py_cpu
83/158 Test #16: parallel_bas ....................................................... Passed 26.57 sec
Start 22: coreneuron_modtests::fast_imem_py_cpu
84/158 Test #17: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 25.91 sec
Start 23: coreneuron_modtests::datareturn_py_cpu
85/158 Test #22: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 5.01 sec
Start 24: coreneuron_modtests::test_units_py_cpu
86/158 Test #137: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 32.21 sec
Start 25: coreneuron_modtests::test_netmove_py_cpu
Start 26: coreneuron_modtests::test_pointer_py_cpu
87/158 Test #129: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 73.29 sec
Start 27: coreneuron_modtests::test_watchrange_py_cpu
Start 28: coreneuron_modtests::test_psolve_py_cpu
88/158 Test #138: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 35.19 sec
Start 29: coreneuron_modtests::test_ba_py_cpu
Start 30: coreneuron_modtests::test_natrans_py_cpu
89/158 Test #19: coreneuron_modtests::direct_hoc_cpu ................................ Passed 25.96 sec
Start 34: coreneuron_modtests::fornetcon_py_gpu
90/158 Test #18: coreneuron_modtests::direct_py_cpu ................................. Passed 27.82 sec
Start 35: coreneuron_modtests::direct_py_gpu
91/158 Test #21: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 23.96 sec
Start 36: coreneuron_modtests::direct_hoc_gpu
92/158 Test #20: coreneuron_modtests::spikes_py_cpu ................................. Passed 25.02 sec
Start 37: coreneuron_modtests::spikes_py_gpu
93/158 Test #24: coreneuron_modtests::test_units_py_cpu ............................. Passed 30.09 sec
Start 38: coreneuron_modtests::spikes_file_mode_py_gpu
94/158 Test #23: coreneuron_modtests::datareturn_py_cpu ............................. Passed 31.71 sec
Start 39: coreneuron_modtests::fast_imem_py_gpu
95/158 Test #39: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 3.49 sec
Start 40: coreneuron_modtests::datareturn_py_gpu
96/158 Test #28: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 33.65 sec
Start 41: coreneuron_modtests::test_units_py_gpu
97/158 Test #25: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 35.11 sec
Start 42: coreneuron_modtests::test_netmove_py_gpu
98/158 Test #27: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 36.23 sec
Start 43: coreneuron_modtests::test_pointer_py_gpu
99/158 Test #29: coreneuron_modtests::test_ba_py_cpu ................................ Passed 34.43 sec
Start 44: coreneuron_modtests::test_watchrange_py_gpu
100/158 Test #30: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 34.70 sec
Start 45: coreneuron_modtests::test_psolve_py_gpu
101/158 Test #34: coreneuron_modtests::fornetcon_py_gpu .............................. Passed 34.97 sec
Start 46: coreneuron_modtests::test_ba_py_gpu
102/158 Test #36: coreneuron_modtests::direct_hoc_gpu ................................ Passed 31.76 sec
Start 47: coreneuron_modtests::test_natrans_py_gpu
103/158 Test #35: coreneuron_modtests::direct_py_gpu ................................. Passed 33.47 sec
Start 51: external_nrntest
104/158 Test #37: coreneuron_modtests::spikes_py_gpu ................................. Passed 30.97 sec
Start 78: testcorenrn_bbcore::compare_results
105/158 Test #78: testcorenrn_bbcore::compare_results ................................ Passed 0.19 sec
Start 88: testcorenrn_deriv::compare_results
106/158 Test #88: testcorenrn_deriv::compare_results ................................. Passed 0.17 sec
Start 98: testcorenrn_gf::compare_results
107/158 Test #98: testcorenrn_gf::compare_results .................................... Passed 0.07 sec
Start 106: testcorenrn_patstim::compare_results
108/158 Test #147: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 121.02 sec
Start 116: testcorenrn_vecplay::compare_results
109/158 Test #106: testcorenrn_patstim::compare_results ............................... Passed 0.17 sec
Start 136: testcorenrn_watch::compare_results
110/158 Test #136: testcorenrn_watch::compare_results ................................. Passed 0.12 sec
Start 139: testcorenrn_netstimdirect::compare_results
111/158 Test #116: testcorenrn_vecplay::compare_results ............................... Passed 0.26 sec
Start 145: channel_benchmark_hippo::compare_results
112/158 Test #139: testcorenrn_netstimdirect::compare_results ......................... Passed 0.14 sec
113/158 Test #38: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 16.49 sec
Start 31: coreneuron_modtests::spikes_mpi_py_cpu
114/158 Test #145: channel_benchmark_hippo::compare_results ........................... Passed 0.25 sec
115/158 Test #148: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 118.44 sec
Start 32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
116/158 Test #149: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 114.21 sec
117/158 Test #41: coreneuron_modtests::test_units_py_gpu ............................. Passed 18.34 sec
Start 33: coreneuron_modtests::inputpresyn_py_cpu
118/158 Test #44: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 16.78 sec
119/158 Test #45: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 16.54 sec
Start 48: coreneuron_modtests::spikes_mpi_py_gpu
120/158 Test #42: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 19.54 sec
121/158 Test #40: coreneuron_modtests::datareturn_py_gpu ............................. Passed 20.95 sec
Start 49: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
122/158 Test #46: coreneuron_modtests::test_ba_py_gpu ................................ Passed 11.26 sec
123/158 Test #150: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 112.66 sec
Start 50: coreneuron_modtests::inputpresyn_py_gpu
124/158 Test #47: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 11.42 sec
Start 151: channel_benchmark_sscx::compare_results
125/158 Test #151: channel_benchmark_sscx::compare_results ............................ Passed 0.08 sec
126/158 Test #32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 14.95 sec
127/158 Test #31: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 16.30 sec
Start 121: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
128/158 Test #33: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 9.38 sec
129/158 Test #49: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 10.89 sec
Start 125: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
130/158 Test #48: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 11.83 sec
131/158 Test #50: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 10.89 sec
Start 153: olfactory-bulb-3d::neuron::preparation
132/158 Test #153: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.15 sec
Start 155: olfactory-bulb-3d::coreneuron_gpu_online::preparation
133/158 Test #121: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 5.00 sec
Start 157: olfactory-bulb-3d::coreneuron_cpu_online::preparation
134/158 Test #26: coreneuron_modtests::test_pointer_py_cpu ........................... Passed 66.62 sec
135/158 Test #155: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.55 sec
Start 52: reduced_dentate::neuron
136/158 Test #157: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.51 sec
Start 53: reduced_dentate::coreneuron_cpu
137/158 Test #43: coreneuron_modtests::test_pointer_py_gpu ........................... Passed 30.73 sec
138/158 Test #125: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 3.20 sec
Start 54: reduced_dentate::coreneuron_gpu
139/158 Test #52: reduced_dentate::neuron ............................................ Passed 18.80 sec
Start 62: external_ringtest::coreneuron_cpu_mpi_threads
140/158 Test #62: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 11.84 sec
Start 67: external_ringtest::coreneuron_gpu_mpi_threads
141/158 Test #53: reduced_dentate::coreneuron_cpu .................................... Passed 40.20 sec
Start 117: testcorenrn_vecevent::neuron
142/158 Test #54: reduced_dentate::coreneuron_gpu .................................... Passed 38.55 sec
Start 118: testcorenrn_vecevent::coreneuron_gpu_online
Start 55: reduced_dentate::compare_results
143/158 Test #55: reduced_dentate::compare_results ................................... Passed 0.17 sec
144/158 Test #67: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 13.36 sec
Start 119: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
Start 68: external_ringtest::compare_results
145/158 Test #68: external_ringtest::compare_results ................................. Passed 0.08 sec
146/158 Test #117: testcorenrn_vecevent::neuron ....................................... Passed 4.00 sec
Start 120: testcorenrn_vecevent::coreneuron_gpu_offline
147/158 Test #118: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 5.72 sec
Start 122: testcorenrn_vecevent::coreneuron_cpu_online
148/158 Test #120: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 5.47 sec
Start 123: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
149/158 Test #122: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 12.94 sec
Start 124: testcorenrn_vecevent::coreneuron_cpu_offline
150/158 Test #119: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 23.56 sec
Start 152: olfactory-bulb-3d::neuron
151/158 Test #123: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 18.28 sec
Start 154: olfactory-bulb-3d::coreneuron_gpu_online
152/158 Test #124: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 9.29 sec
Start 156: olfactory-bulb-3d::coreneuron_cpu_online
Start 126: testcorenrn_vecevent::compare_results
153/158 Test #126: testcorenrn_vecevent::compare_results .............................. Passed 0.41 sec
154/158 Test #51: external_nrntest ................................................... Passed 112.55 sec
155/158 Test #152: olfactory-bulb-3d::neuron .......................................... Passed 159.24 sec
156/158 Test #154: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 166.67 sec
157/158 Test #156: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 167.13 sec
Start 158: olfactory-bulb-3d::compare_results
158/158 Test #158: olfactory-bulb-3d::compare_results ................................. Passed 0.25 sec
100% tests passed, 0 tests failed out of 158
Total Test time (real) = 573.87 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646829624:step_script section_start:1646829624:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=257582 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179981 responseStatus=201 Created token=jHU41PXL
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=257637 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179981 responseStatus=201 Created token=jHU41PXL
section_end:1646829625:upload_artifacts_on_success section_start:1646829625:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646829626:cleanup_file_variables Job succeeded
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1646828310:resolve_secrets Resolving secrets
section_end:1646828310:resolve_secrets section_start:1646828310:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor951721588, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 42032, build ref 99c0b2078cc58bb7542d720a7ef0ec0c1eeabe28, job ID 179980
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032, optional exclusive flag , optional cpus per task flag --cpus-per-task=1
A slurm job will be created with name GL_J179980_PROD_P112_CP0_C0
Job parameters: memory=76G, cpus_per_task=1, duration=1:00:00, constraint=volta ntasks=16 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
Submitted batch job 319708
job state: R
sbatch: sbatch -p prod -A proj9998 --ntasks=16 --cpus-per-task=1 --mem=76G --job-name=GL_J179980_PROD_P112_CP0_C0 -C volta --no-requeue -D /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --time=1:00:00 --wrap="sleep infinity"
srun: srun --mpi=none --chdir=/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P42032 --ntasks=16 --jobid=319708 --cpus-per-task=1 --mem=76G
section_end:1646828378:prepare_executor section_start:1646828378:prepare_script Preparing environment
Running on r2i3n0 via bbpv1.epfl.ch...
section_end:1646828381:prepare_script section_start:1646828381:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1646828382:get_sources section_start:1646828382:download_artifacts Downloading artifacts
Downloading artifacts for build:neuron:nmodl:nvhpc:omp (179969)...
Runtime platform  arch=amd64 os=linux pid=234095 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=179969 responseStatus=200 OK token=NtFoy6Ji
section_end:1646828384:download_artifacts section_start:1646828384:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ export CTEST_PARALLEL_LEVEL=${SLURM_TASKS_PER_NODE}
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ cd ${SPACK_BUILD_DIR}
$ export BOOST_TEST_COLOR_OUTPUT=no
$ i_am_a_failure=0
$ spack build-env ${SPACK_FULL_SPEC} -- ctest --output-on-failure -T Test || i_am_a_failure=1
Site: r1i7n31
Build name: Linux-nvc++
Create new tag: 20220309-1220 - Experimental
Test project /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P42032/J179969/spack-build/spack-stage-neuron-develop-ik54mlr5japlprt37kesnyjymcdgaqgh/spack-build-ik54mlr
Start 61: external_ringtest::coreneuron_cpu_mpi_offline::preparation
Start 66: external_ringtest::coreneuron_gpu_mpi_offline::preparation
Start 73: testcorenrn_bbcore::coreneuron_gpu_offline::preparation
Start 77: testcorenrn_bbcore::coreneuron_cpu_offline::preparation
Start 83: testcorenrn_deriv::coreneuron_gpu_offline::preparation
Start 87: testcorenrn_deriv::coreneuron_cpu_offline::preparation
Start 93: testcorenrn_gf::coreneuron_gpu_offline::preparation
Start 97: testcorenrn_gf::coreneuron_cpu_offline::preparation
Start 102: testcorenrn_patstim::coreneuron_gpu_offline::preparation
Start 105: testcorenrn_patstim::coreneuron_cpu_offline::preparation
Start 56: external_ringtest::neuron
1/158 Test #73: testcorenrn_bbcore::coreneuron_gpu_offline::preparation ............ Passed 2.42 sec
Start 69: testcorenrn_bbcore::neuron
2/158 Test #83: testcorenrn_deriv::coreneuron_gpu_offline::preparation ............. Passed 3.60 sec
Start 70: testcorenrn_bbcore::coreneuron_gpu_online
3/158 Test #56: external_ringtest::neuron .......................................... Passed 3.85 sec
Start 71: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate
4/158 Test #87: testcorenrn_deriv::coreneuron_cpu_offline::preparation ............. Passed 4.85 sec
Start 72: testcorenrn_bbcore::coreneuron_gpu_offline
5/158 Test #77: testcorenrn_bbcore::coreneuron_cpu_offline::preparation ............ Passed 6.74 sec
Start 74: testcorenrn_bbcore::coreneuron_cpu_online
6/158 Test #102: testcorenrn_patstim::coreneuron_gpu_offline::preparation ........... Passed 8.09 sec
Start 75: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate
7/158 Test #97: testcorenrn_gf::coreneuron_cpu_offline::preparation ................ Passed 8.25 sec
Start 111: testcorenrn_vecplay::coreneuron_gpu_offline::preparation
8/158 Test #69: testcorenrn_bbcore::neuron ......................................... Passed 6.12 sec
Start 76: testcorenrn_bbcore::coreneuron_cpu_offline
9/158 Test #93: testcorenrn_gf::coreneuron_gpu_offline::preparation ................ Passed 9.09 sec
Start 115: testcorenrn_vecplay::coreneuron_cpu_offline::preparation
10/158 Test #105: testcorenrn_patstim::coreneuron_cpu_offline::preparation ........... Passed 9.11 sec
Start 131: testcorenrn_watch::coreneuron_gpu_offline::preparation
11/158 Test #111: testcorenrn_vecplay::coreneuron_gpu_offline::preparation ........... Passed 3.29 sec
Start 135: testcorenrn_watch::coreneuron_cpu_offline::preparation
12/158 Test #131: testcorenrn_watch::coreneuron_gpu_offline::preparation ............. Passed 2.79 sec
Start 57: external_ringtest::neuron_mpi
13/158 Test #115: testcorenrn_vecplay::coreneuron_cpu_offline::preparation ........... Passed 2.87 sec
Start 58: external_ringtest::coreneuron_cpu_mpi_offline_saverestore
14/158 Test #135: testcorenrn_watch::coreneuron_cpu_offline::preparation ............. Passed 2.13 sec
Start 59: external_ringtest::coreneuron_cpu_mpi
15/158 Test #57: external_ringtest::neuron_mpi ...................................... Passed 3.49 sec
Start 63: external_ringtest::coreneuron_gpu_mpi_offline_saverestore
16/158 Test #72: testcorenrn_bbcore::coreneuron_gpu_offline ......................... Passed 26.95 sec
Start 79: testcorenrn_deriv::neuron
17/158 Test #66: external_ringtest::coreneuron_gpu_mpi_offline::preparation ......... Passed 32.18 sec
Start 64: external_ringtest::coreneuron_gpu_mpi
18/158 Test #79: testcorenrn_deriv::neuron .......................................... Passed 1.54 sec
Start 80: testcorenrn_deriv::coreneuron_gpu_online
19/158 Test #61: external_ringtest::coreneuron_cpu_mpi_offline::preparation ......... Passed 37.22 sec
Start 60: external_ringtest::coreneuron_cpu_mpi_offline
20/158 Test #70: testcorenrn_bbcore::coreneuron_gpu_online .......................... Passed 34.86 sec
Start 81: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate
21/158 Test #76: testcorenrn_bbcore::coreneuron_cpu_offline ......................... Passed 33.65 sec
Start 82: testcorenrn_deriv::coreneuron_gpu_offline
22/158 Test #74: testcorenrn_bbcore::coreneuron_cpu_online .......................... Passed 35.49 sec
Start 84: testcorenrn_deriv::coreneuron_cpu_online
23/158 Test #75: testcorenrn_bbcore::coreneuron_cpu_online_psolve_alternate ......... Passed 34.20 sec
Start 85: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate
24/158 Test #59: external_ringtest::coreneuron_cpu_mpi .............................. Passed 31.45 sec
Start 65: external_ringtest::coreneuron_gpu_mpi_offline
25/158 Test #71: testcorenrn_bbcore::coreneuron_gpu_online_psolve_alternate ......... Passed 41.53 sec
Start 86: testcorenrn_deriv::coreneuron_cpu_offline
26/158 Test #80: testcorenrn_deriv::coreneuron_gpu_online ........................... Passed 19.29 sec
Start 100: testcorenrn_patstim::coreneuron_gpu_offline_saverestore
27/158 Test #60: external_ringtest::coreneuron_cpu_mpi_offline ...................... Passed 17.35 sec
Start 89: testcorenrn_gf::neuron
28/158 Test #82: testcorenrn_deriv::coreneuron_gpu_offline .......................... Passed 13.01 sec
Start 101: testcorenrn_patstim::coreneuron_gpu_offline
29/158 Test #64: external_ringtest::coreneuron_gpu_mpi .............................. Passed 23.24 sec
Start 90: testcorenrn_gf::coreneuron_gpu_online
30/158 Test #84: testcorenrn_deriv::coreneuron_cpu_online ........................... Passed 14.91 sec
Start 140: channel_benchmark_hippo::neuron
31/158 Test #85: testcorenrn_deriv::coreneuron_cpu_online_psolve_alternate .......... Passed 15.45 sec
Start 141: channel_benchmark_hippo::coreneuron_gpu_online
32/158 Test #89: testcorenrn_gf::neuron ............................................. Passed 3.60 sec
Start 91: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate
33/158 Test #86: testcorenrn_deriv::coreneuron_cpu_offline .......................... Passed 15.89 sec
Start 142: channel_benchmark_hippo::coreneuron_gpu_filemode
34/158 Test #81: testcorenrn_deriv::coreneuron_gpu_online_psolve_alternate .......... Passed 23.49 sec
Start 143: channel_benchmark_hippo::coreneuron_cpu_online
35/158 Test #65: external_ringtest::coreneuron_gpu_mpi_offline ...................... Passed 31.42 sec
Start 92: testcorenrn_gf::coreneuron_gpu_offline
36/158 Test #101: testcorenrn_patstim::coreneuron_gpu_offline ........................ Passed 33.19 sec
Start 144: channel_benchmark_hippo::coreneuron_cpu_filemode
37/158 Test #100: testcorenrn_patstim::coreneuron_gpu_offline_saverestore ............ Passed 51.26 sec
Start 146: channel_benchmark_sscx::neuron
38/158 Test #90: testcorenrn_gf::coreneuron_gpu_online .............................. Passed 51.55 sec
Start 94: testcorenrn_gf::coreneuron_cpu_online
39/158 Test #92: testcorenrn_gf::coreneuron_gpu_offline ............................. Passed 35.88 sec
Start 95: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate
40/158 Test #63: external_ringtest::coreneuron_gpu_mpi_offline_saverestore .......... Passed 105.05 sec
Start 96: testcorenrn_gf::coreneuron_cpu_offline
41/158 Test #58: external_ringtest::coreneuron_cpu_mpi_offline_saverestore .......... Passed 109.37 sec
Start 99: testcorenrn_patstim::neuron
42/158 Test #99: testcorenrn_patstim::neuron ........................................ Passed 4.62 sec
Start 103: testcorenrn_patstim::coreneuron_cpu_offline_saverestore
43/158 Test #94: testcorenrn_gf::coreneuron_cpu_online .............................. Passed 28.74 sec
Start 104: testcorenrn_patstim::coreneuron_cpu_offline
44/158 Test #91: testcorenrn_gf::coreneuron_gpu_online_psolve_alternate ............. Passed 79.31 sec
Start 107: testcorenrn_vecplay::neuron
45/158 Test #107: testcorenrn_vecplay::neuron ........................................ Passed 4.47 sec
Start 108: testcorenrn_vecplay::coreneuron_gpu_online
46/158 Test #96: testcorenrn_gf::coreneuron_cpu_offline ............................. Passed 26.78 sec
Start 109: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate
47/158 Test #104: testcorenrn_patstim::coreneuron_cpu_offline ........................ Passed 22.99 sec
Start 110: testcorenrn_vecplay::coreneuron_gpu_offline
48/158 Test #95: testcorenrn_gf::coreneuron_cpu_online_psolve_alternate ............. Passed 46.40 sec
Start 112: testcorenrn_vecplay::coreneuron_cpu_online
49/158 Test #103: testcorenrn_patstim::coreneuron_cpu_offline_saverestore ............ Passed 59.35 sec
Start 113: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate
50/158 Test #112: testcorenrn_vecplay::coreneuron_cpu_online ......................... Passed 27.87 sec
Start 114: testcorenrn_vecplay::coreneuron_cpu_offline
51/158 Test #108: testcorenrn_vecplay::coreneuron_gpu_online ......................... Passed 58.14 sec
Start 127: testcorenrn_watch::neuron
52/158 Test #141: channel_benchmark_hippo::coreneuron_gpu_online ..................... Passed 142.46 sec
Start 147: channel_benchmark_sscx::coreneuron_gpu_online
53/158 Test #127: testcorenrn_watch::neuron .......................................... Passed 4.03 sec
Start 128: testcorenrn_watch::coreneuron_gpu_online
54/158 Test #114: testcorenrn_vecplay::coreneuron_cpu_offline ........................ Passed 20.60 sec
Start 129: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate
55/158 Test #140: channel_benchmark_hippo::neuron .................................... Passed 150.77 sec
Start 148: channel_benchmark_sscx::coreneuron_gpu_filemode
56/158 Test #110: testcorenrn_vecplay::coreneuron_gpu_offline ........................ Passed 50.55 sec
Start 130: testcorenrn_watch::coreneuron_gpu_offline
57/158 Test #142: channel_benchmark_hippo::coreneuron_gpu_filemode ................... Passed 156.86 sec
Start 149: channel_benchmark_sscx::coreneuron_cpu_online
58/158 Test #113: testcorenrn_vecplay::coreneuron_cpu_online_psolve_alternate ........ Passed 34.91 sec
Start 132: testcorenrn_watch::coreneuron_cpu_online
59/158 Test #143: channel_benchmark_hippo::coreneuron_cpu_online ..................... Passed 168.76 sec
Start 150: channel_benchmark_sscx::coreneuron_cpu_filemode
60/158 Test #130: testcorenrn_watch::coreneuron_gpu_offline .......................... Passed 33.30 sec
Start 133: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate
61/158 Test #132: testcorenrn_watch::coreneuron_cpu_online ........................... Passed 22.81 sec
Start 134: testcorenrn_watch::coreneuron_cpu_offline
62/158 Test #109: testcorenrn_vecplay::coreneuron_gpu_online_psolve_alternate ........ Passed 100.78 sec
Start 137: testcorenrn_netstimdirect::direct_netstimdirect
63/158 Test #144: channel_benchmark_hippo::coreneuron_cpu_filemode ................... Passed 163.57 sec
Start 1: testneuron
64/158 Test #1: testneuron ......................................................... Passed 0.07 sec
Start 2: ringtest
65/158 Test #2: ringtest ........................................................... Passed 0.27 sec
Start 3: connect_dend
66/158 Test #3: connect_dend ....................................................... Passed 0.18 sec
Start 4: mpi_init::nrniv_mpiopt
67/158 Test #4: mpi_init::nrniv_mpiopt ............................................. Passed 0.66 sec
Start 5: mpi_init::nrniv_nrnmpi_init
68/158 Test #5: mpi_init::nrniv_nrnmpi_init ........................................ Passed 0.33 sec
Start 6: mpi_init::python_nrnmpi_init
69/158 Test #6: mpi_init::python_nrnmpi_init ....................................... Passed 0.99 sec
Start 7: mpi_init::python_mpienv
70/158 Test #7: mpi_init::python_mpienv ............................................ Passed 2.69 sec
Start 8: mpi_init::nrniv_mpiexec_mpiopt
71/158 Test #8: mpi_init::nrniv_mpiexec_mpiopt ..................................... Passed 1.88 sec
Start 9: mpi_init::nrniv_mpiexec_nrnmpi_init
72/158 Test #146: channel_benchmark_sscx::neuron ..................................... Passed 156.07 sec
Start 10: mpi_init::python_mpiexec_nrnmpi_init
73/158 Test #134: testcorenrn_watch::coreneuron_cpu_offline .......................... Passed 17.66 sec
Start 138: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate
74/158 Test #9: mpi_init::nrniv_mpiexec_nrnmpi_init ................................ Passed 1.69 sec
Start 11: mpi_init::python_mpiexec_mpienv
75/158 Test #10: mpi_init::python_mpiexec_nrnmpi_init ............................... Passed 2.18 sec
Start 12: pynrn_tests::basic_tests
76/158 Test #11: mpi_init::python_mpiexec_mpienv .................................... Passed 3.32 sec
Start 13: parallel_tests
77/158 Test #12: pynrn_tests::basic_tests ........................................... Passed 6.67 sec
Start 14: parallel_partrans
78/158 Test #137: testcorenrn_netstimdirect::direct_netstimdirect .................... Passed 26.51 sec
Start 15: parallel_netpar
Start 16: parallel_bas
79/158 Test #14: parallel_partrans .................................................. Passed 10.29 sec
Start 17: coreneuron_modtests::fornetcon_py_cpu
80/158 Test #13: parallel_tests ..................................................... Passed 16.91 sec
Start 18: coreneuron_modtests::direct_py_cpu
81/158 Test #15: parallel_netpar .................................................... Passed 8.46 sec
Start 19: coreneuron_modtests::direct_hoc_cpu
82/158 Test #17: coreneuron_modtests::fornetcon_py_cpu .............................. Passed 8.81 sec
Start 20: coreneuron_modtests::spikes_py_cpu
83/158 Test #18: coreneuron_modtests::direct_py_cpu ................................. Passed 14.13 sec
Start 21: coreneuron_modtests::spikes_file_mode_py_cpu
84/158 Test #19: coreneuron_modtests::direct_hoc_cpu ................................ Passed 12.66 sec
Start 22: coreneuron_modtests::fast_imem_py_cpu
85/158 Test #128: testcorenrn_watch::coreneuron_gpu_online ........................... Passed 91.65 sec
Start 23: coreneuron_modtests::datareturn_py_cpu
Start 24: coreneuron_modtests::test_units_py_cpu
86/158 Test #133: testcorenrn_watch::coreneuron_cpu_online_psolve_alternate .......... Passed 58.37 sec
Start 25: coreneuron_modtests::test_netmove_py_cpu
Start 26: coreneuron_modtests::test_pointer_py_cpu
87/158 Test #138: testcorenrn_netstimdirect::direct_netstimdirect_psolve_alternate ... Passed 40.97 sec
Start 27: coreneuron_modtests::test_watchrange_py_cpu
Start 28: coreneuron_modtests::test_psolve_py_cpu
88/158 Test #16: parallel_bas ....................................................... Passed 31.96 sec
Start 29: coreneuron_modtests::test_ba_py_cpu
89/158 Test #20: coreneuron_modtests::spikes_py_cpu ................................. Passed 19.07 sec
Start 30: coreneuron_modtests::test_natrans_py_cpu
90/158 Test #22: coreneuron_modtests::fast_imem_py_cpu .............................. Passed 15.91 sec
Start 34: coreneuron_modtests::fornetcon_py_gpu
91/158 Test #129: testcorenrn_watch::coreneuron_gpu_online_psolve_alternate .......... Passed 110.00 sec
Start 31: coreneuron_modtests::spikes_mpi_py_cpu
92/158 Test #21: coreneuron_modtests::spikes_file_mode_py_cpu ....................... Passed 28.10 sec
Start 35: coreneuron_modtests::direct_py_gpu
93/158 Test #24: coreneuron_modtests::test_units_py_cpu ............................. Passed 27.47 sec
Start 36: coreneuron_modtests::direct_hoc_gpu
94/158 Test #31: coreneuron_modtests::spikes_mpi_py_cpu ............................. Passed 10.83 sec
Start 32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu
95/158 Test #27: coreneuron_modtests::test_watchrange_py_cpu ........................ Passed 31.20 sec
Start 37: coreneuron_modtests::spikes_py_gpu
96/158 Test #23: coreneuron_modtests::datareturn_py_cpu ............................. Passed 37.83 sec
Start 38: coreneuron_modtests::spikes_file_mode_py_gpu
97/158 Test #28: coreneuron_modtests::test_psolve_py_cpu ............................ Passed 33.49 sec
Start 39: coreneuron_modtests::fast_imem_py_gpu
98/158 Test #29: coreneuron_modtests::test_ba_py_cpu ................................ Passed 29.35 sec
Start 40: coreneuron_modtests::datareturn_py_gpu
99/158 Test #30: coreneuron_modtests::test_natrans_py_cpu ........................... Passed 29.72 sec
Start 41: coreneuron_modtests::test_units_py_gpu
100/158 Test #32: coreneuron_modtests::spikes_mpi_file_mode_py_cpu ................... Passed 9.71 sec
Start 33: coreneuron_modtests::inputpresyn_py_cpu
101/158 Test #25: coreneuron_modtests::test_netmove_py_cpu ........................... Passed 37.21 sec
Start 42: coreneuron_modtests::test_netmove_py_gpu
102/158 Test #34: coreneuron_modtests::fornetcon_py_gpu .............................. Passed 26.95 sec
Start 43: coreneuron_modtests::test_pointer_py_gpu
103/158 Test #39: coreneuron_modtests::fast_imem_py_gpu .............................. Passed 3.52 sec
Start 44: coreneuron_modtests::test_watchrange_py_gpu
104/158 Test #147: channel_benchmark_sscx::coreneuron_gpu_online ...................... Passed 138.80 sec
Start 45: coreneuron_modtests::test_psolve_py_gpu
105/158 Test #148: channel_benchmark_sscx::coreneuron_gpu_filemode .................... Passed 131.30 sec
Start 46: coreneuron_modtests::test_ba_py_gpu
106/158 Test #149: channel_benchmark_sscx::coreneuron_cpu_online ...................... Passed 123.75 sec
Start 47: coreneuron_modtests::test_natrans_py_gpu
107/158 Test #41: coreneuron_modtests::test_units_py_gpu ............................. Passed 9.69 sec
Start 51: external_nrntest
108/158 Test #36: coreneuron_modtests::direct_hoc_gpu ................................ Passed 25.22 sec
Start 78: testcorenrn_bbcore::compare_results
109/158 Test #78: testcorenrn_bbcore::compare_results ................................ Passed 0.42 sec
Start 88: testcorenrn_deriv::compare_results
110/158 Test #38: coreneuron_modtests::spikes_file_mode_py_gpu ....................... Passed 15.47 sec
Start 98: testcorenrn_gf::compare_results
111/158 Test #44: coreneuron_modtests::test_watchrange_py_gpu ........................ Passed 10.45 sec
Start 106: testcorenrn_patstim::compare_results
112/158 Test #98: testcorenrn_gf::compare_results .................................... Passed 0.07 sec
Start 116: testcorenrn_vecplay::compare_results
113/158 Test #46: coreneuron_modtests::test_ba_py_gpu ................................ Passed 9.97 sec
Start 136: testcorenrn_watch::compare_results
114/158 Test #88: testcorenrn_deriv::compare_results ................................. Passed 0.51 sec
Start 139: testcorenrn_netstimdirect::compare_results
115/158 Test #139: testcorenrn_netstimdirect::compare_results ......................... Passed 0.27 sec
Start 145: channel_benchmark_hippo::compare_results
116/158 Test #116: testcorenrn_vecplay::compare_results ............................... Passed 0.58 sec
117/158 Test #136: testcorenrn_watch::compare_results ................................. Passed 0.56 sec
Start 48: coreneuron_modtests::spikes_mpi_py_gpu
118/158 Test #45: coreneuron_modtests::test_psolve_py_gpu ............................ Passed 10.74 sec
119/158 Test #33: coreneuron_modtests::inputpresyn_py_cpu ............................ Passed 12.09 sec
Start 49: coreneuron_modtests::spikes_mpi_file_mode_py_gpu
120/158 Test #106: testcorenrn_patstim::compare_results ............................... Passed 0.89 sec
Start 50: coreneuron_modtests::inputpresyn_py_gpu
121/158 Test #150: channel_benchmark_sscx::coreneuron_cpu_filemode .................... Passed 119.58 sec
Start 151: channel_benchmark_sscx::compare_results
122/158 Test #145: channel_benchmark_hippo::compare_results ........................... Passed 0.89 sec
123/158 Test #35: coreneuron_modtests::direct_py_gpu ................................. Passed 27.61 sec
124/158 Test #47: coreneuron_modtests::test_natrans_py_gpu ........................... Passed 9.48 sec
125/158 Test #151: channel_benchmark_sscx::compare_results ............................ Passed 1.10 sec
Start 121: testcorenrn_vecevent::coreneuron_gpu_offline::preparation
126/158 Test #37: coreneuron_modtests::spikes_py_gpu ................................. Passed 18.64 sec
127/158 Test #40: coreneuron_modtests::datareturn_py_gpu ............................. Passed 17.95 sec
128/158 Test #42: coreneuron_modtests::test_netmove_py_gpu ........................... Passed 15.75 sec
129/158 Test #26: coreneuron_modtests::test_pointer_py_cpu ........................... Passed 58.22 sec
Start 125: testcorenrn_vecevent::coreneuron_cpu_offline::preparation
130/158 Test #48: coreneuron_modtests::spikes_mpi_py_gpu ............................. Passed 9.83 sec
131/158 Test #121: testcorenrn_vecevent::coreneuron_gpu_offline::preparation .......... Passed 8.56 sec
Start 153: olfactory-bulb-3d::neuron::preparation
132/158 Test #153: olfactory-bulb-3d::neuron::preparation ............................. Passed 0.14 sec
Start 155: olfactory-bulb-3d::coreneuron_gpu_online::preparation
133/158 Test #155: olfactory-bulb-3d::coreneuron_gpu_online::preparation .............. Passed 0.13 sec
Start 157: olfactory-bulb-3d::coreneuron_cpu_online::preparation
134/158 Test #157: olfactory-bulb-3d::coreneuron_cpu_online::preparation .............. Passed 0.05 sec
Start 52: reduced_dentate::neuron
135/158 Test #50: coreneuron_modtests::inputpresyn_py_gpu ............................ Passed 11.59 sec
Start 53: reduced_dentate::coreneuron_cpu
136/158 Test #49: coreneuron_modtests::spikes_mpi_file_mode_py_gpu ................... Passed 11.88 sec
137/158 Test #125: testcorenrn_vecevent::coreneuron_cpu_offline::preparation .......... Passed 2.71 sec
Start 54: reduced_dentate::coreneuron_gpu
138/158 Test #43: coreneuron_modtests::test_pointer_py_gpu ........................... Passed 23.94 sec
139/158 Test #52: reduced_dentate::neuron ............................................ Passed 39.21 sec
Start 62: external_ringtest::coreneuron_cpu_mpi_threads
140/158 Test #53: reduced_dentate::coreneuron_cpu .................................... Passed 43.27 sec
Start 117: testcorenrn_vecevent::neuron
141/158 Test #117: testcorenrn_vecevent::neuron ....................................... Passed 4.08 sec
Start 118: testcorenrn_vecevent::coreneuron_gpu_online
142/158 Test #62: external_ringtest::coreneuron_cpu_mpi_threads ...................... Passed 15.23 sec
Start 67: external_ringtest::coreneuron_gpu_mpi_threads
143/158 Test #54: reduced_dentate::coreneuron_gpu .................................... Passed 54.49 sec
Start 119: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate
Start 55: reduced_dentate::compare_results
144/158 Test #55: reduced_dentate::compare_results ................................... Passed 0.07 sec
145/158 Test #118: testcorenrn_vecevent::coreneuron_gpu_online ........................ Passed 9.01 sec
Start 120: testcorenrn_vecevent::coreneuron_gpu_offline
146/158 Test #120: testcorenrn_vecevent::coreneuron_gpu_offline ....................... Passed 16.76 sec
Start 122: testcorenrn_vecevent::coreneuron_cpu_online
147/158 Test #67: external_ringtest::coreneuron_gpu_mpi_threads ...................... Passed 21.47 sec
Start 123: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate
Start 68: external_ringtest::compare_results
148/158 Test #68: external_ringtest::compare_results ................................. Passed 0.09 sec
149/158 Test #119: testcorenrn_vecevent::coreneuron_gpu_online_psolve_alternate ....... Passed 20.23 sec
Start 124: testcorenrn_vecevent::coreneuron_cpu_offline
150/158 Test #122: testcorenrn_vecevent::coreneuron_cpu_online ........................ Passed 3.12 sec
Start 152: olfactory-bulb-3d::neuron
151/158 Test #124: testcorenrn_vecevent::coreneuron_cpu_offline ....................... Passed 4.26 sec
Start 154: olfactory-bulb-3d::coreneuron_gpu_online
152/158 Test #123: testcorenrn_vecevent::coreneuron_cpu_online_psolve_alternate ....... Passed 41.98 sec
Start 156: olfactory-bulb-3d::coreneuron_cpu_online
Start 126: testcorenrn_vecevent::compare_results
153/158 Test #126: testcorenrn_vecevent::compare_results .............................. Passed 0.08 sec
154/158 Test #51: external_nrntest ................................................... Passed 348.74 sec
155/158 Test #152: olfactory-bulb-3d::neuron .......................................... Passed 259.43 sec
156/158 Test #154: olfactory-bulb-3d::coreneuron_gpu_online ........................... Passed 274.64 sec
157/158 Test #156: olfactory-bulb-3d::coreneuron_cpu_online ........................... Passed 237.30 sec
Start 158: olfactory-bulb-3d::compare_results
158/158 Test #158: olfactory-bulb-3d::compare_results ................................. Passed 0.25 sec
100% tests passed, 0 tests failed out of 158
Total Test time (real) = 715.87 sec
$ cp -r Testing/ ${CI_PROJECT_DIR}/
$ module load unstable unit-test-translator
Autoloading python/3.9.7
$ cmake2junit > ${CI_PROJECT_DIR}/ctest.xml
$ exit ${i_am_a_failure}
section_end:1646829133:step_script section_start:1646829133:upload_artifacts_on_success Uploading artifacts for successful job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=249782 revision=58ba2b95 version=14.2.0
initial_environment.env: found 1 matching files and directories
Testing/: found 7 matching files and directories 
Uploading artifacts as "archive" to coordinator... ok id=179980 responseStatus=201 Created token=1RDK_4Mj
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=249835 revision=58ba2b95 version=14.2.0
ctest.xml: found 1 matching files and directories 
Uploading artifacts as "junit" to coordinator... ok id=179980 responseStatus=201 Created token=1RDK_4Mj
section_end:1646829135:upload_artifacts_on_success section_start:1646829135:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1646829136:cleanup_file_variables Job succeeded
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment