Skip to content

Instantly share code, notes, and snippets.

@bbpbuildbot
Created December 22, 2021 17:20
Show Gist options
  • Save bbpbuildbot/af1c900afebcb19787628513975e851d to your computer and use it in GitHub Desktop.
Save bbpbuildbot/af1c900afebcb19787628513975e851d to your computer and use it in GitHub Desktop.
Logfiles for GitLab pipeline https://bbpgitlab.epfl.ch/hpc/coreneuron/-/pipelines/30337 (:no_entry:) running on GitHub PR BlueBrain/CoreNeuron#713.
Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640193342:resolve_secrets Resolving secrets
section_end:1640193342:resolve_secrets section_start:1640193342:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor168527936, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30337, build ref 5c5b8a37c8bc659a2cecaaf54b16775851939d44, job ID 114418
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30337/J114418, optional exclusive flag , optional cpus per task flag
A slurm job will be created with name GL_J114418_PROD_P112_CP10_C13
Job parameters: memory=30750M, cpus_per_task=, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 143905
job state: PD
job state: R
section_end:1640193345:prepare_executor section_start:1640193345:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1640193348:prepare_script section_start:1640193348:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640193349:get_sources section_start:1640193349:restore_cache Restoring cache
Checking cache for coreneuron-nvhpc-6...
Runtime platform  arch=amd64 os=linux pid=178964 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640193405:restore_cache section_start:1640193405:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (114411)...
Runtime platform  arch=amd64 os=linux pid=180453 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114411 responseStatus=200 OK token=-TwX4nWr
section_end:1640193406:download_artifacts section_start:1640193406:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114418/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114418/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114418/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114418/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114418/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="5c5b8a37c8bc659a2cecaaf54b16775851939d44"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..8cef2b5 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="5c5b8a37c8bc659a2cecaaf54b16775851939d44")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%nvhpc+gpu+openmp+tests~legacy-unit~report build_type=RelWithDebInfo
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be d4mbc44tzlxvfyp7iy3jomhrptr7oxvo
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30337/J114418/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30337/J114418/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Dec 22 18:18:03 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.39 / 0.51 (76.20 %)
Files: 9566
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'd4mbc44tzlxvfyp7iy3jomhrptr7oxvo'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%nvhpc+gpu~legacy-unit+openmp~report+tests build_type=RelWithDebInfo
Concretized
--------------------------------
- d4mbc44 coreneuron@develop%nvhpc@21.11~caliper~codegenopt+gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl+openmp~profile~report+shared~sympy~sympyopt+tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- ilh3i6h ^bison@3.6.4%nvhpc@21.11 patches=ad81ef1b088459a396d908295afc3809f9a25076efaa459cdd2f21eabd1f4b16 arch=linux-rhel7-x86_64
[^] ugnnauj ^boost@1.73.0%nvhpc@21.11+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556,d56f31f2a3956630e5372b987d39cb79b5d2c71760fa150b8eb4a3f1a07e2658 visibility=hidden arch=linux-rhel7-x86_64
- 3id4xmv ^cmake@3.15.7%nvhpc@21.11~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
[^] rtdgzju ^cuda@11.5.1%nvhpc@21.11 arch=linux-rhel7-x86_64
- o7642tm ^flex@2.6.4%nvhpc@21.11+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] rvmqyas ^hpe-mpi@2.25.hmpt%nvhpc@21.11 arch=linux-rhel7-x86_64
- 6yf3e2o ^ninja@1.10.2%nvhpc@21.11 arch=linux-rhel7-x86_64
[^] boepiq7 ^python@3.8.3%nvhpc@21.11+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
usage: spack install [-hnvy] [--only {package,dependencies}] [-u UNTIL]
[-j JOBS] [--overwrite] [--fail-fast] [--keep-prefix]
[--keep-stage] [--dont-restage]
[--use-cache | --no-cache | --cache-only]
[--no-check-signature] [--require-full-hash-match]
[--show-log-on-error] [--source] [--fake]
[--only-concrete] [-f SPEC_YAML_FILE] [--clean | --dirty]
[--test {root,all} | --run-tests]
[--log-format {None,junit,cdash}] [--log-file LOG_FILE]
[--help-cdash]
...
spack install: error: argument -j/--jobs: expected one argument
srun: error: r1i6n17: task 0: Exited with exit code 1
section_end:1640193512:step_script section_start:1640193512:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188132 revision=58ba2b95 version=14.2.0
WARNING: install.xml: no matching files 
WARNING: spack_build_info.env: no matching files 
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
WARNING: spack-build-env.txt: no matching files 
WARNING: spack-build-out.txt: no matching files 
WARNING: spack-configure-args.txt: no matching files
Uploading artifacts as "archive" to coordinator... ok id=114418 responseStatus=201 Created token=ZmtjHz7h
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188207 revision=58ba2b95 version=14.2.0
WARNING: install.xml: no matching files 
ERROR: No files to upload 
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188238 revision=58ba2b95 version=14.2.0
WARNING: spack_build_info.env: no matching files 
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114418 responseStatus=201 Created token=ZmtjHz7h
section_end:1640193514:upload_artifacts_on_failure section_start:1640193514:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640193514:cleanup_file_variables ERROR: Job failed: exit status 1

Running with gitlab-runner 14.3.2 (e0218c92)
 on BB5 map runner pnPo3yJy
section_start:1640193342:resolve_secrets Resolving secrets
section_end:1640193342:resolve_secrets section_start:1640193342:prepare_executor Preparing the "custom" executor
Using Custom executor with driver BB5 PROD runner v0.0.3...
BB5 PROD runner running on bbpv1.epfl.ch, version 14.3.2, user
TMPDIR is /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/tmp/custom-executor069602619, slurm job id
Runner ID 29, project root hpc, project name coreneuron
Pipeline ID 30337, build ref 5c5b8a37c8bc659a2cecaaf54b16775851939d44, job ID 114415
Build dir /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30337/J114415, optional exclusive flag , optional cpus per task flag
A slurm job will be created with name GL_J114415_PROD_P112_CP9_C12
Job parameters: memory=30750M, cpus_per_task=, duration=1:00:00, constraint=cpu ntasks=1 account=proj9998 user=bbpcihpcproj12 partition=prod
sbatch: INFO: Activating auto partition selection plugin, please report errors to HPC/CS
sbatch: INFO: Job specifies cpu constraint, setting --constraint=[skl|clx]
Submitted batch job 143904
job state: PD
job state: PD
job state: R
section_end:1640193345:prepare_executor section_start:1640193345:prepare_script Preparing environment
Running on r1i6n17 via bbpv1.epfl.ch...
section_end:1640193348:prepare_script section_start:1640193348:get_sources Getting source from Git repository
Skipping Git repository setup
Skipping Git checkout
Skipping Git submodules setup
section_end:1640193349:get_sources section_start:1640193349:restore_cache Restoring cache
Checking cache for coreneuron-intel-6...
Runtime platform  arch=amd64 os=linux pid=178950 revision=58ba2b95 version=14.2.0
cache.zip is up to date 
Successfully extracted cache
section_end:1640193396:restore_cache section_start:1640193396:download_artifacts Downloading artifacts
Downloading artifacts for spack_setup (114411)...
Runtime platform  arch=amd64 os=linux pid=179594 revision=58ba2b95 version=14.2.0
Downloading artifacts from coordinator... ok  id=114411 responseStatus=200 OK token=-TwX4nWr
section_end:1640193396:download_artifacts section_start:1640193396:step_script Executing "step_script" stage of the job script
WARNING: Starting with version 14.0 the 'build_script' stage will be replaced with 'step_script': https://gitlab.com/gitlab-org/gitlab-runner/-/issues/26426
$ SPACK_BUILD="${PWD}/spack-build"
$ env -0 | sort -z | xargs -0 -L 1 echo > initial_environment.env
$ . ${SPACK_ROOT}/share/spack/setup-env.sh
$ SPACK_CONFIG=${PWD}/spack-config
$ mkdir ${SPACK_CONFIG}
$ cat > ${SPACK_CONFIG}/config.yaml << END_SCRIPT # collapsed multi-line command
$ spack --config-scope ${SPACK_CONFIG} config blame config
--- config:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114415/_/spack-config/config.yaml:2 build_stage:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114415/_/spack-config/config.yaml:3 - /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114415/_/spack-build
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:69 - $tempdir/$user/spack-stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 - ~/.spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 # - $spack/var/spack/stage
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 # Directory in which to run tests and store test results.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:70 # Tests will be stored in directories named by date/time and package
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114415/_/spack-config/config.yaml:4 # name/hash.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:2 source_cache: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114415/_/spack-source-cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:3 install_tree:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:4 projections:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:20 all: ${ARCHITECTURE}/${COMPILERNAME}-${COMPILERVER}/${PACKAGE}-${VERSION}-${HASH:6}
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:5 root: $spack/opt/spack
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/config.yaml:6 build_jobs: 36
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:33 ccache: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:33 template_dirs:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:34 - $spack/share/spack/templates
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:38
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:39
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:40 # Locations where different types of modules should be installed.
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:76 module_roots:
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:85 tcl: $spack/share/spack/modules
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:91 lmod: $spack/share/spack/lmod
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:96 test_stage: ~/.spack/test
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:104 misc_cache: ~/.spack/cache
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:110 connect_timeout: 10
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:115 verify_ssl: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:120 suppress_gpg_warnings: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:128 install_missing_compilers: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:137 checksum: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:163 dirty: False
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:170 build_language: C
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:178 locks: True
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:184 concretizer: original
/gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs/bbpcihpcproj12/P30337/J114411/_/spack/etc/spack/defaults/config.yaml:189 db_lock_timeout: 300
_builtin package_lock_timeout: !!null 'None'
$ if [ "${SPACK_EXPORT_SPECS}" ]; then
$ export XDG_CONFIG_HOME=${PWD}/local_config
$ mkdir -p "${XDG_CONFIG_HOME}/git"
$ echo -e "[url \"https://gitlab-ci-token:${CI_JOB_TOKEN}@bbpgitlab.epfl.ch/\"]\n insteadOf = git@bbpgitlab.epfl.ch:" > "${XDG_CONFIG_HOME}/git/config"
$ cat "${XDG_CONFIG_HOME}/git/config"
[url "https://gitlab-ci-token:[MASKED]@bbpgitlab.epfl.ch/"]
insteadOf = git@bbpgitlab.epfl.ch:
$ REF_OVERRIDE_NAME=SPACK_PACKAGE_REF_${SPACK_PACKAGE}
$ PACKAGE_REF=${!REF_OVERRIDE_NAME:-$SPACK_PACKAGE_REF}
$ SPACK_PACKAGE_FILE="$(spack location -p ${SPACK_PACKAGE})/package.py"
$ if [ "${PACKAGE_REF}" ]; then
$ echo New ref for ${SPACK_PACKAGE} is ${PACKAGE_REF}
New ref for coreneuron is commit="5c5b8a37c8bc659a2cecaaf54b16775851939d44"
$ sed -i -e "/^\s*version\s*(\s*\(['\"]\)develop\1/ { s/,\s*\(commit\|tag\|branch\)=\([\"']\)[^\"']\+\2//g; s#)#, ${PACKAGE_REF})#; }" "${SPACK_PACKAGE_FILE}"
$ (cd $(dirname "${SPACK_PACKAGE_FILE}") && git diff "${SPACK_PACKAGE_FILE}")
diff --git a/var/spack/repos/builtin/packages/coreneuron/package.py b/var/spack/repos/builtin/packages/coreneuron/package.py
index d2ab4ef..8cef2b5 100644
--- a/var/spack/repos/builtin/packages/coreneuron/package.py
+++ b/var/spack/repos/builtin/packages/coreneuron/package.py
@@ -18,7 +18,7 @@ class Coreneuron(CMakePackage):
url = "https://github.com/BlueBrain/CoreNeuron"
git = "https://github.com/BlueBrain/CoreNeuron"
- version('develop', branch='master')
+ version('develop', commit="5c5b8a37c8bc659a2cecaaf54b16775851939d44")
# 1.0.1 > 1.0.0.20210519 > 1.0 as far as Spack is concerned
version('1.0.0.20211020', commit='e265f9d')
version('1.0.0.20211012', commit='846b3a6')
$ fi
$ SPACK_FULL_SPEC="${SPACK_PACKAGE}@develop${SPACK_PACKAGE_COMPILER:+%}${SPACK_PACKAGE_COMPILER}${SPACK_PACKAGE_SPEC}${SPACK_PACKAGE_DEPENDENCIES:+ }${SPACK_PACKAGE_DEPENDENCIES}"
$ echo "Preparing to install ${SPACK_FULL_SPEC}"
Preparing to install coreneuron@develop%intel+tests~legacy-unit build_type=Debug
$ JSON_SPEC=$(spack --config-scope ${SPACK_CONFIG} spec --json ${SPACK_FULL_SPEC})
$ SPACK_INSTALLED_HASH=$(echo "${JSON_SPEC}" | python -c "import json, sys; print(json.loads(sys.stdin.read())[\"spec\"][0][\"${SPACK_PACKAGE}\"][\"hash\"])")
$ echo "Determined its hash will be ${SPACK_INSTALLED_HASH}"
Determined its hash will be aevgkbdozl3htdtjhrd5w65n3c6mb2jh
$ SPACK_STAGE_DIR=${SPACK_BUILD}/spack-stage-${SPACK_PACKAGE}-develop-${SPACK_INSTALLED_HASH}
$ SPACK_BUILD_DIR=${SPACK_STAGE_DIR}/spack-build-${SPACK_INSTALLED_HASH:0:7}
$ SPACK_SOURCE_DIR=${SPACK_STAGE_DIR}/spack-src
$ if [ ${SPACK_USE_CCACHE+x} ]; then
$ module load unstable ccache
$ export CCACHE_BASEDIR=${SPACK_STAGE_DIR}
$ export CCACHE_DIR=${CI_PROJECT_DIR}/ccache
$ export CCACHE_MAXSIZE=512M
$ mkdir -p ${CCACHE_BASEDIR}
$ ccache --zero-stats
Statistics zeroed
$ ccache --show-stats --verbose
Summary:
Cache directory: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30337/J114415/_/ccache
Primary config: /gpfs/bbp.cscs.ch/ssd/gitlab_map_jobs//bbpcihpcproj12/P30337/J114415/_/ccache/ccache.conf
Secondary config: /gpfs/bbp.cscs.ch/ssd/apps/hpc/jenkins/deploy/externals/2021-01-06/linux-rhel7-x86_64/gcc-9.3.0/ccache-4.4.2-rg3w3q/etc/ccache.conf
Stats updated: Wed Dec 22 18:18:03 2021
Hits: 0 / 0
Direct: 0 / 0
Preprocessed: 0 / 0
Misses: 0
Direct: 0
Preprocessed: 0
Primary storage:
Hits: 0 / 0
Misses: 0
Cache size (GB): 0.36 / 0.51 (69.76 %)
Files: 7354
$ fi
$ module load unstable git ${SPACK_EXTRA_MODULES}
$ spack --config-scope ${SPACK_CONFIG} uninstall -y --dependents /${SPACK_INSTALLED_HASH} || true
==> Error: No installed spec matches the hash: 'aevgkbdozl3htdtjhrd5w65n3c6mb2jh'
$ spack --config-scope ${SPACK_CONFIG} spec -Il ${SPACK_FULL_SPEC}
Input spec
--------------------------------
- coreneuron@develop%intel~legacy-unit+tests build_type=Debug
Concretized
--------------------------------
- aevgkbd coreneuron@develop%intel@19.1.2.254~caliper~codegenopt~gpu~ipo~ispc~knl~legacy-unit+mpi~nmodl~openmp~profile+report+shared~sympy~sympyopt+tests build_type=Debug arch=linux-rhel7-x86_64
- ymcya3l ^bison@3.6.4%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] pvpzjkl ^boost@1.73.0%intel@19.1.2.254+atomic+chrono~clanglibcpp~container~context~coroutine+date_time~debug+exception~fiber+filesystem+graph~icu+iostreams+locale+log+math~mpi+multithreaded~numpy+pic+program_options~python+random+regex+serialization+shared+signals~singlethreaded+system~taggedlayout+test+thread+timer~versionedlayout+wave cxxstd=98 patches=246508e052c44b6f4e8c2542a71c06cacaa72cd1447ab8d2a542b987bc35ace9,4dd507e1f5a29e3b87b15321a4d8c74afdc8331433edabf7aeab89b3c405d556 visibility=hidden arch=linux-rhel7-x86_64
- mxqypex ^cmake@3.15.7%intel@19.1.2.254~doc+ncurses+openssl+ownlibs~qt build_type=Release patches=1c540040c7e203dd8e27aa20345ecb07fe06570d56410a24a266ae570b1c4c39,bf695e3febb222da2ed94b3beea600650e4318975da90e4a71d6f31a6d5d8c3d arch=linux-rhel7-x86_64
- 5mabxtb ^flex@2.6.4%intel@19.1.2.254+lex patches=09c22e5c6fef327d3e48eb23f0d610dcd3a35ab9207f12e0f875701c677978d3 arch=linux-rhel7-x86_64
[^] nnhu6zi ^hpe-mpi@2.25.hmpt%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] 2gn7wjx ^libsonata-report@1.0.0.20211007%intel@19.1.2.254~ipo+mpi build_type=RelWithDebInfo arch=linux-rhel7-x86_64
[^] pjaxv63 ^hdf5@1.10.7%intel@19.1.2.254+cxx~debug~fortran+hl~java+mpi+pic+shared~szip~threadsafe api=none arch=linux-rhel7-x86_64
[^] wjshhip ^zlib@1.2.11%intel@19.1.2.254+optimize+pic+shared arch=linux-rhel7-x86_64
[^] gwht6mm ^spdlog@1.8.1%intel@19.1.2.254~ipo+shared build_type=RelWithDebInfo arch=linux-rhel7-x86_64
- nayogh4 ^ninja@1.10.2%intel@19.1.2.254 arch=linux-rhel7-x86_64
[^] icfhbit ^python@3.8.3%intel@19.1.2.254+bz2+ctypes+dbm~debug+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93189bc278fbc37a50ed7f183bd8aaf249a8e1670a465f0db6bb4f8cf87 arch=linux-rhel7-x86_64
[^] 7eg3tqe ^reportinglib@2.5.6%intel@19.1.2.254~ipo~profile+shared~tests build_type=RelWithDebInfo arch=linux-rhel7-x86_64
$ spack ${SPACK_INSTALL_EXTRA_FLAGS} --config-scope ${SPACK_CONFIG} install -j${SLURM_CPUS_PER_TASK} --log-format=junit --log-file=${CI_PROJECT_DIR}/install.xml --keep-stage ${SPACK_FULL_SPEC}
usage: spack install [-hnvy] [--only {package,dependencies}] [-u UNTIL]
[-j JOBS] [--overwrite] [--fail-fast] [--keep-prefix]
[--keep-stage] [--dont-restage]
[--use-cache | --no-cache | --cache-only]
[--no-check-signature] [--require-full-hash-match]
[--show-log-on-error] [--source] [--fake]
[--only-concrete] [-f SPEC_YAML_FILE] [--clean | --dirty]
[--test {root,all} | --run-tests]
[--log-format {None,junit,cdash}] [--log-file LOG_FILE]
[--help-cdash]
...
spack install: error: argument -j/--jobs: expected one argument
srun: error: r1i6n17: task 0: Exited with exit code 1
section_end:1640193512:step_script section_start:1640193512:upload_artifacts_on_failure Uploading artifacts for failed job
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188161 revision=58ba2b95 version=14.2.0
WARNING: install.xml: no matching files 
WARNING: spack_build_info.env: no matching files 
spack_clone_variables.env: found 1 matching files and directories
initial_environment.env: found 1 matching files and directories
WARNING: spack-build-env.txt: no matching files 
WARNING: spack-build-out.txt: no matching files 
WARNING: spack-configure-args.txt: no matching files
Uploading artifacts as "archive" to coordinator... ok id=114415 responseStatus=201 Created token=R-7Dzqtc
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188230 revision=58ba2b95 version=14.2.0
WARNING: install.xml: no matching files 
ERROR: No files to upload 
Uploading artifacts...
Runtime platform  arch=amd64 os=linux pid=188261 revision=58ba2b95 version=14.2.0
WARNING: spack_build_info.env: no matching files 
spack_clone_variables.env: found 1 matching files and directories
Uploading artifacts as "dotenv" to coordinator... ok id=114415 responseStatus=201 Created token=R-7Dzqtc
section_end:1640193513:upload_artifacts_on_failure section_start:1640193513:cleanup_file_variables Cleaning up project directory and file based variables
section_end:1640193514:cleanup_file_variables ERROR: Job failed: exit status 1

Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Log was not fetched because job had status: skipped
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment