Skip to content

Instantly share code, notes, and snippets.

@enricorotundo

enricorotundo/hepscore.md

Last active September 15, 2022 14:11
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save enricorotundo/86fdc132dbb061a17612b37c0a0554c7 to your computer and use it in GitHub Desktop.
Save enricorotundo/86fdc132dbb061a17612b37c0a0554c7 to your computer and use it in GitHub Desktop.
Download ZIP
hepscore
Raw
hepscore.md

Repo: https://github.com/cmscaltech/docker-hs06/tree/master/hepscore

Prerequisites

Using CentOS Stream release 9. I tried using Red Hat enterprise linux version 7,8,9 but there's a blocking issue with Google Cloud infra at the moment that prevents any yum install (opened a support ticket with them...).

sudo yum update
sudo yum -y install git
git clone https://github.com/cmscaltech/docker-hs06.git
cd docker-hs06/hepscore

Prepare Install

## `sudo bash install.sh` throws a number of errors, let's try to fix them manually

# Error: Unable to find a match: docker-ce
sudo yum install -y yum-utils
sudo yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
sudo yum install -y docker-ce docker-ce-cli containerd.io # probably docker-ce is enough

# mkdir: cannot create directory ‘/wntmp/docker’: No such file or directory
sudo mkdir -p /wntmp
sudo mkdir -p /wntmp/docker

# install.sh: line 32: pip3: command not found
sudo yum install python3-pip -y

Install

[enrico@caltech-benchmark-enrico-centos hepscore]$ sudo bash install.sh
Last metadata expiration check: 0:02:15 ago on Thu 15 Sep 2022 01:26:38 PM UTC.
Package docker-ce-3:20.10.18-3.el9.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
Redirecting to /bin/systemctl stop docker.service
mkdir: cannot create directory ‘/wntmp/docker’: No such file or directory
Redirecting to /bin/systemctl start docker.service
Job for docker.service failed because the control process exited with error code.
See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.
/proc/sys/user/max_net_namespaces = 10000
Collecting git+https://gitlab.cern.ch/hep-benchmarks/hep-score.git
  Cloning https://gitlab.cern.ch/hep-benchmarks/hep-score.git to /tmp/pip-req-build-i83k203t
  Running command git clone -q https://gitlab.cern.ch/hep-benchmarks/hep-score.git /tmp/pip-req-build-i83k203t
  Resolved https://gitlab.cern.ch/hep-benchmarks/hep-score.git to commit 19502f0986276e9377f4b24b17e75abf9aa699f5
Collecting setuptools<45
  Downloading setuptools-44.1.1-py2.py3-none-any.whl (583 kB)
     |████████████████████████████████| 583 kB 3.2 MB/s 
Collecting pbr>=5.0.0
  Using cached pbr-5.10.0-py2.py3-none-any.whl (112 kB)
Collecting pyyaml>=5.1
  Downloading PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)
     |████████████████████████████████| 661 kB 17.5 MB/s 
Using legacy 'setup.py install' for hep-score, since package 'wheel' is not installed.
Installing collected packages: setuptools, pyyaml, pbr, hep-score
  WARNING: Value for scheme.platlib does not match. Please report this to <https://github.com/pypa/pip/issues/10151>
  distutils: /root/.local/lib/python3.9/site-packages
  sysconfig: /root/.local/lib64/python3.9/site-packages
  WARNING: Additional context:
  user = True
  home = None
  root = None
  prefix = None
  WARNING: The scripts easy_install and easy_install-3.9 are installed in '/root/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
  WARNING: The script pbr is installed in '/root/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
    Running setup.py install for hep-score ... done
Successfully installed hep-score-1.4.0 pbr-5.10.0 pyyaml-6.0 setuptools-44.1.1
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

Run all

  1. I've reduced SLEEP_TIME_BEFORE_RUNS from 300 to 3 to see some logs in reasonable time.
  2. sudo bash run-all.sh
  3. Let's inspect the logs
[enrico@caltech-benchmark-enrico-centos hepscore]$ cat /wntmp/benchmarks/HEPSCORE-HT-ON/1663250131/all.out 
2022-09-15 13:55:31 hepscore [INFO] .atlas-sim-bmk is commented out: Skipping this benchmark!
Traceback (most recent call last):
  File "/root/.local/bin/hepscore", line 10, in <module>
    sys.exit(main())
  File "/root/.local/lib/python3.9/site-packages/hepscore/main.py", line 162, in main
    if hep_score.run(args['replay']) >= 0:
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 771, in run
    ver = self.get_version()
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 364, in get_version
    if re.sub(r'[^0-9\.]', '', line.decode('utf-8'))[0].isdigit():
IndexError: string index out of range

[enrico@caltech-benchmark-enrico-centos hepscore]$ cat /wntmp/benchmarks/HEPSCORE-HT-ON/1663250131/atlas.out 
Traceback (most recent call last):
  File "/root/.local/bin/hepscore", line 10, in <module>
    sys.exit(main())
  File "/root/.local/lib/python3.9/site-packages/hepscore/main.py", line 162, in main
    if hep_score.run(args['replay']) >= 0:
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 771, in run
    ver = self.get_version()
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 364, in get_version
    if re.sub(r'[^0-9\.]', '', line.decode('utf-8'))[0].isdigit():
IndexError: string index out of range

[enrico@caltech-benchmark-enrico-centos hepscore]$ cat /wntmp/benchmarks/HEPSCORE-HT-ON/1663250131/belle2.out 
Traceback (most recent call last):
  File "/root/.local/bin/hepscore", line 10, in <module>
    sys.exit(main())
  File "/root/.local/lib/python3.9/site-packages/hepscore/main.py", line 162, in main
    if hep_score.run(args['replay']) >= 0:
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 771, in run
    ver = self.get_version()
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 364, in get_version
    if re.sub(r'[^0-9\.]', '', line.decode('utf-8'))[0].isdigit():
IndexError: string index out of range

[enrico@caltech-benchmark-enrico-centos hepscore]$ cat /wntmp/benchmarks/HEPSCORE-HT-ON/1663250131/cms.out 
Traceback (most recent call last):
  File "/root/.local/bin/hepscore", line 10, in <module>
    sys.exit(main())
  File "/root/.local/lib/python3.9/site-packages/hepscore/main.py", line 162, in main
    if hep_score.run(args['replay']) >= 0:
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 771, in run
    ver = self.get_version()
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 364, in get_version
    if re.sub(r'[^0-9\.]', '', line.decode('utf-8'))[0].isdigit():
IndexError: string index out of range

[enrico@caltech-benchmark-enrico-centos hepscore]$ cat /wntmp/benchmarks/HEPSCORE-HT-ON/1663250131/lhcb.out 
Traceback (most recent call last):
  File "/root/.local/bin/hepscore", line 10, in <module>
    sys.exit(main())
  File "/root/.local/lib/python3.9/site-packages/hepscore/main.py", line 162, in main
    if hep_score.run(args['replay']) >= 0:
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 771, in run
    ver = self.get_version()
  File "/root/.local/lib/python3.9/site-packages/hepscore/hepscore.py", line 364, in get_version
    if re.sub(r'[^0-9\.]', '', line.decode('utf-8'))[0].isdigit():
IndexError: string index out of range
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment