Skip to content

Instantly share code, notes, and snippets.

View pdeperio's full-sized avatar

Patrick de Perio pdeperio

  • Kavli IPMU
  • Japan
View GitHub Profile
@pdeperio
pdeperio / 160501_1733_18792607.log
Created May 1, 2016 19:01
pax jobs still crashing on midway (AttributeError: 'float' object has no attribute 'typecode')
discarding /project/lgrandi/anaconda3/envs/pax_head/bin from PATH
prepending /project/lgrandi/anaconda3/envs/pax_head/bin to PATH
Activate: ROOT has been sourced. Environment settings are ready.
ROOTSYS=/project/lgrandi/anaconda3/envs/pax_head
python /project/lgrandi/deployHQ/cax/cax/tasks/process.py 160501_1733 /project/lgrandi/xenon1t/160501_1733 midway-login1
processor MainProcess L89 INFO This is PAX version 4.9.1, running with configuration for XENON1T.
ReadZipped MainProcess L101 INFO InputFromFolder: Selecting file /project/lgrandi/xenon1t/160501_1733/XENON1T-0-000000000-000000999-000001000.zip (number 1/17 in fo
lder) for reading
#error "You need a ISO C conforming compiler to use the glibc headers"
*** Interpreter error recovered ***
@pdeperio
pdeperio / 160501_1343_18791929.log
Last active May 1, 2016 15:44
Another strange ending for multicore on Midway
nprocs = 4
discarding /project/lgrandi/anaconda3/envs/pax_head/bin from PATH
prepending /project/lgrandi/anaconda3/envs/pax_head/bin to PATH
Activate: ROOT has been sourced. Environment settings are ready.
ROOTSYS=/project/lgrandi/anaconda3/envs/pax_head
python /project/lgrandi/deployHQ/cax/cax/tasks/process.py 160501_1343 /project/lgrandi/xenon1t/160501_1343 midway-login1
processor MainProcess L89 INFO This is PAX version 4.9.1, running with configuration for XENON1T.
processing 160501_1343 /project/lgrandi/xenon1t/160501_1343
ReadZipped MainProcess L101 INFO InputFromFolder: Selecting file /project/lgrandi/xenon1t/160501_1343/XENON1T-0-000000000-000000999-000001000.zip (number 1/45 in folder) for reading
@pdeperio
pdeperio / 160501_1331_18791928.log
Created May 1, 2016 15:30
Crash on Midway with 4 cores (submitted from process.py)
nprocs = 4
discarding /project/lgrandi/anaconda3/envs/pax_head/bin from PATH
prepending /project/lgrandi/anaconda3/envs/pax_head/bin to PATH
Activate: ROOT has been sourced. Environment settings are ready.
ROOTSYS=/project/lgrandi/anaconda3/envs/pax_head
python /project/lgrandi/deployHQ/cax/cax/tasks/process.py 160501_1331 /project/lgrandi/xenon1t/160501_1331 midway-login1
processor MainProcess L89 INFO This is PAX version 4.9.1, running with configuration for XENON1T.
processing 160501_1331 /project/lgrandi/xenon1t/160501_1331
ReadZipped MainProcess L101 INFO InputFromFolder: Selecting file /project/lgrandi/xenon1t/160501_1331/XENON1T-0-000000000-000000999-000001000.zip (number 1/180 in folder) for reading
@pdeperio
pdeperio / process_mistake.py
Created April 30, 2016 21:13
How to Screw up DB
import sys
import datetime
import hashlib
import subprocess
from cax import qsub, config
from cax.task import Task
# Obtain pax repository hash
def get_pax_hash(pax_version):
@pdeperio
pdeperio / cax.json
Created April 28, 2016 19:38
cax.json for Midway->ci-connect transfer
[
{
"name": "eb0",
"hostname": "eb0",
"receive": null,
"directory": "/data/xenon1t_data/",
"upload_options": [],
"download_options": []
},
{
@pdeperio
pdeperio / cax_crash2
Created April 26, 2016 21:33
More cax crashes
root : INFO put: /project/lgrandi/xenon1t/160414_1156 to /xenon/xenon1t_test/160414_1156
paramiko.transport: DEBUG [chan 0] Max packet in: 32768 bytes
paramiko.transport: DEBUG [chan 0] Max packet out: 32768 bytes
paramiko.transport: DEBUG Secsh channel 0 opened.
paramiko.transport: DEBUG [chan 0] Sesch channel 0 request ok
paramiko.transport: DEBUG Rekeying (hit 32668 packets, 536872688 bytes sent)
paramiko.transport: DEBUG kex algos:['diffie-hellman-group-exchange-sha256', 'diffie-hellman-group-exchange-sha1', 'diffie-hellman-group14-sha1', 'diffie-hellman-group1-sha1'] server key:['ssh-rsa', 'ssh-dss'] client encrypt:['aes128-ctr', 'aes192-ctr', 'aes256-ctr', 'arcfour256', 'arcfour128', 'aes128-cbc', '3des-cbc', 'blowfish-cbc', 'cast128-cbc', 'aes192-cbc', 'aes256-cbc', 'arcfour', 'rijndael-cbc@lysator.liu.se'] server encrypt:['aes128-ctr', 'aes192-ctr', 'aes256-ctr', 'arcfour256', 'arcfour128', 'aes128-cbc', '3des-cbc', 'blowfish-cbc', 'cast128-cbc', 'aes192-cbc', 'aes256-cbc'
@pdeperio
pdeperio / cax_crash1
Created April 26, 2016 21:01
cax crash
root : INFO put: /project/lgrandi/xenon1t/160331_1207 to /xenon/xenon1t_test/160331_1207
paramiko.transport: DEBUG [chan 0] Max packet in: 32768 bytes
paramiko.transport: DEBUG [chan 0] Max packet out: 32768 bytes
paramiko.transport: DEBUG Secsh channel 0 opened.
paramiko.transport: DEBUG [chan 0] Sesch channel 0 request ok
paramiko.transport: DEBUG [chan 0] EOF sent (0)
paramiko.transport: DEBUG EOF in transport thread
SCPPush : DEBUG SCP done, telling run database
SCPPush : INFO Transfer complete
root : DEBUG loading /home/pdeperio/160426-cax_tests/cax/lib/python3.4/site-packages/cax-0.1.0-py3.4.egg/cax/cax.json
@pdeperio
pdeperio / gfalcopy_mid_stash.err
Created April 26, 2016 20:50
gfal-copy midway->stash error
$ gfal-copy -vvv -r -p srm://srm1.rcc.uchicago.edu:8443/srm/v2/server?SFN=/project/lgrandi/xenon1t/160315_1438 srm://ceph-se.osgconnect.net:8443/srm/v2/server?SFN=/cephfs/srm/xenon/xenon1t/160315_1438
DEBUG GFAL_CONFIG_DIR env var found, try to load configuration from /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.11/el6-x86_64/etc/gfal2.d
DEBUG try to load configuration file /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.11/el6-x86_64/etc/gfal2.d/bdii.conf ...
DEBUG try to load configuration file /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.11/el6-x86_64/etc/gfal2.d/srm_plugin.conf ...
DEBUG try to load configuration file /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.11/el6-x86_64/etc/gfal2.d/gsiftp_plugin.conf ...
DEBUG try to load configuration file /cvmfs/oasis.opensciencegrid.org/mis/osg-wn-client/3.3/3.3.11/el6-x86_64/etc/gfal2.d/xrootd_plugin.conf ...
DEBUG try to load configuration file /cvmfs/oasis.opensciencegrid.org/mis/osg-
@pdeperio
pdeperio / cax.log1
Created April 26, 2016 19:38
cax error 1
SCPPull : DEBUG Notifying run database
Traceback (most recent call last):
File "/stash2/project/@xenon1t/anaconda3/envs/pax_head/bin/cax-single", line 9, in <module>
load_entry_point('cax==0.1.0', 'console_scripts', 'cax-single')()
File "/stash2/project/@xenon1t/anaconda3/envs/pax_head/lib/python3.4/site-packages/cax-0.1.0-py3.4.egg/cax/main.py", line 8, in single
main(run_once = True)
File "/stash2/project/@xenon1t/anaconda3/envs/pax_head/lib/python3.4/site-packages/cax-0.1.0-py3.4.egg/cax/main.py", line 44, in main
task.go()
File "/stash2/project/@xenon1t/anaconda3/envs/pax_head/lib/python3.4/site-packages/cax-0.1.0-py3.4.egg/cax/task.py", line 24, in go
self.each_run()
(pax)hattorikun:PaxROOTExample pdeperio$ root -b
dyld: Symbol not found: _CGLGetCurrentContext
Referenced from: /System/Library/Frameworks/CoreVideo.framework/Versions/A/CoreVideo
Expected in: /System/Library/Frameworks/OpenGL.framework/Versions/A/OpenGL
in /System/Library/Frameworks/CoreVideo.framework/Versions/A/CoreVideo