Skip to content

Instantly share code, notes, and snippets.

@lgray

lgray/test_laurelin_nano1.log

Created September 26, 2019 13:54
Show Gist options
  • Save lgray/1c9506591517ccad08e6f882da90ff9d to your computer and use it in GitHub Desktop.
Save lgray/1c9506591517ccad08e6f882da90ff9d to your computer and use it in GitHub Desktop.
Download ZIP
log from fermicloud318 on /eos/uscms/store/group/lpccoffea/coffeabeans/102X/nano_2018/QCD_HT2000toInf_TuneCP5_13TeV-madgraphMLM-pythia8/NanoTuples-2018_RunIIAutumn18MiniAOD-102X_v15-v1/190321_064928/0000/nano_1.root
Raw
test_laurelin_nano1.log
(py36) [lagray@fermicloud318 laurelin]$ python ../test_laurelin.py
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/spark-2.4.3-bin-hadoop2.7/jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.2/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Ivy Default Cache set to: /home/lagray/.ivy2/cache
The jars for the packages stored in: /home/lagray/.ivy2/jars
:: loading settings :: url = jar:file:/opt/spark-2.4.3-bin-hadoop2.7/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
edu.vanderbilt.accre#laurelin added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent-298d141d-7e08-4799-abd3-73389ddba564;1.0
confs: [default]
found edu.vanderbilt.accre#laurelin;0.3.1-SNAPSHOT in local-m2-cache
found com.google.guava#guava;28.0-jre in central
found com.google.guava#failureaccess;1.0.1 in central
found com.google.guava#listenablefuture;9999.0-empty-to-avoid-conflict-with-guava in central
found com.google.code.findbugs#jsr305;3.0.2 in local-m2-cache
found org.checkerframework#checker-qual;2.8.1 in central
found com.google.errorprone#error_prone_annotations;2.3.2 in central
found com.google.j2objc#j2objc-annotations;1.3 in central
found org.codehaus.mojo#animal-sniffer-annotations;1.17 in central
found org.tukaani#xz;1.2 in central
found org.lz4#lz4-java;1.5.1 in central
found org.apache.logging.log4j#log4j-api;2.11.2 in central
found org.apache.logging.log4j#log4j-core;2.11.2 in central
:: resolution report :: resolve 1022ms :: artifacts dl 52ms
:: modules in use:
com.google.code.findbugs#jsr305;3.0.2 from local-m2-cache in [default]
com.google.errorprone#error_prone_annotations;2.3.2 from central in [default]
com.google.guava#failureaccess;1.0.1 from central in [default]
com.google.guava#guava;28.0-jre from central in [default]
com.google.guava#listenablefuture;9999.0-empty-to-avoid-conflict-with-guava from central in [default]
com.google.j2objc#j2objc-annotations;1.3 from central in [default]
edu.vanderbilt.accre#laurelin;0.3.1-SNAPSHOT from local-m2-cache in [default]
org.apache.logging.log4j#log4j-api;2.11.2 from central in [default]
org.apache.logging.log4j#log4j-core;2.11.2 from central in [default]
org.checkerframework#checker-qual;2.8.1 from central in [default]
org.codehaus.mojo#animal-sniffer-annotations;1.17 from central in [default]
org.lz4#lz4-java;1.5.1 from central in [default]
org.tukaani#xz;1.2 from central in [default]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 13 | 0 | 0 | 0 || 13 | 0 |
---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent-298d141d-7e08-4799-abd3-73389ddba564
confs: [default]
0 artifacts copied, 13 already retrieved (0kB/10ms)
19/09/26 08:52:31 WARN spark.SparkConf: The configuration key 'spark.executor.port' has been deprecated as of Spark 2.0.0 and may be removed in the future. Not used anymore
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
19/09/26 08:52:32 WARN spark.SparkConf: The configuration key 'spark.executor.port' has been deprecated as of Spark 2.0.0 and may be removed in the future. Not used anymore
19/09/26 08:52:32 WARN spark.SparkConf: The configuration key 'spark.executor.port' has been deprecated as of Spark 2.0.0 and may be removed in the future. Not used anymore
19/09/26 08:52:33 WARN util.Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
ERROR StatusLogger No Log4j 2 configuration file found. Using default configuration (logging only errors to the console), or user programmatically provided configurations. Set system property 'log4j2.debug' to show Log4j 2 internal initialization logging. See https://logging.apache.org/log4j/2.x/manual/configuration.html for instructions on how to configure Log4j 2
loading took 3.798249 seconds!
select took 0.435410 seconds!
1
getNumPartitions took 3.442525 seconds!
19/09/26 08:52:43 WARN util.Utils: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.debug.maxToStringFields' in SparkEnv.conf.
49867
count() took 0.973670 seconds!
+-----+--------------------+--------------------+--------------------+--------------------+--------------------+-------------------------------------+-------+
|nMuon| Muon_pt| Muon_eta| Muon_phi| Muon_mass| Jet_pt|HLT_Ele16_Ele12_Ele8_CaloIdL_TrackIdL|dataset|
+-----+--------------------+--------------------+--------------------+--------------------+--------------------+-------------------------------------+-------+
| 0| []| []| []| []|[1330.0, 534.0, 4...| false| test|
| 2|[13.294561, 10.38...|[1.0700684, 1.274...|[-0.66918945, -0....|[0.10571289, 0.10...|[568.5, 495.75, 4...| false| test|
| 2|[6.7554817, 3.061...|[0.28881836, -1.6...|[-0.57141113, 1.7...|[0.10571289, 0.10...|[1043.0, 672.0, 3...| false| test|
| 0| []| []| []| []|[1010.0, 917.5, 2...| false| test|
| 1| [3.1629183]| [2.2578125]| [-0.11279297]| [0.10571289]|[997.5, 895.5, 50...| false| test|
| 0| []| []| []| []|[920.5, 824.0, 56...| false| test|
| 0| []| []| []| []|[1085.0, 841.5, 2...| false| test|
| 0| []| []| []| []|[869.0, 661.0, 36...| false| test|
| 0| []| []| []| []|[1110.0, 1032.0, ...| false| test|
| 1| [28.789988]| [-1.1604004]| [0.9675293]| [0.10571289]|[1387.0, 627.5, 6...| false| test|
| 0| []| []| []| []|[1261.0, 1086.0, ...| false| test|
| 1| [6.509205]| [1.3823242]| [-2.7514648]| [0.10571289]|[1127.0, 1071.0, ...| false| test|
| 0| []| []| []| []|[860.5, 434.5, 31...| false| test|
| 0| []| []| []| []|[961.5, 752.5, 53...| false| test|
| 0| []| []| []| []|[980.5, 974.0, 20...| false| test|
| 1| [48.93754]| [0.6097412]| [-0.6939697]| [0.10571289]|[923.0, 723.5, 19...| false| test|
| 0| []| []| []| []|[1098.0, 1014.5, ...| false| test|
| 0| []| []| []| []|[1292.0, 1055.0, ...| false| test|
| 1| [5.9114594]| [0.8215332]| [1.1867676]| [0.10571289]|[1017.0, 651.5, 2...| false| test|
| 1| [5.5051847]| [0.52111816]| [-0.9519043]| [0.10571289]|[1083.0, 715.0, 4...| false| test|
+-----+--------------------+--------------------+--------------------+--------------------+--------------------+-------------------------------------+-------+
only showing top 20 rows
/home/lagray/py36/lib64/python3.6/site-packages/pyarrow/__init__.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream
warnings.warn("pyarrow.open_stream is deprecated, please use "
nMuon True
HLT True
True
True
counts True
offsets True
from uproot: [1330. 534. 466.25 ... 16.359375 16.125
16.0625 ]
from spark: [1330. 534. 466.25 ... 16.359375 16.125
16.0625 ]
muons 0
jets 0
Muon_pt[25001] in uproot [6.184775]
Muon_pt[25001] in spark [6.184775]
Muon_pt[4] in uproot [3.1629183]
Muon_pt[4] in spark [3.1629183]
5.5845685 in uproot [46829]
5.5845685 in spark [46829]
4.508958 in uproot [49861]
4.508958 in spark [49861]
(py36) [lagray@fermicloud318 laurelin]$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment