This is a recipe for connecting to the CMS DiracX test deployment at:
https://cms-diracx-test18.cern.ch/
and using the DiracX CLI to authenticate and submit a simple job.
Marco Mascheroni mmascher
mmascher
/ diracx-cms-test18-cli-quickstart.md
Last active
August 17, 2026 14:06
DiracX CLI quickstart for the CMS test deployment: Kubernetes access, self-signed CA setup, authentication, and submitting a test job.
mmascher
/ KIT Pilots efficiency 11th to 18th of March
Created
March 18, 2024 11:51
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [mmascher@vocms0209 tools]$ ./efficiency.py /data/glideinmonitor/rsync/*/user_fecmsglobal/glidein_gfactory_instance/entry_CMSHTPC_T1_DE_KIT_htcondor-ce-{1..3}-kit/condor_activity_2024031{1..8}_CMSG-v1_0.main.log --aggregate | |
| Total walltime: 2127 days and 10 hours with 69.67% termination rate (#jobs) | |
| Total efficiency 86.80% | |
| [mmascher@vocms0209 tools]$ ./efficiency.py /data/glideinmonitor/rsync/*/user_fecmsglobal/glidein_gfactory_instance/entry_CMSHTPC_T1_DE_KIT_htcondor-ce-4-kit/condor_activity_2024031{1..8}_CMSG-v1_0.main.log --aggregate | |
| Total walltime: 531 days and 9 hours with 72.26% termination rate (#jobs) | |
| Total efficiency 78.80% | |
| [mmascher@vocms0209 tools]$ ./efficiency.py /data/glideinmonitor/rsync/*/user_fecmsglobal/glidein_gfactory_instance/entry_CMSHTPC_T1_DE_KIT_htcondor-ce-{1..3}-kit/condor_activity_2024031{1..8}_CMSG-v1_0.main.log | |
| Job 9959835.000.000 lasted 171329.0. Efficiency is 90.45% | |
| Job 9959835.001.000 lasted 197303.0. Efficiency is 74.12% | |
| Job 9959835.002.000 lasted 194075.0. Efficiency is 83.2 |
mmascher
/ PROD_profiling.txt
Created
February 17, 2022 10:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [0124] gfactory@gfactory-2 ~/mmascher/debug$ time sh tmp.sh | |
| 7351425 function calls (7334571 primitive calls) in 9.321 seconds | |
| Ordered by: standard name | |
| ncalls tottime percall cumtime percall filename:lineno(function) | |
| 1 0.000 0.000 9.321 9.321 <string>:1(<module>) | |
| 113 0.000 0.000 0.001 0.000 BIO.py:137(__init__) | |
| 112 0.000 0.000 0.001 0.000 BIO.py:147(read) | |
| 1 0.000 0.000 0.000 0.000 BIO.py:174(__init__) |
mmascher
/ ITB_profiling.txt
Last active
February 17, 2022 10:01
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [0122] gfactory@gfactory-itb-1 ~/mmascher/debug$ time sh tmp.sh | |
| WARNING: GSI authentication is enabled by your security configuration! GSI will not work in future releases. | |
| For details, see https://htcondor-wiki.cs.wisc.edu/index.cgi/wiki?p=PlanToReplaceGridCommunityToolkit | |
| 8466040 function calls (8453224 primitive calls) in 29.465 seconds | |
| Ordered by: standard name | |
| ncalls tottime percall cumtime percall filename:lineno(function) | |
| 1 0.000 0.000 0.000 0.000 <frozen importlib._bootstrap>:103(release) | |
| 1 0.000 0.000 0.000 0.000 <frozen importlib._bootstrap>:143(__init__) |
mmascher
/ shutdowntime_job
Created
March 9, 2016 12:48
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 200 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "private" : { | |
| "delegate-dn": ["/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=erupeika/CN=775659/CN=Emilis Antanas Rupeika|/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=mmascher/CN=720897/CN=Marco Mascheroni|/DC=ch/DC=cern/OU=computers/CN=mmascher-poc.cern.ch|/DC=ch/DC=cern/OU=computers/CN=devaso1.cern.ch|/DC=ch/DC=cern/OU=computers/CN=hammer-crab3.cern.ch|/DC=ch/DC=cern/OU=computers/CN=mmascher-dev6.cern.ch|/DC=ch/DC=cern/OU=computers/CN=hammer-crab3.cern.ch|/DC=ch/DC=cern/OU=computers/CN=mmascher-mon.cern.ch"], | |
| "backend-urls" : { | |
| "cacheSSL" : "https://mmascher-mon.cern.ch/crabcache", | |
| "baseURL" : "https://mmascher-mon.ch/crabcache", | |
| "htcondorSchedds" : {"crab3-5@vocms059.cern.ch" : {"proxiedurl" : "https://mmascher-dev6.cern.ch/scheddmon/059"}}, | |
| "htcondorPool" : "cmssrv221.fnal.gov,vocms099.cern.ch", | |
| "ASOURL" : "https://cmsweb.cern.ch/couchdb" | |
| }, |
mmascher
/ crab3-gwms
Last active
December 26, 2015 03:19
Crab3 GlideInWMS external configuration file
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "cmsweb-dev" : { | |
| "delegate-dn": [ "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=mmascher/CN=720897/CN=Marco Mascheroni|/DC=ch/DC=cern/OU=computers/CN=hammer-crab3.cern.ch|/DC=ch/DC=cern/OU=computers/CN=c3p1.cern.ch" ], | |
| "transformation": { | |
| "Analysis" : "http://common-analysis-framework.cern.ch/CMSRunAnaly.sh", | |
| "PrivateMC" : "http://common-analysis-framework.cern.ch/CMSRunMCProd.sh" | |
| }, | |
| "backend-urls" : { | |
| "cacheSSL" : "https://cmsweb.cern.ch/crabcache/file", | |
| "baseURL" : "https://cmsweb.cern.ch/crabcache/file", |
mmascher
/ gist:6022126
Last active
August 29, 2017 14:51
— forked from spigad/gist:5886118
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "private" : { | |
| "delegate-dn": ["/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=mmascher/CN=720897/CN=Marco Mascheroni|/DC=ch/DC=cern/OU=computers/CN=mmascher-poc.cern.ch|/DC=ch/DC=cern/OU=computers/CN=devaso1.cern.ch|/DC=ch/DC=cern/OU=computers/CN=hammer-crab3.cern.ch|/DC=ch/DC=cern/OU=computers/CN=mmascher-dev6.cern.ch|/DC=ch/DC=cern/OU=computers/CN=hammer-crab3.cern.ch|/DC=ch/DC=cern/OU=computers/CN=mmascher-mon.cern.ch|/DC=ch/DC=cern/OU=computers/CN=hammer-crab3.cern.ch|/DC=ch/DC=cern/OU=computers/CN=mmascher-gwms.cern.ch|/DC=ch/DC=cern/OU=computers/CN=asotest.cern.ch|/DC=ch/DC=cern/OU=computers/CN=vocms0105.cern.ch"], | |
| "backend-urls" : { | |
| "cacheSSL" : "https://cmsweb.cern.ch/crabcache", | |
| "htcondorSchedds" : { | |
| "crab3-5@vocms059.cern.ch" : {"proxiedurl" : "https://cmsweb.cern.ch/scheddmon/059", "weightfactor" : 2}, | |
| "crab3-5@vocms05.cern.ch" : {"proxiedurl" : "https://cmsweb.cern.ch/scheddmon/059", "weightfactor" : 0.1 |
mmascher
/ FAQ-CRABSERVER
Last active
December 19, 2015 15:08
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| *** | |
| CLIENT: | |
| Error contacting the server. | |
| Server answered with: No such instance | |
| SERVER: | |
| [11/Jul/2013:10:07:03] SERVER REST ERROR WMCore.REST.Error.NoSuchInstance 30cacdcf7522dbb72b1310e875070251 (No such instance) | |
| [11/Jul/2013:10:07:03] Traceback (most recent call last): | |
| [11/Jul/2013:10:07:03] File "/data/hg1307b/sw.pre.spiga/slc5_amd64_gcc461/cms/crabserver/3.2.0pre15/lib/python2.6/site-packages/WMCore/REST/Server.py", line 693, in default |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "delegate-dn": [ | |
| "/DC=ch/DC=cern/OU=computers/CN=dashb-ai-402.cern.ch", | |
| "/DC=ch/DC=cern/OU=computers/CN=devaso1.cern.ch" | |
| ] | |
| } |
NewerOlder