Created
April 26, 2012 22:40
-
-
Save neggert/2503811 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cms-sh|5> info run=160915 | |
| --------------------------------------------------------------------------- | |
| HTTPError Traceback (most recent call last) | |
| /afs/cern.ch/user/n/neggert/<ipython-input-5-c10902d46b4c> in <module>() | |
| ----> 1 get_ipython().magic(u'info run=160915') | |
| /afs/cern.ch/work/v/valya/public/soft/install/lib/python2.6/site-packages/IPython/core/interactiveshell.pyc in magic(self, arg_s, next_input) | |
| 1983 self._magic_locals = sys._getframe(1).f_locals | |
| 1984 with self.builtin_trap: | |
| -> 1985 result = fn(magic_args) | |
| 1986 # Ensure we're not keeping object references around: | |
| 1987 self._magic_locals = {} | |
| /afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cms_cmds.pyc in cms_info(arg) | |
| 579 cmssh# info run=160915 | |
| 580 """ | |
| --> 581 cms_ls(arg) | |
| 582 | |
| 583 def cms_cp(arg): | |
| /afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cms_cmds.pyc in cms_ls(arg) | |
| 564 elif pat_run.match(arg): | |
| 565 arg = arg.replace('run=', '') | |
| --> 566 res = run_info(arg, verbose) | |
| 567 else: | |
| 568 raise Exception('Unsupported input') | |
| /afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cmsfs.pyc in run_info(run, verbose) | |
| 396 params = {'Runs':run, 'lumiType':'delivered'} | |
| 397 data = get_data(url, method, params) | |
| --> 398 runinfo = [r for r in runsum(run)] | |
| 399 runlumi = [r for r in data] | |
| 400 plist = [] | |
| /afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/runsum.pyc in runsum(run, debug) | |
| 39 url = run_summary_url(url, params) | |
| 40 key, cert = get_key_cert() | |
| ---> 41 data = get_data(url, key, cert, debug) | |
| 42 for row in xml_parser(data, 'runInfo'): | |
| 43 yield row['runInfo'] | |
| /afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/auth_utils.pyc in get_data(url, key, cert, debug) | |
| 81 params = urllib.urlencode(params, doseq=True) | |
| 82 url = 'https://login.cern.ch/adfs/ls/auth/sslclient/' | |
| ---> 83 fdesc = opener.open(url+'?'+params) | |
| 84 data = fdesc.read() | |
| 85 fdesc.close() | |
| /afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in open(self, fullurl, data, timeout) | |
| 393 for processor in self.process_response.get(protocol, []): | |
| 394 meth = getattr(processor, meth_name) | |
| --> 395 response = meth(req, response) | |
| 396 | |
| 397 return response | |
| /afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in http_response(self, request, response) | |
| 506 if not (200 <= code < 300): | |
| 507 response = self.parent.error( | |
| --> 508 'http', request, response, code, msg, hdrs) | |
| 509 | |
| 510 return response | |
| /afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in error(self, proto, *args) | |
| 431 if http_err: | |
| 432 args = (dict, 'default', 'http_error_default') + orig_args | |
| --> 433 return self._call_chain(*args) | |
| 434 | |
| 435 # XXX probably also want an abstract factory that knows when it makes | |
| /afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in _call_chain(self, chain, kind, meth_name, *args) | |
| 365 func = getattr(handler, meth_name) | |
| 366 | |
| --> 367 result = func(*args) | |
| 368 if result is not None: | |
| 369 return result | |
| /afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in http_error_default(self, req, fp, code, msg, hdrs) | |
| 514 class HTTPDefaultErrorHandler(BaseHandler): | |
| 515 def http_error_default(self, req, fp, code, msg, hdrs): | |
| --> 516 raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) | |
| 517 | |
| 518 class HTTPRedirectHandler(BaseHandler): | |
| HTTPError: HTTP Error 403: Forbidden | |
| cms-sh|6> cp /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root . | |
| Unable to identify total size of the file, GRID middleware fails. | |
| Fallback to xrdcp method | |
| Traceback (most recent call last): | |
| File "/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cms_cmds.py", line 618, in cms_cp | |
| status = copy_lfn(src, dst, verbose, background) | |
| File "/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/filemover.py", line 657, in copy_lfn | |
| FM_SINGLETON.copy_via_xrdcp(lfn, dst, verbose) | |
| File "/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/filemover.py", line 487, in copy_via_xrdcp | |
| stdout, stderr = execmd(cmd) | |
| File "/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/utils.py", line 103, in execmd | |
| stdout = child_stdout.read() | |
| KeyboardInterrupt | |
| Wrong argument '/store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root .' |
Same problem on lxplus.
…On Fri, Apr 27, 2012 at 2:16 PM, Valentin Kuznetsov ***@***.*** wrote:
Nic, could you please try one more time. I created new account for myself on my VM and was able to run info and cp commands form it. But I still need to try it out from someone else account with his own grid certificate.
---
Reply to this email directly or view it on GitHub:
https://gist.github.com/2503811
Nic, could you please try one more time. I understood the problem and now hopefully have a fix for it. You may be asked once for your GRID/userkey.pem passphrase at the start-up of cmssh. It is the located at same location:
/afs/cern.ch/user/v/valya/workspace/public/soft/bin/cmssh
and I want you to try out the following commands:
info run=160915
ls /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root
cp /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root .
The LFN is only 5MB.
Thanks.
Now the ls command works, but the others don't. https://gist.github.com/2575681.
…On Tue, May 1, 2012 at 5:50 PM, Valentin Kuznetsov ***@***.*** wrote:
Nic, could you please try one more time. I understood the problem and now hopefully have a fix for it. You may be asked once for your GRID/userkey.pem passphrase at the start-up of cmssh. It is the located at same location:
/afs/cern.ch/user/v/valya/workspace/public/soft/bin/cmssh
and I want you to try out the following commands:
info run=160915
ls /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root
cp /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root .
The LFN is only 5MB.
Thanks.
---
Reply to this email directly or view it on GitHub:
https://gist.github.com/2503811
Nic,
could you please try again. I was fighting with GRID certificates handling. Let me know how it will go now.
Thanks,
Valentin.
…On May 2, 2012, at ,May 2, 6:08 AM, Nic Eggert wrote:
Now the ls command works, but the others don't. https://gist.github.com/2575681.
On Tue, May 1, 2012 at 5:50 PM, Valentin Kuznetsov
***@***.***
wrote:
> Nic, could you please try one more time. I understood the problem and now hopefully have a fix for it. You may be asked once for your GRID/userkey.pem passphrase at the start-up of cmssh. It is the located at same location:
> /afs/cern.ch/user/v/valya/workspace/public/soft/bin/cmssh
>
> and I want you to try out the following commands:
> info run=160915
> ls /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root
> cp /store/data/CRUZET3/Cosmics/RAW/v1/000/050/832/186585EC-024D-DD11-B747-000423D94AA8.root .
>
> The LFN is only 5MB.
> Thanks.
> ---
>
> Reply to this email directly or view it on GitHub:
> https://gist.github.com/2503811
---
Reply to this email directly or view it on GitHub:
https://gist.github.com/2503811
Alright, now the copy works, but info run=160915 still gives the same error.
Nic,
I've added the code to debug the problem. Could you please do the following, run /afs/cern.ch/user/v/valya/workspace/public/soft/bin/cmssh
- debug_http 1
- info run=160915
and cut and paste output to me.
Thanks,
Valentin.
…On May 4, 2012, at ,May 4, 4:18 AM, Nic Eggert wrote:
Alright, now the copy works, but `info run=160915` still gives the same error.
---
Reply to this email directly or view it on GitHub:
https://gist.github.com/2503811
Here's the output:
cms-sh|2> info run=160915
send: u'GET /cmswbm/cmsdb/servlet/RunSummary?RUN=160915&DB=cms_omds_lb&FORMAT=XML HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: cmswbm.web.cern.ch\r\nConnection: close\r\nUser-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11\r\n\r\n'
reply: 'HTTP/1.1 302 Found\r\n'
header: Date: Sat, 05 May 2012 19:24:56 GMT
header: Server: Apache
header: Set-Cookie: _shibstate_d0dbd8a6=https%3A%2F%2Fcmswbm.web.cern.ch%2Fcmswbm%2Fcmsdb%2Fservlet%2FRunSummary%3FRUN%3D160915%26DB%3Dcms_omds_lb%26FORMAT%3DXML; path=/
header: Expires: Wed, 01 Jan 1997 12:00:00 GMT
header: Cache-Control: private,no-store,no-cache,max-age=0
header: Location: https://login.cern.ch/adfs/ls/?wa=wsignin1.0&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wctx=cookie%3Ad0dbd8a6
header: Content-Length: 425
header: Connection: close
header: Content-Type: text/html; charset=iso-8859-1
send: 'GET /adfs/ls/?wa=wsignin1.0&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wctx=cookie%3Ad0dbd8a6 HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: login.cern.ch\r\nConnection: close\r\nUser-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Cache-Control: no-cache
header: Pragma: no-cache
header: Content-Type: text/html; charset=utf-8
header: Expires: -1
header: Server: Microsoft-IIS/7.5
header: X-AspNet-Version: 2.0.50727
header: X-Powered-By: ASP.NET
header: Date: Sat, 05 May 2012 19:24:55 GMT
header: Connection: close
header: Content-Length: 13047
INFO: Response info
Cache-Control: no-cache
Pragma: no-cache
Content-Type: text/html; charset=utf-8
Expires: -1
Server: Microsoft-IIS/7.5
X-AspNet-Version: 2.0.50727
X-Powered-By: ASP.NET
Date: Sat, 05 May 2012 19:24:55 GMT
Connection: close
Content-Length: 13047
INFO: CERN Login output
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" dir="ltr">
<head><meta http-equiv="Content-Language" content="en" /><meta name="viewport" content="width=device-width, initial-scale = 1, user-scalable = yes" /><title>
CERN Authentication v2
</title><meta name="robots" content="noindex, nofollow" /><link href="/adfs/ls/favicon.ico" rel="ICON" type="image/x-icon" /><link href="/adfs/ls/favicon.ico" rel="SHORTCUT ICON" type="image/x-icon" /><link href="https://framework.web.cern.ch/framework/1.0/css/global_banner.css" rel="stylesheet" type="text/css" media="screen" /><link href="https://framework.web.cern.ch/framework/1.0/css/cern_logo.css" rel="stylesheet" type="text/css" media="screen" /><link href="https://framework.web.cern.ch/framework/1.0/css/content.css" rel="stylesheet" type="text/css" media="screen" /><link href="https://framework.web.cern.ch/framework/1.0/css/clear-block.css" rel="stylesheet" type="text/css" media="screen" />
<style type="text/css">
body {text-align: center;}
a {color: #3861aa;}
.smaller {font-size: 0.85em;}
h2 {font-size: 1.8em; margin-bottom: 2em; letter-spacing: 0;}
#container {text-align: left; margin: 0 auto; padding-top: 3em; max-width: 480px;}
.cern_credentials {background: #f0f3f8; padding: 1em; border: 1px solid #c3c5c9; margin-bottom: 3em;}
.cern_credentials .message {font-style: italic; margin-bottom: 2em; text-align: right;}
.cern_credentials .error {color: #c80e43; font-weight: bold;}
.cern_credentials label {display: block; text-align: right; width: 68%; float: left; margin: 0; font-weight: bold; font-size: 0.9em;}
.cern_credentials input {display: block; float: right; width: 28%; margin: 0;}
.cern_credentials .row {margin-bottom: 1em;}
.cern_credentials button {float: right;}
.centre {text-align: center;}
ul.go li a {display: inline;}
#security_msg {font-size: 0.9em; margin-top: 4em; border: 1px solid #c80e43; padding: 1em; -moz-border-radius: 5px; -webkit-border-radius: 5px; border-radius: 5px 5px 5px 5px;}
#security_msg .date {color: #999; white-space: nowrap; font-size: 0.7em;}
.subtle {color: #999;}
/* FOOTER */
#footer {height: 80px; margin-top: 20px; padding-top: 20px; position: relative;}
#footer p {position: absolute; bottom: 0; left: 0; font-size: 0.9em; line-height: 1; margin-bottom: 0; color: #999;}
#footer a#cern_logo {position: absolute; bottom: 0; right: 0;}
@media all and (max-width:480px) {
body {padding: 0 3%;}
body.fluid #container {width: 100%; padding: 0;}
#footer {height: auto; text-align: left;}
#footer p {position: relative; bottom: auto; left: auto; font-size: 0.9em; color: #999; margin-bottom: 1em; color: #000; line-height: 1.3;}
#footer a#cern_logo {position: relative; bottom: auto; right: auto;}
.column1, .column2 {float: none; width: 100%; margin-right: 0;}
}
</style>
<link href="App_Themes/CERNGC/05custom.css" type="text/css" rel="stylesheet" /><meta name="robots" content="noindex, nofollow, noarchive" /></head>
<body>
<form name="aspnetForm" method="post" action="/adfs/ls/?wa=wsignin1.0&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wctx=cookie%3Ad0dbd8a6" onsubmit="javascript:return WebForm_OnSubmit();" id="aspnetForm">
<div>
<input type="hidden" name="__LASTFOCUS" id="__LASTFOCUS" value="" />
<input type="hidden" name="__EVENTTARGET" id="__EVENTTARGET" value="" />
<input type="hidden" name="__EVENTARGUMENT" id="__EVENTARGUMENT" value="" />
<input type="hidden" name="__VIEWSTATE" id="__VIEWSTATE" value="/wEPDwUKLTczMDE3MDIxNmQYAQUeX19Db250cm9sc1JlcXVpcmVQb3N0QmFja0tleV9fFgEFKmN0bDAwJENvbnRlbnRQbGFjZUhvbGRlcjEkY2hrUmVtZW1iZXJMb2dpbg==" />
</div>
<script type="text/javascript">
//<![CDATA[
var theForm = document.forms['aspnetForm'];
if (!theForm) {
theForm = document.aspnetForm;
}
function __doPostBack(eventTarget, eventArgument) {
if (!theForm.onsubmit || (theForm.onsubmit() != false)) {
theForm.__EVENTTARGET.value = eventTarget;
theForm.__EVENTARGUMENT.value = eventArgument;
theForm.submit();
}
}
//]]>
</script>
<script src="/adfs/ls/WebResource.axd?d=R0l1a72Cg5TSxysp2KQAI3jxsvUX5lddCsTro4PK2e3pa0vrKWGSoREpzEHBSUwD1ZnoW_1p3s0pZ0N14jqxpke-Les1&t=634604460479085897" type="text/javascript"></script>
<script src="/adfs/ls/WebResource.axd?d=uhT4_EyRHUPDD9bN9xEdvnkPa9UwoS7EcwbJafBPEC1C5yXvZ7U_B-Bk88vhYJ210MpIkZNXX14YSSMHpLNsjEGk8CU1&t=634604460479085897" type="text/javascript"></script>
<script src="/adfs/ls/WebResource.axd?d=0g2LGoR3WFCaDkasEEc2P3TsG14EuOcyE9ijeuIQuH3xMggypapCo3nEqYmjSozc7sTUcRAnt_JAmxj7Bmf2E89wiBE1&t=634604460479085897" type="text/javascript"></script>
<script type="text/javascript">
//<![CDATA[
function WebForm_OnSubmit() {
if (typeof(ValidatorOnSubmit) == "function" && ValidatorOnSubmit() == false) return false;
return true;
}
//]]>
</script>
<div>
<input type="hidden" name="__EVENTVALIDATION" id="__EVENTVALIDATION" value="/wEWCAKVrZbjCgLnmcnFAQKI/MCLCQKeqYHdCwKOhc6uCwKapentBQL7p9L9CwKk15WYBQ==" />
</div><input type="hidden" name="__db" value="15" />
<!-- THE CERN_BANNER IS REQUIRED BY THE GRAPHIC CHARTER -->
<div id="ctl00_pnlHeader">
<div id="cern_banner">
<a href="http://www.cern.ch/" title="cern.ch"><span>CERN — the European Organization
for Nuclear Research</span></a>
</div>
</div>
<div id="container" class="clear-block">
<!-- Page Content -->
<div id="middle" class="clear-block">
<h1 class="hide">CERN Single Sign-On</h1>
<h2>Sign in with your CERN account</h2>
<div class="cern_credentials">
<p class="message error">
<span id="ctl00_ContentPlaceHolder1_RequiredFieldValidator1" style="color:Red;visibility:hidden;">Login is required</span>
<span id="ctl00_ContentPlaceHolder1_Requiredfieldvalidator2" style="color:Red;visibility:hidden;">Password is required</span>
<span id="ctl00_ContentPlaceHolder1_lblFormsError"></span>
</p>
<div class="row clear-block">
<label>Username or Email Address:</label>
<input name="ctl00$ContentPlaceHolder1$txtFormsLogin" type="text" id="ctl00_ContentPlaceHolder1_txtFormsLogin" />
</div>
<div class="row clear-block">
<label>Password:</label>
<input name="ctl00$ContentPlaceHolder1$txtFormsPassword" type="password" id="ctl00_ContentPlaceHolder1_txtFormsPassword" />
</div>
<div class="row clear-block">
<input type="submit" name="ctl00$ContentPlaceHolder1$btnFormsLogin" value="Sign in" onclick="javascript:WebForm_DoPostBackWithOptions(new WebForm_PostBackOptions("ctl00$ContentPlaceHolder1$btnFormsLogin", "", true, "credentials", "", false, false))" id="ctl00_ContentPlaceHolder1_btnFormsLogin" />
</div>
<p class="smaller note important right">Reminder: you have agreed to comply with the <a href="http://cern.ch/ComputingRules">CERN computing rules</a></p>
<!-- virtual keyboard -->
<!--<div id="Div1"></div>-->
</div><!-- cern_credentials -->
<ul class="alternate_authentication plain right">
<li><span class="subtle"><input id="ctl00_ContentPlaceHolder1_chkRememberLogin" type="checkbox" name="ctl00$ContentPlaceHolder1$chkRememberLogin" /><label for="ctl00_ContentPlaceHolder1_chkRememberLogin">Remember Username or Email Address</label></span></li>
<li><a id="ctl00_ContentPlaceHolder1_hlNTLM2" href="auth/integrated/?wa=wsignin1.0&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wctx=cookie%3Ad0dbd8a6">Sign in using your current Windows/Kerberos credentials</a>
<a id="ctl00_ContentPlaceHolder1_hlNTLMAutologon" title="Enables Autologon with current Windows/Kerberos Credentials. Click Logout in the Application to disable." href="javascript:__doPostBack('ctl00$ContentPlaceHolder1$hlNTLMAutologon','')">[autologon]</a>
<img class="vmiddle" src="/adfs/ls/images/ntlmkeysmall.gif" alt="Kerberos based authentication" />
</li>
<li><a id="ctl00_ContentPlaceHolder1_hlCertificateAuth" title="Don't forget to first map your Certificate to your CERN Account on http://ca.cern.ch ." href="auth/sslclient/?wa=wsignin1.0&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wctx=cookie%3Ad0dbd8a6">Sign in using your Certificate</a>
<a onclick="javascript:return confirm('Warning: please ensure you successfully authenticated with your Certificate by clicking on \'Sign in using your Certificate\' before enabling autologon.\r\nIf autologon is enabled with a bad Certificate your will have to Clear your Browser\'s cookies to disable the feature.\r\nClick Ok to proceed with autologon enabling or Cancel if you are unsure or don\'t understand this message.');" id="ctl00_ContentPlaceHolder1_hlCertificateAutologon" title="Enables Autologon with Certificate. Click Logout in the Application to disable. Don't forget to first map your Certificate to your CERN Account on http://ca.cern.ch ." href="javascript:__doPostBack('ctl00$ContentPlaceHolder1$hlCertificateAutologon','')">[autologon]</a>
<img class="vmiddle" src="/adfs/ls/images/certificatekeysmall.gif" alt="Don't forget to first map your Certificate to your CERN Account on http://ca.cern.ch ." />
</li>
</ul>
<ul class="more_links plain go">
<li><a id="ctl00_ContentPlaceHolder1_hlRequestPassChange" href="https://account.cern.ch/account/Help/?kbid=053010">Need password help ?</a></li>
<li><a id="ctl00_ContentPlaceHolder1_hlNewAccount" href="http://cern.ch/account">Create/Check your account</a></li>
<li><a href="mailto:service-desk@cern.ch">service-desk@cern.ch</a> <span class="subtle">+41 22 76 77777</span></li>
<li><a href="http://cern.ch/it-support-servicestatus/" target="_blank">IT Services Status Board</a></li>
</ul>
</div><!-- / middle -->
<div id="ctl00_pnlFooter">
<div id="footer" class="clear-block">
<!-- THE CERN_LOGO IS REQUIRED BY THE GRAPHIC CHARTER -->
<a id="cern_logo" class="badge_80" href="http://www.cern.ch" title="www.cern.ch"
name="cern_logo"><span>cern.ch</span></a>
</div><!-- / footer -->
<span style="color: white">Server: ADFS01</span>
</div>
</div><!-- / container -->
<script type="text/javascript">
//<![CDATA[
var Page_Validators = new Array(document.getElementById("ctl00_ContentPlaceHolder1_RequiredFieldValidator1"), document.getElementById("ctl00_ContentPlaceHolder1_Requiredfieldvalidator2"));
//]]>
</script>
<script type="text/javascript">
//<![CDATA[
var ctl00_ContentPlaceHolder1_RequiredFieldValidator1 = document.all ? document.all["ctl00_ContentPlaceHolder1_RequiredFieldValidator1"] : document.getElementById("ctl00_ContentPlaceHolder1_RequiredFieldValidator1");
ctl00_ContentPlaceHolder1_RequiredFieldValidator1.controltovalidate = "ctl00_ContentPlaceHolder1_txtFormsLogin";
ctl00_ContentPlaceHolder1_RequiredFieldValidator1.validationGroup = "credentials";
ctl00_ContentPlaceHolder1_RequiredFieldValidator1.evaluationfunction = "RequiredFieldValidatorEvaluateIsValid";
ctl00_ContentPlaceHolder1_RequiredFieldValidator1.initialvalue = "";
var ctl00_ContentPlaceHolder1_Requiredfieldvalidator2 = document.all ? document.all["ctl00_ContentPlaceHolder1_Requiredfieldvalidator2"] : document.getElementById("ctl00_ContentPlaceHolder1_Requiredfieldvalidator2");
ctl00_ContentPlaceHolder1_Requiredfieldvalidator2.controltovalidate = "ctl00_ContentPlaceHolder1_txtFormsPassword";
ctl00_ContentPlaceHolder1_Requiredfieldvalidator2.validationGroup = "credentials";
ctl00_ContentPlaceHolder1_Requiredfieldvalidator2.evaluationfunction = "RequiredFieldValidatorEvaluateIsValid";
ctl00_ContentPlaceHolder1_Requiredfieldvalidator2.initialvalue = "";
//]]>
</script>
<script type="text/javascript">
//<![CDATA[
var Page_ValidationActive = false;
if (typeof(ValidatorOnLoad) == "function") {
ValidatorOnLoad();
}
function ValidatorOnSubmit() {
if (Page_ValidationActive) {
return ValidatorCommonOnSubmit();
}
else {
return true;
}
}
WebForm_AutoFocus('ctl00_ContentPlaceHolder1_txtFormsLogin');//]]>
</script>
</form>
</body>
</html>
INFO: CERN Login parameters
https://login.cern.ch/adfs/ls/auth/sslclient/?wctx=cookie%3Ad0dbd8a6&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wa=wsignin1.0&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS
INFO: Cookie Jar content
<cookielib.CookieJar[<Cookie _shibstate_d0dbd8a6=https%3A%2F%2Fcmswbm.web.cern.ch%2Fcmswbm%2Fcmsdb%2Fservlet%2FRunSummary%3FRUN%3D160915%26DB%3Dcms_omds_lb%26FORMAT%3DXML for cmswbm.web.cern.ch/>]>
send: 'GET /adfs/ls/auth/sslclient/?wctx=cookie%3Ad0dbd8a6&wreply=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS&wct=2012-05-05T19%3A24%3A56Z&wa=wsignin1.0&wtrealm=https%3A%2F%2Fcmswbm.web.cern.ch%2FShibboleth.sso%2FADFS HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: login.cern.ch\r\nConnection: close\r\nUser-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Cache-Control: no-cache
header: Pragma: no-cache
header: Content-Type: text/html; charset=utf-8
header: Expires: -1
header: Server: Microsoft-IIS/7.5
header: X-AspNet-Version: 2.0.50727
header: X-Powered-By: ASP.NET
header: Date: Sat, 05 May 2012 19:24:55 GMT
header: Connection: close
header: Content-Length: 7071
INFO: Response info
Cache-Control: no-cache
Pragma: no-cache
Content-Type: text/html; charset=utf-8
Expires: -1
Server: Microsoft-IIS/7.5
X-AspNet-Version: 2.0.50727
X-Powered-By: ASP.NET
Date: Sat, 05 May 2012 19:24:55 GMT
Connection: close
Content-Length: 7071
send: 'POST /Shibboleth.sso/ADFS HTTP/1.1\r\nAccept-Encoding: identity\r\nContent-Length: 96\r\nHost: cmswbm.web.cern.ch\r\nUser-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11\r\nConnection: close\r\nCookie: _shibstate_d0dbd8a6=https%3A%2F%2Fcmswbm.web.cern.ch%2Fcmswbm%2Fcmsdb%2Fservlet%2FRunSummary%3FRUN%3D160915%26DB%3Dcms_omds_lb%26FORMAT%3DXML\r\nContent-Type: application/x-www-form-urlencoded\r\n\r\n'
send: '__db=8&__EVENTVALIDATION=%2FwEWAgKIx7KvDwLnmcnFAQ%3D%3D&__VIEWSTATE=%2FwEPDwUJMzAzMTU0MDM5ZGQ%3D'
reply: 'HTTP/1.1 500 Internal Server Error\r\n'
header: Date: Sat, 05 May 2012 19:24:56 GMT
header: Server: Apache
header: Expires: 01-Jan-1997 12:00:00 GMT
header: Cache-Control: private,no-store,no-cache
header: Content-Length: 982
header: Connection: close
header: Content-Type: text/html
---------------------------------------------------------------------------
HTTPError Traceback (most recent call last)
/afs/cern.ch/user/n/neggert/<ipython-input-2-c10902d46b4c> in <module>()
----> 1 get_ipython().magic(u'info run=160915')
/afs/cern.ch/work/v/valya/public/soft/install/lib/python2.6/site-packages/IPython/core/interactiveshell.pyc in magic(self, arg_s, next_input)
1983 self._magic_locals = sys._getframe(1).f_locals
1984 with self.builtin_trap:
-> 1985 result = fn(magic_args)
1986 # Ensure we're not keeping object references around:
1987 self._magic_locals = {}
/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cms_cmds.pyc in cms_info(arg)
590 cmssh# info run=160915
591 """
--> 592 cms_ls(arg)
593
594 def cms_cp(arg):
/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cms_cmds.pyc in cms_ls(arg)
567 elif pat_run.match(arg):
568 arg = arg.replace('run=', '')
--> 569 res = run_info(arg, verbose)
570 elif pat_release.match(arg):
571 arg = arg.replace('release=', '')
/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/cmsfs.pyc in run_info(run, verbose)
423 params = {'Runs':run, 'lumiType':'delivered'}
424 data = get_data(url, method, params)
--> 425 runinfo = [r for r in runsum(run)]
426 runlumi = [r for r in data]
427 plist = []
/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/runsum.pyc in runsum(run, debug)
42 cert = os.path.join(os.environ['HOME'], '.globus/usercert.pem')
43 with working_pem(PEMMGR.pem) as key:
---> 44 data = get_data(url, key, cert, debug)
45 for row in xml_parser(data, 'runInfo'):
46 yield row['runInfo']
/afs/cern.ch/work/v/valya/public/soft/cmssh/src/cmssh/auth_utils.pyc in get_data(url, key, cert, debug)
150 url = 'https://cmswbm.web.cern.ch/Shibboleth.sso/ADFS'
151 params = urllib.urlencode(param_dict)
--> 152 fdesc = opener.open(url, params)
153 return fdesc
/afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in open(self, fullurl, data, timeout)
393 for processor in self.process_response.get(protocol, []):
394 meth = getattr(processor, meth_name)
--> 395 response = meth(req, response)
396
397 return response
/afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in http_response(self, request, response)
506 if not (200 <= code < 300):
507 response = self.parent.error(
--> 508 'http', request, response, code, msg, hdrs)
509
510 return response
/afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in error(self, proto, *args)
431 if http_err:
432 args = (dict, 'default', 'http_error_default') + orig_args
--> 433 return self._call_chain(*args)
434
435 # XXX probably also want an abstract factory that knows when it makes
/afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in _call_chain(self, chain, kind, meth_name, *args)
365 func = getattr(handler, meth_name)
366
--> 367 result = func(*args)
368 if result is not None:
369 return result
/afs/cern.ch/cms/slc5_amd64_gcc462/external/python/2.6.4/lib/python2.6/urllib2.pyc in http_error_default(self, req, fp, code, msg, hdrs)
514 class HTTPDefaultErrorHandler(BaseHandler):
515 def http_error_default(self, req, fp, code, msg, hdrs):
--> 516 raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
517
518 class HTTPRedirectHandler(BaseHandler):
HTTPError: HTTP Error 500: Internal Server Error
Nic,
thanks for output, I do see where the problem is. Somehow for your requests CERN SSO does not send proper cookies, but for me and Dan it does. Either we have different settings in our certificates or mine/Dan's environment allows CERN SSO to pass. To debug the problem I still need your cooperation. Do you mind to run one more script from your local environment. In fact it would be nice if you'll run it from your Mac and from lxplus. I extracted all necessary pieces to access RunSummary and put them together into single script which I'm attaching to this email. So you'll need to run as as simple as
python test_rs.py
On lxplus it should be python26 test_rs.py since default python is 2.4.
Thanks,
Valentin.
Hi Nic,
I understood the problem and it should be fixed by you :) Since cmssh uses CERN SSO to access RunSummary@P5, the user certificate needs to be mapped at CERN http://ca.cern.ch/ site. Please go there, lookup Map an existing Certificate to your account link and upload your usercert.pem file. Once you'll do it the cmssh will happy and give you back results.
I already checked that with Werner who had similar issue.
Please let me know if you'll do it and if you can check again cmssh once you'll map your certificate.
Regards,
Valentin.
That worked! Thanks.
…On Monday, May 7, 2012 at 6:54 PM, Valentin Kuznetsov wrote:
Hi Nic,
I understood the problem and it should be fixed by you :) Since cmssh uses CERN SSO to access ***@***.***, the user certificate needs to be mapped at CERN http://ca.cern.ch/ site. Please go there, lookup Map an existing Certificate to your account link and upload your usercert.pem file. Once you'll do it the cmssh will happy and give you back results.
I already checked that with Werner who had similar issue.
Please let me know if you'll do it and if you can check again cmssh once you'll map your certificate.
Regards,
Valentin.
---
Reply to this email directly or view it on GitHub:
https://gist.github.com/2503811
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Nic, could you please try one more time. I created new account for myself on my VM and was able to run info and cp commands form it. But I still need to try it out from someone else account with his own grid certificate.