This was run with the ipynbhpc script, with IPYNB_PORT=8812 and IPYNB_MINUTES=12
Last active
August 29, 2015 13:58
-
-
Save olgabot/9957802 to your computer and use it in GitHub Desktop.
Debugging ssh tunneling into TSCC
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| debug3: load_hostkeys: loading entries for host "tscc-login1" from file "/home/obotvinnik/.ssh/known_hosts" | |
| debug3: load_hostkeys: loaded 0 keys | |
| debug3: load_hostkeys: loading entries for host "tscc-login1" from file "/etc/ssh/ssh_known_hosts" | |
| debug3: load_hostkeys: found key type DSA in file /etc/ssh/ssh_known_hosts:341 | |
| debug3: load_hostkeys: found key type RSA in file /etc/ssh/ssh_known_hosts:342 | |
| debug3: load_hostkeys: loaded 2 keys | |
| debug3: load_hostkeys: loading entries for host "10.1.255.90" from file "/home/obotvinnik/.ssh/known_hosts" | |
| debug3: load_hostkeys: loaded 0 keys | |
| debug3: load_hostkeys: loading entries for host "10.1.255.90" from file "/etc/ssh/ssh_known_hosts" | |
| debug3: load_hostkeys: found key type DSA in file /etc/ssh/ssh_known_hosts:341 | |
| debug3: load_hostkeys: found key type RSA in file /etc/ssh/ssh_known_hosts:342 | |
| debug3: load_hostkeys: loaded 2 keys | |
| debug1: Host 'tscc-login1' is known and matches the RSA host key. | |
| debug1: Found key in /etc/ssh/ssh_known_hosts:342 | |
| debug2: bits set: 514/1024 | |
| debug1: ssh_rsa_verify: signature correct | |
| debug2: kex_derive_keys | |
| debug2: set_newkeys: mode 1 | |
| debug1: SSH2_MSG_NEWKEYS sent | |
| debug1: expecting SSH2_MSG_NEWKEYS | |
| debug2: set_newkeys: mode 0 | |
| debug1: SSH2_MSG_NEWKEYS received | |
| debug1: Roaming not allowed by server | |
| debug1: SSH2_MSG_SERVICE_REQUEST sent | |
| debug2: service_accept: ssh-userauth | |
| debug1: SSH2_MSG_SERVICE_ACCEPT received | |
| debug2: key: /home/obotvinnik/.ssh/identity ((nil)) | |
| debug2: key: /home/obotvinnik/.ssh/id_rsa (0x2385290) | |
| debug2: key: /home/obotvinnik/.ssh/id_dsa ((nil)) | |
| debug1: Authentications that can continue: publickey,gssapi-keyex,gssapi-with-mic,password,keyboard-interactive | |
| debug3: start over, passed a different list publickey,gssapi-keyex,gssapi-with-mic,password,keyboard-interactive | |
| debug3: preferred gssapi-keyex,gssapi-with-mic,publickey,keyboard-interactive,password | |
| debug3: authmethod_lookup gssapi-keyex | |
| debug3: remaining preferred: gssapi-with-mic,publickey,keyboard-interactive,password | |
| debug3: authmethod_is_enabled gssapi-keyex | |
| debug1: Next authentication method: gssapi-keyex | |
| debug1: No valid Key exchange context | |
| debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup gssapi-with-mic | |
| debug3: remaining preferred: publickey,keyboard-interactive,password | |
| debug3: authmethod_is_enabled gssapi-with-mic | |
| debug1: Next authentication method: gssapi-with-mic | |
| debug1: Unspecified GSS failure. Minor code may provide more information | |
| Credentials cache file '/tmp/krb5cc_132047' not found | |
| debug1: GSS Major Status: General failure | |
| GSS Minor Status Error Chain: | |
| globus_gsi_gssapi: Error with gss context | |
| globus_gsi_gssapi: Error with gss credential handle | |
| globus_credential: Valid credentials could not be found in any of the possible locations specified by the credential search order. | |
| Valid credentials could not be found in any of the possible locations specified by the credential search order. | |
| Attempt 1 | |
| globus_credential: Error reading host credential | |
| globus_sysconfig: Could not find a valid certificate file: The host cert could not be found in: | |
| 1) env. var. X509_USER_CERT | |
| 2) /etc/grid-security/hostcert.pem | |
| 3) $GLOBUS_LOCATION/etc/hostcert.pem | |
| 4) $HOME/.globus/hostcert.pem | |
| The host key could not be found in: | |
| 1) env. var. X509_USER_KEY | |
| 2) /etc/grid-security/hostkey.pem | |
| 3) $GLOBUS_LOCATION/etc/hostkey.pem | |
| 4) $HOME/.globus/hostkey.pem | |
| Attempt 2 | |
| globus_credential: Error reading proxy credential | |
| globus_sysconfig: Could not find a valid proxy certificate file location | |
| globus_sysconfig: Error with debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup publickey | |
| debug3: remaining preferred: keyboard-interactive,password | |
| debug3: authmethod_is_enabled publickey | |
| debug1: Next authentication method: publickey | |
| debug1: Trying private key: /home/obotvinnik/.ssh/identity | |
| debug3: no such identity: /home/obotvinnik/.ssh/identity | |
| debug1: Offering RSA public key: /home/obotvinnik/.ssh/id_rsa | |
| debug3: send_pubkey_test | |
| debug2: we sent a publickey packet, wait for reply | |
| debug1: Server accepts key: pkalg ssh-rsa blen 277 | |
| debug2: input_userauth_pk_ok: fp a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug3: sign_and_send_pubkey: RSA a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug1: read PEM private key done: type RSA | |
| debug1: Authentication succeeded (publickey). | |
| Authenticated to tscc-login1 ([10.1.255.90]:22). | |
| debug1: Local connections to LOCALHOST:7710 forwarded to remote address localhost:7710 | |
| debug3: channel_setup_fwd_listener: type 2 wildcard 0 addr NULL | |
| debug1: Local forwarding listening on 127.0.0.1 port 7710. | |
| bind: Address already in use | |
| channel_setup_fwd_listener: cannot listen to port: 7710 | |
| Could not request local forwarding. | |
| debug1: Final hpn_buffer_size = 131072 | |
| debug1: HPN Disabled: 0, HPN Buffer Size: 131072 | |
| debug1: channel 0: new [client-session] | |
| debug1: Enabled Dynamic Window Scaling | |
| debug3: ssh_session2_open: channel_new: 0 | |
| debug2: channel 0: send open | |
| debug1: Requesting no-more-sessions@openssh.com | |
| debug1: Entering interactive session. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Attempt 2 | |
| globus_credential: Error reading proxy credential | |
| globus_sysconfig: Could not find a valid proxy certificate file location | |
| globus_sysconfig: Error with debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup publickey | |
| debug3: remaining preferred: keyboard-interactive,password | |
| debug3: authmethod_is_enabled publickey | |
| debug1: Next authentication method: publickey | |
| debug1: Trying private key: /home/obotvinnik/.ssh/identity | |
| debug3: no such identity: /home/obotvinnik/.ssh/identity | |
| debug1: Offering RSA public key: /home/obotvinnik/.ssh/id_rsa | |
| debug3: send_pubkey_test | |
| debug2: we sent a publickey packet, wait for reply | |
| debug1: Server accepts key: pkalg ssh-rsa blen 277 | |
| debug2: input_userauth_pk_ok: fp a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug3: sign_and_send_pubkey: RSA a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug1: read PEM private key done: type RSA | |
| debug1: Authentication succeeded (publickey). | |
| Authenticated to tscc-login1 ([10.1.255.90]:22). | |
| debug1: Local connections to LOCALHOST:7701 forwarded to remote address localhost:7701 | |
| debug3: channel_setup_fwd_listener: type 2 wildcard 0 addr NULL | |
| debug1: Local forwarding listening on 127.0.0.1 port 7701. | |
| bind: Address already in use | |
| channel_setup_fwd_listener: cannot listen to port: 7701 | |
| Could not request local forwarding. | |
| debug1: Final hpn_buffer_size = 131072 | |
| debug1: HPN Disabled: 0, HPN Buffer Size: 131072 | |
| debug1: channel 0: new [client-session] | |
| debug1: Enabled Dynamic Window Scaling | |
| debug3: ssh_session2_open: channel_new: 0 | |
| debug2: channel 0: send open | |
| debug1: Requesting no-more-sessions@openssh.com | |
| debug1: Entering interactive session. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Attempt 2 | |
| globus_credential: Error reading proxy credential | |
| globus_sysconfig: Could not find a valid proxy certificate file location | |
| globus_sysconfig: Error with debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup publickey | |
| debug3: remaining preferred: keyboard-interactive,password | |
| debug3: authmethod_is_enabled publickey | |
| debug1: Next authentication method: publickey | |
| debug1: Trying private key: /home/obotvinnik/.ssh/identity | |
| debug3: no such identity: /home/obotvinnik/.ssh/identity | |
| debug1: Offering RSA public key: /home/obotvinnik/.ssh/id_rsa | |
| debug3: send_pubkey_test | |
| debug2: we sent a publickey packet, wait for reply | |
| debug1: Server accepts key: pkalg ssh-rsa blen 277 | |
| debug2: input_userauth_pk_ok: fp a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug3: sign_and_send_pubkey: RSA a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug1: read PEM private key done: type RSA | |
| debug1: Authentication succeeded (publickey). | |
| Authenticated to tscc-login1 ([10.1.255.90]:22). | |
| debug1: Local connections to LOCALHOST:7700 forwarded to remote address localhost:7700 | |
| debug3: channel_setup_fwd_listener: type 2 wildcard 0 addr NULL | |
| debug1: Local forwarding listening on 127.0.0.1 port 7700. | |
| bind: Address already in use | |
| socket: Address family not supported by protocol | |
| channel_setup_fwd_listener: cannot listen to port: 7700 | |
| Could not request local forwarding. | |
| debug1: Final hpn_buffer_size = 131072 | |
| debug1: HPN Disabled: 0, HPN Buffer Size: 131072 | |
| debug1: channel 0: new [client-session] | |
| debug1: Enabled Dynamic Window Scaling | |
| debug3: ssh_session2_open: channel_new: 0 | |
| debug2: channel 0: send open | |
| debug1: Requesting no-more-sessions@openssh.com | |
| debug1: Entering interactive session. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| alias sshcluster='ssh obotvinnik@tscc-login1.sdsc.edu -L 8812:localhost:8812' |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ head index.html.2 | |
| <!DOCTYPE HTML> | |
| <html> | |
| <head> | |
| <meta charset="utf-8"> | |
| <title>IPython Dashboard</title> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| from subprocess import Popen, PIPE, call | |
| import sys | |
| import time | |
| import os | |
| import exceptions | |
| import socket | |
| # Current default QSUB template is suitable for SDSC Gordon | |
| QSUB_TEMPLATE = os.environ.get("IPYNB_QSUB_TEMPLATE", 'qsub -I -V -l nodes=1:ppn=1 -l walltime=00:00:%d -q hotel') | |
| NOTEBOOK_TEMPLATE = os.environ.get("IPYNB_NOTEBOOK_TEMPLATE", 'ipython notebook --pylab=inline --port=%d --debug --no-browser --profile default') | |
| try: | |
| PORT = int(os.environ["IPYNB_PORT"]) | |
| except exceptions.KeyError: | |
| print("Need to define IPYNB_PORT environmental variable [>1024], i.e. export IPYNB_PORT=XXXX") | |
| sys.exit(1) | |
| try: | |
| MINUTES = int(os.environ["IPYNB_MINUTES"]) | |
| except exceptions.KeyError: | |
| MINUTES = 30 | |
| print("You can define IPYNB_MINUTES environmental variable to set the duration of the job, i.e. export IPYNB_MINUTES=XX, using default %d minutes" % MINUTES) | |
| def readwhile(stream, func): | |
| while True: | |
| line = stream.readline() | |
| if line!='': | |
| sys.stdout.write(line) | |
| if func(line): break | |
| else: | |
| raise exceptions.Exception("Disconnected unexpectedly.") | |
| print("Requesting an interactive node") | |
| #pqsub=Popen(['ssh', '-t', '-t','-4','localhost'],stdin=PIPE,stdout=PIPE,stderr=PIPE) | |
| pqsub=Popen(['ssh','-o', 'GlobalKnownHostsFile=/dev/null','-t','-t','-4','localhost'],stdin=PIPE,stdout=PIPE,stderr=PIPE) | |
| pqsub.stdin.write((QSUB_TEMPLATE % MINUTES)+"\n") | |
| pqsub.stdin.write('echo HOSTNAME=`hostname`\n') | |
| def gethostname(line): | |
| global hostname | |
| if line.startswith('HOSTNAME'): | |
| hostname = line.split('=')[1].strip() | |
| return True | |
| print("Waiting for the job to start...") | |
| readwhile(pqsub.stdout, gethostname) | |
| pqsub.stdin.write('cd $PBS_O_WORKDIR\n') | |
| pqsub.stdin.write('echo CD\n') | |
| readwhile(pqsub.stdout, lambda line: line.startswith('CD')) | |
| print("Launching the notebook") | |
| pqsub.stdin.write((NOTEBOOK_TEMPLATE % PORT)+"\n") | |
| readwhile(pqsub.stdout, lambda line: line.find('NotebookApp')>0) | |
| print("Setting up SSH tunnel from computing to login node") | |
| # get IP address | |
| hostname = socket.gethostbyname(socket.gethostname()) | |
| #tunnel = ['ssh', '-t', '-Y', hostname, '-L', '%s:localhost:%s'% (PORT,PORT)] | |
| tunnel = ['ssh', '-o', 'GlobalKnownHostsFile=/dev/null', '-vvv', '-t', '-Y', hostname, '-L', '%s:localhost:%s'% (PORT,PORT)] | |
| ptunnel = Popen(tunnel,stdout=PIPE,stdin=PIPE, stderr=PIPE) | |
| ptunnel.stdin.write('echo TUNNEL\n') | |
| readwhile(ptunnel.stdout, lambda line: line.startswith('TUNNEL')) | |
| print("Succesfully opened notebook!") | |
| print("Kill this process to end your notebook connection.") | |
| time.sleep(MINUTES*60) | |
| pqsub.kill() | |
| ptunnel.kill() | |
| print("Succesfully cleaned up connections.") |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)[obotvinnik@tscc-0-59 ~]$ lsof -i:7701 | |
| COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME | |
| ipython 60903 obotvinnik 4u IPv4 26356748 0t0 TCP localhost.localdomain:7701 (LISTEN) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ qsub -I -l walltime=00:30:00 -l nodes=1:ppn=1 -q home-yeo | |
| qsub: waiting for job 1335571.tscc-mgr.local to start | |
| qsub: job 1335571.tscc-mgr.local ready | |
| (envy)[obotvinnik@tscc-1-52 ~]$ ipython notebook --pylab inline --port=8812 --no-browser & | |
| [1] 57064 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ /projects/ps-yeolab/software/lib/python2.7/site-packages/Crypto/Util/number.py:57: PowmInsecureWarning: Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability. | |
| _warn("Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability.", PowmInsecureWarning) | |
| 2014-04-03 10:17:39.182 [NotebookApp] Using existing profile dir: u'/home/obotvinnik/.config/ipython/profile_default' | |
| 2014-04-03 10:17:39.212 [NotebookApp] Using MathJax from CDN: http://cdn.mathjax.org/mathjax/latest/MathJax.js | |
| 2014-04-03 10:17:39.238 [NotebookApp] Serving notebooks from local directory: /home/obotvinnik | |
| 2014-04-03 10:17:39.238 [NotebookApp] The IPython Notebook is running at: http://127.0.0.1:8812/ | |
| 2014-04-03 10:17:39.238 [NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation). | |
| (envy)[obotvinnik@tscc-1-52 ~]$ | |
| (envy)[obotvinnik@tscc-1-52 ~]$ | |
| (envy)[obotvinnik@tscc-1-52 ~]$ ssh tscc-login1 -L 8812:localhost:8812 & | |
| [2] 57072 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ channel_setup_fwd_listener: cannot listen to port: 8812 | |
| Could not request local forwarding. | |
| ^C | |
| [2]+ Stopped ssh tscc-login1 -L 8812:localhost:8812 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ netstat --listen | grep 8812 | |
| tcp 0 0 localhost.localdomain:8812 *:* LISTEN | |
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ wget localhost:8812 | |
| --2014-04-03 09:19:24-- http://localhost:8812/ | |
| Resolving localhost... 127.0.0.1 | |
| Connecting to localhost|127.0.0.1|:8812... connected. | |
| HTTP request sent, awaiting response... ^Z | |
| [1]+ Stopped wget localhost:8812 | |
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ ^C | |
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ wget | |
| wget: missing URL | |
| Usage: wget [OPTION]... [URL]... | |
| Try ‘wget --help’ for more options. | |
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ wget localhost.localdomain:8812 | |
| --2014-04-03 09:19:48-- http://localhost.localdomain:8812/ | |
| Resolving localhost.localdomain... 127.0.0.1 | |
| Connecting to localhost.localdomain|127.0.0.1|:8812... connected. | |
| HTTP request sent, awaiting response... No data received. | |
| Retrying. | |
| --2014-04-03 09:19:50-- (try: 2) http://localhost.localdomain:8812/ | |
| Connecting to localhost.localdomain|127.0.0.1|:8812... connected. | |
| HTTP request sent, awaiting response... No data received. | |
| Retrying. | |
| ^Z | |
| [2]+ Stopped wget localhost.localdomain:8812 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ netstat -tulpn | grep 8812 | |
| (Not all processes could be identified, non-owned process info | |
| will not be shown, you would have to be root to see it all.) | |
| tcp 0 0 127.0.0.1:8812 0.0.0.0:* LISTEN 22103/ssh |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)[obotvinnik@tscc-1-52 ~]$ ssh tscc-login1 -L 8813:localhost:8813 & | |
| [6] 57158 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ channel_setup_fwd_listener: cannot listen to port: 8813 | |
| Could not request local forwarding. | |
| ^C | |
| [6]+ Stopped ssh tscc-login1 -L 8813:localhost:8813 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ ssh tscc-login1 -L 8814:localhost:8814 & | |
| [7] 57163 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ channel_setup_fwd_listener: cannot listen to port: 8814 | |
| Could not request local forwarding. | |
| [7]+ Stopped ssh tscc-login1 -L 8814:localhost:8814 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ | |
| (envy)[obotvinnik@tscc-1-52 ~]$ ssh tscc-login1 -L 8815:localhost:8815 & | |
| [8] 57168 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ channel_setup_fwd_listener: cannot listen to port: 8815 | |
| Could not request local forwarding. | |
| [8]+ Stopped ssh tscc-login1 -L 8815:localhost:8815 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ ssh tscc-login1 -L 7713:localhost:7713 & | |
| [10] 57233 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ channel_setup_fwd_listener: cannot listen to port: 7713 | |
| Could not request local forwarding. | |
| [10]+ Stopped ssh tscc-login1 -L 7713:localhost:7713 | |
| (envy)[obotvinnik@tscc-1-52 ~]$ | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)[obotvinnik@tscc-1-43 ~]$ netstat -tulpn | |
| (Not all processes could be identified, non-owned process info | |
| will not be shown, you would have to be root to see it all.) | |
| Active Internet connections (only servers) | |
| Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name | |
| tcp 0 0 0.0.0.0:51717 0.0.0.0:* LISTEN - | |
| tcp 0 0 127.0.0.1:8777 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:59444 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:38807 0.0.0.0:* LISTEN - | |
| tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:15002 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:15003 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:988 0.0.0.0:* LISTEN - | |
| tcp 0 0 127.0.0.1:7710 0.0.0.0:* LISTEN 52316/python | |
| tcp 0 0 0.0.0.0:964 0.0.0.0:* LISTEN - | |
| udp 0 0 0.0.0.0:988 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:111 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:631 0.0.0.0:* - | |
| udp 0 0 10.1.255.147:123 0.0.0.0:* - | |
| udp 0 0 132.249.107.147:123 0.0.0.0:* - | |
| udp 0 0 127.0.0.1:123 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:123 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:44189 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:35234 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:56998 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:55210 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:940 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:962 0.0.0.0:* - |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Attempt 2 | |
| globus_credential: Error reading proxy credential | |
| globus_sysconfig: Could not find a valid proxy certificate file location | |
| globus_sysconfig: Error with debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup publickey | |
| debug3: remaining preferred: keyboard-interactive,password | |
| debug3: authmethod_is_enabled publickey | |
| debug1: Next authentication method: publickey | |
| debug1: Trying private key: /home/obotvinnik/.ssh/identity | |
| debug3: no such identity: /home/obotvinnik/.ssh/identity | |
| debug1: Offering RSA public key: /home/obotvinnik/.ssh/id_rsa | |
| debug3: send_pubkey_test | |
| debug2: we sent a publickey packet, wait for reply | |
| debug1: Server accepts key: pkalg ssh-rsa blen 277 | |
| debug2: input_userauth_pk_ok: fp a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug3: sign_and_send_pubkey: RSA a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug1: read PEM private key done: type RSA | |
| debug1: Authentication succeeded (publickey). | |
| Authenticated to tscc-login1 ([10.1.255.90]:22). | |
| debug1: Remote connections from LOCALHOST:7701 forwarded to local address localhost:7701 | |
| debug1: Final hpn_buffer_size = 131072 | |
| debug1: HPN Disabled: 0, HPN Buffer Size: 131072 | |
| debug1: channel 0: new [client-session] | |
| debug1: Enabled Dynamic Window Scaling | |
| debug3: ssh_session2_open: channel_new: 0 | |
| debug2: channel 0: send open | |
| debug1: Requesting no-more-sessions@openssh.com | |
| debug1: Entering interactive session. | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Attempt 2 | |
| globus_credential: Error reading proxy credential | |
| globus_sysconfig: Could not find a valid proxy certificate file location | |
| globus_sysconfig: Error with debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup publickey | |
| debug3: remaining preferred: keyboard-interactive,password | |
| debug3: authmethod_is_enabled publickey | |
| debug1: Next authentication method: publickey | |
| debug1: Trying private key: /home/obotvinnik/.ssh/identity | |
| debug3: no such identity: /home/obotvinnik/.ssh/identity | |
| debug1: Offering RSA public key: /home/obotvinnik/.ssh/id_rsa | |
| debug3: send_pubkey_test | |
| debug2: we sent a publickey packet, wait for reply | |
| debug1: Server accepts key: pkalg ssh-rsa blen 277 | |
| debug2: input_userauth_pk_ok: fp a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug3: sign_and_send_pubkey: RSA a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug1: read PEM private key done: type RSA | |
| debug1: Authentication succeeded (publickey). | |
| Authenticated to tscc-login1 ([10.1.255.90]:22). | |
| debug1: Local connections to LOCALHOST:7720 forwarded to remote address localhost:7720 | |
| debug3: channel_setup_fwd_listener: type 2 wildcard 0 addr NULL | |
| debug1: Local forwarding listening on 127.0.0.1 port 7720. | |
| bind: Address already in use | |
| channel_setup_fwd_listener: cannot listen to port: 7720 | |
| Could not request local forwarding. | |
| debug1: Final hpn_buffer_size = 131072 | |
| debug1: HPN Disabled: 0, HPN Buffer Size: 131072 | |
| debug1: channel 0: new [client-session] | |
| debug1: Enabled Dynamic Window Scaling | |
| debug3: ssh_session2_open: channel_new: 0 | |
| debug2: channel 0: send open | |
| debug1: Requesting no-more-sessions@openssh.com | |
| debug1: Entering interactive session. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| debug3: load_hostkeys: loaded 0 keys | |
| debug3: load_hostkeys: loading entries for host "tscc-login1" from file "/etc/ssh/ssh_known_hosts" | |
| debug3: load_hostkeys: found key type DSA in file /etc/ssh/ssh_known_hosts:341 | |
| debug3: load_hostkeys: found key type RSA in file /etc/ssh/ssh_known_hosts:342 | |
| debug3: load_hostkeys: loaded 2 keys | |
| debug3: load_hostkeys: loading entries for host "10.1.255.90" from file "/home/obotvinnik/.ssh/known_hosts" | |
| debug3: load_hostkeys: loaded 0 keys | |
| debug3: load_hostkeys: loading entries for host "10.1.255.90" from file "/etc/ssh/ssh_known_hosts" | |
| debug3: load_hostkeys: found key type DSA in file /etc/ssh/ssh_known_hosts:341 | |
| debug3: load_hostkeys: found key type RSA in file /etc/ssh/ssh_known_hosts:342 | |
| debug3: load_hostkeys: loaded 2 keys | |
| debug1: Host 'tscc-login1' is known and matches the RSA host key. | |
| debug1: Found key in /etc/ssh/ssh_known_hosts:342 | |
| debug2: bits set: 532/1024 | |
| debug1: ssh_rsa_verify: signature correct | |
| debug2: kex_derive_keys | |
| debug2: set_newkeys: mode 1 | |
| debug1: SSH2_MSG_NEWKEYS sent | |
| debug1: expecting SSH2_MSG_NEWKEYS | |
| debug2: set_newkeys: mode 0 | |
| debug1: SSH2_MSG_NEWKEYS received | |
| debug1: Roaming not allowed by server | |
| debug1: SSH2_MSG_SERVICE_REQUEST sent | |
| debug2: service_accept: ssh-userauth | |
| debug1: SSH2_MSG_SERVICE_ACCEPT received | |
| debug2: key: /home/obotvinnik/.ssh/identity ((nil)) | |
| debug2: key: /home/obotvinnik/.ssh/id_rsa (0x1cbb270) | |
| debug2: key: /home/obotvinnik/.ssh/id_dsa ((nil)) | |
| debug1: Authentications that can continue: publickey,gssapi-keyex,gssapi-with-mic,password,keyboard-interactive | |
| debug3: start over, passed a different list publickey,gssapi-keyex,gssapi-with-mic,password,keyboard-interactive | |
| debug3: preferred gssapi-keyex,gssapi-with-mic,publickey,keyboard-interactive,password | |
| debug3: authmethod_lookup gssapi-keyex | |
| debug3: remaining preferred: gssapi-with-mic,publickey,keyboard-interactive,password | |
| debug3: authmethod_is_enabled gssapi-keyex | |
| debug1: Next authentication method: gssapi-keyex | |
| debug1: No valid Key exchange context | |
| debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup gssapi-with-mic | |
| debug3: remaining preferred: publickey,keyboard-interactive,password | |
| debug3: authmethod_is_enabled gssapi-with-mic | |
| debug1: Next authentication method: gssapi-with-mic | |
| debug1: Unspecified GSS failure. Minor code may provide more information | |
| Credentials cache file '/tmp/krb5cc_132047' not found | |
| debug1: GSS Major Status: General failure | |
| GSS Minor Status Error Chain: | |
| globus_gsi_gssapi: Error with gss context | |
| globus_gsi_gssapi: Error with gss credential handle | |
| globus_credential: Valid credentials could not be found in any of the possible locations specified by the credential search order. | |
| Valid credentials could not be found in any of the possible locations specified by the credential search order. | |
| Attempt 1 | |
| globus_credential: Error reading host credential | |
| globus_sysconfig: Could not find a valid certificate file: The host cert could not be found in: | |
| 1) env. var. X509_USER_CERT | |
| 2) /etc/grid-security/hostcert.pem | |
| 3) $GLOBUS_LOCATION/etc/hostcert.pem | |
| 4) $HOME/.globus/hostcert.pem | |
| The host key could not be found in: | |
| 1) env. var. X509_USER_KEY | |
| 2) /etc/grid-security/hostkey.pem | |
| 3) $GLOBUS_LOCATION/etc/hostkey.pem | |
| 4) $HOME/.globus/hostkey.pem | |
| Attempt 2 | |
| globus_credential: Error reading proxy credential | |
| globus_sysconfig: Could not find a valid proxy certificate file location | |
| globus_sysconfig: Error with debug2: we did not send a packet, disable method | |
| debug3: authmethod_lookup publickey | |
| debug3: remaining preferred: keyboard-interactive,password | |
| debug3: authmethod_is_enabled publickey | |
| debug1: Next authentication method: publickey | |
| debug1: Trying private key: /home/obotvinnik/.ssh/identity | |
| debug3: no such identity: /home/obotvinnik/.ssh/identity | |
| debug1: Offering RSA public key: /home/obotvinnik/.ssh/id_rsa | |
| debug3: send_pubkey_test | |
| debug2: we sent a publickey packet, wait for reply | |
| debug1: Server accepts key: pkalg ssh-rsa blen 277 | |
| debug2: input_userauth_pk_ok: fp a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug3: sign_and_send_pubkey: RSA a4:b5:c7:ac:eb:30:58:26:db:56:62:c3:df:45:2b:a2 | |
| debug1: read PEM private key done: type RSA | |
| debug1: Authentication succeeded (publickey). | |
| Authenticated to tscc-login1 ([10.1.255.90]:22). | |
| debug1: Local connections to LOCALHOST:7700 forwarded to remote address localhost:7700 | |
| debug3: channel_setup_fwd_listener: type 2 wildcard 0 addr NULL | |
| debug1: Local forwarding listening on 127.0.0.1 port 7700. | |
| bind: Address already in use | |
| socket: Address family not supported by protocol | |
| channel_setup_fwd_listener: cannot listen to port: 7700 | |
| Could not request local forwarding. | |
| debug1: Final hpn_buffer_size = 131072 | |
| debug1: HPN Disabled: 0, HPN Buffer Size: 131072 | |
| debug1: channel 0: new [client-session] | |
| debug1: Enabled Dynamic Window Scaling | |
| debug3: ssh_session2_open: channel_new: 0 | |
| debug2: channel 0: send open | |
| debug1: Requesting no-more-sessions@openssh.com | |
| debug1: Entering interactive session. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ ssh tscc-0-39 | |
| Rocks Compute Node | |
| Rocks 6.1 (Emerald Boa) | |
| Profile built 16:19 07-Dec-2013 | |
| Kickstarted 16:54 07-Dec-2013 | |
| For information on using the TSCC, please visit http://rci.ucsd.edu/computing | |
| (envy)[obotvinnik@tscc-0-39 ~]$ netstat -tupln | |
| (Not all processes could be identified, non-owned process info | |
| will not be shown, you would have to be root to see it all.) | |
| Active Internet connections (only servers) | |
| Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name | |
| tcp 0 0 0.0.0.0:933 0.0.0.0:* LISTEN - | |
| tcp 0 0 127.0.0.1:8812 0.0.0.0:* LISTEN 20703/python | |
| tcp 0 0 0.0.0.0:52972 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN - | |
| tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:15002 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:15003 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:988 0.0.0.0:* LISTEN - | |
| tcp 0 0 0.0.0.0:39133 0.0.0.0:* LISTEN - | |
| udp 0 0 0.0.0.0:43472 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:111 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:631 0.0.0.0:* - | |
| udp 0 0 10.1.255.215:123 0.0.0.0:* - | |
| udp 0 0 132.249.107.215:123 0.0.0.0:* - | |
| udp 0 0 127.0.0.1:123 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:123 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:45707 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:909 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:35731 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:931 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:34738 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:51901 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:957 0.0.0.0:* - | |
| udp 0 0 0.0.0.0:44990 0.0.0.0:* - | |
| (envy)[obotvinnik@tscc-0-39 ~]$ wget localhost:8812 | |
| --2014-04-03 09:41:28-- http://localhost:8812/ | |
| Resolving localhost... 127.0.0.1 | |
| Connecting to localhost|127.0.0.1|:8812... failed: Connection refused. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)[obotvinnik@tscc-1-52 ~]$ ssh tscc-login1 | |
| Last login: Thu Apr 3 10:16:41 2014 from scrm-bio-228-232-2.dynamic.ucsd.edu | |
| Rocks 6.1 (Emerald Boa) | |
| Profile built 22:19 10-Mar-2014 | |
| Kickstarted 22:53 10-Mar-2014 | |
| Triton Shared Computing Cluster Login Node | |
| For information on using the TSCC, please visit http://rci.ucsd.edu/computing | |
| (envy)[obotvinnik@tscc-login1 ~]$ | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ wget localhost:7701 | |
| --2014-04-03 11:29:24-- http://localhost:7701/ | |
| Resolving localhost... 127.0.0.1 | |
| Connecting to localhost|127.0.0.1|:7701... connected. | |
| HTTP request sent, awaiting response... |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| (envy)(envy)[obotvinnik@tscc-login1 ~]$ ~/bin/ipynbhpc | |
| Requesting an interactive node | |
| Waiting for the job to start... | |
| Last login: Thu Apr 3 09:10:04 2014 from localhost.localdomain | |
| Rocks 6.1 (Emerald Boa) | |
| Profile built 22:19 10-Mar-2014 | |
| Kickstarted 22:53 10-Mar-2014 | |
| Triton Shared Computing Cluster Login Node | |
| For information on using the TSCC, please visit http://rci.ucsd.edu/computing | |
| qsub -I -V -l nodes=1:ppn=1 -l walltime=00:00:12 -q hotel | |
| echo HOSTNAME=`hostname` | |
| 12 -q hotelvinnik@tscc-login1 ~]$ qsub -I -V -l nodes=1:ppn=1 -l walltime=00:00: | |
| qsub: waiting for job 1335448.tscc-mgr.local to start | |
| qsub: job 1335448.tscc-mgr.local ready | |
| echo HOSTNAME=`hostname` | |
| (envy)(envy)[obotvinnik@tscc-0-59 ~]$echo HOSTNAME=`hostname` | |
| HOSTNAME=tscc-0-59.sdsc.edu | |
| (envy)(envy)[obotvinnik@tscc-0-59 ~]$cd $PBS_O_WORKDIR | |
| (envy)(envy)[obotvinnik@tscc-0-59 ~]$echo CD | |
| CD | |
| Launching the notebook | |
| --debug --no-browser --profile defaultython notebook --pylab=inline --port=8812 | |
| /projects/ps-yeolab/software/lib/python2.7/site-packages/Crypto/Util/number.py:57: PowmInsecureWarning: Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability. | |
| _warn("Not using mpz_powm_sec. You should rebuild using libgmp >= 5 to avoid timing attack vulnerability.", PowmInsecureWarning) | |
| 2014-04-03 09:16:56.220 [NotebookApp] Config changed: | |
| Setting up SSH tunnel from computing to login node | |
| TUNNEL | |
| Succesfully opened notebook! | |
| Kill this process to end your notebook connection. | |
| Succesfully cleaned up connections. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment