Skip to content

Instantly share code, notes, and snippets.

@manning-ncsa

manning-ncsa/log.md Secret

Last active July 4, 2021 14:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save manning-ncsa/f64c2eb43c6d295f5a5e4f4e1c64b37a to your computer and use it in GitHub Desktop.
Save manning-ncsa/f64c2eb43c6d295f5a5e4f4e1c64b37a to your computer and use it in GitHub Desktop.
Download ZIP
JupyterHub authentication problem
Raw
log.md

Successes

JupyterHub:

[I 2021-07-04 13:38:50.859 JupyterHub login:43] User logged out: vera.rubin
[I 2021-07-04 13:38:50.887 JupyterHub log:181] 302 GET /jupyter/hub/logout -> /jupyter/hub/login (@140.177.234.164) 49.96ms
[I 2021-07-04 13:38:50.919 JupyterHub log:181] 200 GET /jupyter/hub/login (@140.177.234.164) 1.77ms
[I 2021-07-04 13:39:00.537 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 0.93ms
[I 2021-07-04 13:39:00.566 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.86ms
[I 2021-07-04 13:39:00.595 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.59ms
[I 2021-07-04 13:39:02.352 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:39:02.353 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.55ms
[I 2021-07-04 13:39:08.293 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:39:28.378 JupyterHub base:757] User logged in: andrea.ghez
[I 2021-07-04 13:39:28.379 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 919.79ms
[I 2021-07-04 13:39:28.430 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (andrea.ghez@140.177.234.164) 20.63ms
[I 2021-07-04 13:39:28.542 JupyterHub spawner:1875] Attempting to create pvc claim-andrea-2eghez, with timeout 3
[I 2021-07-04 13:39:28.544 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/andrea.ghez (andrea.ghez@140.177.234.164) 84.70ms
[I 2021-07-04 13:39:28.551 JupyterHub spawner:1887] PVC claim-andrea-2eghez already exists, so did not create new pvc.
[I 2021-07-04 13:39:28.554 JupyterHub spawner:1840] Attempting to create pod jupyter-andrea-2eghez, with timeout 3
[I 2021-07-04 13:39:28.584 JupyterHub pages:402] andrea.ghez is pending spawn
[I 2021-07-04 13:39:28.585 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/andrea.ghez (andrea.ghez@140.177.234.164) 11.40ms
[I 2021-07-04 13:39:33.412 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.20) 0.90ms
[I 2021-07-04 13:39:33.486 JupyterHub log:181] 200 POST /jupyter/hub/api/users/andrea.ghez/activity (andrea.ghez@10.42.160.20) 43.10ms
[I 2021-07-04 13:39:34.264 JupyterHub base:904] User andrea.ghez took 5.796 seconds to start
[I 2021-07-04 13:39:34.265 JupyterHub proxy:257] Adding user andrea.ghez to proxy /jupyter/user/andrea.ghez/ => http://10.42.160.20:8888
[I 2021-07-04 13:39:34.269 JupyterHub users:664] Server andrea.ghez is ready
[I 2021-07-04 13:39:34.269 JupyterHub log:181] 200 GET /jupyter/hub/api/users/andrea.ghez/server/progress (andrea.ghez@140.177.234.164) 5564.40ms
[I 2021-07-04 13:39:34.310 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/andrea.ghez -> /jupyter/user/andrea.ghez/ (andrea.ghez@140.177.234.164) 10.13ms
[I 2021-07-04 13:39:34.426 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-andrea.ghez&redirect_uri=%2Fjupyter%2Fuser%2Fandrea.ghez%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/andrea.ghez/oauth_callback?code=[secret]&state=[secret] (andrea.ghez@140.177.234.164) 41.41ms
[I 2021-07-04 13:39:34.516 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (andrea.ghez@10.42.160.20) 57.25ms
[I 2021-07-04 13:39:34.555 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (andrea.ghez@10.42.160.20) 33.18ms
[I 2021-07-04 13:39:36.376 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (andrea.ghez@10.42.160.20) 28.32ms
[I 2021-07-04 13:39:50.620 JupyterHub login:43] User logged out: andrea.ghez
[I 2021-07-04 13:39:50.645 JupyterHub log:181] 302 GET /jupyter/hub/logout -> /jupyter/hub/login (@140.177.234.164) 35.77ms
[I 2021-07-04 13:39:50.687 JupyterHub log:181] 200 GET /jupyter/hub/login (@140.177.234.164) 1.68ms
[I 2021-07-04 13:39:56.098 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 0.95ms
[I 2021-07-04 13:39:56.128 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.88ms
[I 2021-07-04 13:39:56.158 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.40ms
[I 2021-07-04 13:40:01.457 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:40:01.458 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.61ms
[I 2021-07-04 13:40:08.296 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:40:15.292 JupyterHub base:757] User logged in: henrietta.leavitt
[I 2021-07-04 13:40:15.293 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 638.48ms
[I 2021-07-04 13:40:15.363 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (henrietta.leavitt@140.177.234.164) 19.35ms
[I 2021-07-04 13:40:15.483 JupyterHub spawner:1875] Attempting to create pvc claim-henrietta-2eleavitt, with timeout 3
[I 2021-07-04 13:40:15.484 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/henrietta.leavitt (henrietta.leavitt@140.177.234.164) 85.37ms
[I 2021-07-04 13:40:15.492 JupyterHub spawner:1887] PVC claim-henrietta-2eleavitt already exists, so did not create new pvc.
[I 2021-07-04 13:40:15.499 JupyterHub spawner:1840] Attempting to create pod jupyter-henrietta-2eleavitt, with timeout 3
[I 2021-07-04 13:40:15.530 JupyterHub pages:402] henrietta.leavitt is pending spawn
[I 2021-07-04 13:40:15.532 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/henrietta.leavitt (henrietta.leavitt@140.177.234.164) 12.96ms
[I 2021-07-04 13:40:19.270 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.24) 0.89ms
[I 2021-07-04 13:40:19.337 JupyterHub log:181] 200 POST /jupyter/hub/api/users/henrietta.leavitt/activity (henrietta.leavitt@10.42.160.24) 42.47ms
[I 2021-07-04 13:40:19.433 JupyterHub base:904] User henrietta.leavitt took 4.025 seconds to start
[I 2021-07-04 13:40:19.433 JupyterHub proxy:257] Adding user henrietta.leavitt to proxy /jupyter/user/henrietta.leavitt/ => http://10.42.160.24:8888
[I 2021-07-04 13:40:19.438 JupyterHub users:664] Server henrietta.leavitt is ready
[I 2021-07-04 13:40:19.438 JupyterHub log:181] 200 GET /jupyter/hub/api/users/henrietta.leavitt/server/progress (henrietta.leavitt@140.177.234.164) 3661.18ms
[I 2021-07-04 13:40:19.498 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/henrietta.leavitt -> /jupyter/user/henrietta.leavitt/ (henrietta.leavitt@140.177.234.164) 10.21ms
[I 2021-07-04 13:40:19.677 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-henrietta.leavitt&redirect_uri=%2Fjupyter%2Fuser%2Fhenrietta.leavitt%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/henrietta.leavitt/oauth_callback?code=[secret]&state=[secret] (henrietta.leavitt@140.177.234.164) 36.94ms
[I 2021-07-04 13:40:19.771 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (henrietta.leavitt@10.42.160.24) 55.91ms
[I 2021-07-04 13:40:19.807 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (henrietta.leavitt@10.42.160.24) 30.63ms
[I 2021-07-04 13:40:21.818 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (henrietta.leavitt@10.42.160.24) 29.43ms
	[W 2021-07-04 13:41:13.269 JupyterHub proxy:814] api_request to the proxy failed with status code 599, retrying...
[I 2021-07-04 13:41:13.392 JupyterHub proxy:319] Checking routes




[I 2021-07-04 13:41:41.638 JupyterHub login:43] User logged out: henrietta.leavitt
[I 2021-07-04 13:41:41.661 JupyterHub log:181] 302 GET /jupyter/hub/logout -> /jupyter/hub/login (@140.177.234.164) 33.84ms
[I 2021-07-04 13:41:41.697 JupyterHub log:181] 200 GET /jupyter/hub/login (@140.177.234.164) 1.68ms
[I 2021-07-04 13:41:42.128 JupyterHub log:181] 200 POST /jupyter/hub/api/users/vera.rubin/activity (vera.rubin@10.42.160.17) 36.81ms
[I 2021-07-04 13:41:51.301 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 0.90ms
[I 2021-07-04 13:41:51.329 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.68ms
[I 2021-07-04 13:41:51.354 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.46ms
[I 2021-07-04 13:41:57.836 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:41:57.837 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.71ms
[I 2021-07-04 13:42:08.298 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:42:14.929 JupyterHub base:757] User logged in: helen.hogg
[I 2021-07-04 13:42:14.929 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 1076.45ms
[I 2021-07-04 13:42:14.987 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (helen.hogg@140.177.234.164) 19.70ms
[I 2021-07-04 13:42:15.107 JupyterHub spawner:1875] Attempting to create pvc claim-helen-2ehogg, with timeout 3
[I 2021-07-04 13:42:15.109 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/helen.hogg (helen.hogg@140.177.234.164) 84.97ms
[I 2021-07-04 13:42:15.120 JupyterHub spawner:1840] Attempting to create pod jupyter-helen-2ehogg, with timeout 3
[I 2021-07-04 13:42:15.158 JupyterHub pages:402] helen.hogg is pending spawn
[I 2021-07-04 13:42:15.159 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/helen.hogg (helen.hogg@140.177.234.164) 12.33ms
[I 2021-07-04 13:42:21.944 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.29) 0.93ms
[I 2021-07-04 13:42:22.000 JupyterHub log:181] 200 POST /jupyter/hub/api/users/helen.hogg/activity (helen.hogg@10.42.160.29) 40.77ms
[I 2021-07-04 13:42:24.148 JupyterHub base:904] User helen.hogg took 9.114 seconds to start
[I 2021-07-04 13:42:24.149 JupyterHub proxy:257] Adding user helen.hogg to proxy /jupyter/user/helen.hogg/ => http://10.42.160.29:8888
[I 2021-07-04 13:42:24.154 JupyterHub users:664] Server helen.hogg is ready
[I 2021-07-04 13:42:24.154 JupyterHub log:181] 200 GET /jupyter/hub/api/users/helen.hogg/server/progress (helen.hogg@140.177.234.164) 8750.38ms
[I 2021-07-04 13:42:24.211 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/helen.hogg -> /jupyter/user/helen.hogg/ (helen.hogg@140.177.234.164) 9.25ms
[I 2021-07-04 13:42:24.341 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-helen.hogg&redirect_uri=%2Fjupyter%2Fuser%2Fhelen.hogg%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/helen.hogg/oauth_callback?code=[secret]&state=[secret] (helen.hogg@140.177.234.164) 37.94ms
[I 2021-07-04 13:42:24.434 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (helen.hogg@10.42.160.29) 58.27ms
[I 2021-07-04 13:42:24.471 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (helen.hogg@10.42.160.29) 32.05ms
[I 2021-07-04 13:42:26.504 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (helen.hogg@10.42.160.29) 28.43ms


[I 2021-07-04 13:43:08.306 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:43:08.421 JupyterHub log:181] 200 GET /jupyter/hub/api/users (cull-idle@127.0.0.1) 31.30ms
[I 2021-07-04 13:43:39.445 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 0.92ms
[I 2021-07-04 13:43:39.493 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.90ms
[I 2021-07-04 13:43:39.525 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.59ms
[I 2021-07-04 13:43:41.005 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:43:41.006 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.67ms
[I 2021-07-04 13:44:00.938 JupyterHub base:757] User logged in: eleanor.helin
[I 2021-07-04 13:44:00.938 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 1899.34ms
[I 2021-07-04 13:44:00.986 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (eleanor.helin@140.177.234.164) 19.01ms
[I 2021-07-04 13:44:01.098 JupyterHub spawner:1875] Attempting to create pvc claim-eleanor-2ehelin, with timeout 3
[I 2021-07-04 13:44:01.100 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/eleanor.helin (eleanor.helin@140.177.234.164) 85.74ms
[I 2021-07-04 13:44:01.110 JupyterHub spawner:1840] Attempting to create pod jupyter-eleanor-2ehelin, with timeout 3
[I 2021-07-04 13:44:01.138 JupyterHub pages:402] eleanor.helin is pending spawn
[I 2021-07-04 13:44:01.140 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/eleanor.helin (eleanor.helin@140.177.234.164) 14.08ms
[I 2021-07-04 13:44:05.662 JupyterHub base:904] User eleanor.helin took 4.638 seconds to start
[I 2021-07-04 13:44:05.662 JupyterHub proxy:257] Adding user eleanor.helin to proxy /jupyter/user/eleanor.helin/ => http://10.42.160.31:8888
[I 2021-07-04 13:44:05.668 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.31) 0.92ms
[I 2021-07-04 13:44:05.669 JupyterHub users:664] Server eleanor.helin is ready
[I 2021-07-04 13:44:05.669 JupyterHub log:181] 200 GET /jupyter/hub/api/users/eleanor.helin/server/progress (eleanor.helin@140.177.234.164) 4365.95ms
[I 2021-07-04 13:44:05.730 JupyterHub log:181] 200 POST /jupyter/hub/api/users/eleanor.helin/activity (eleanor.helin@10.42.160.31) 48.57ms
[I 2021-07-04 13:44:05.739 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/eleanor.helin -> /jupyter/user/eleanor.helin/ (eleanor.helin@140.177.234.164) 8.51ms
[I 2021-07-04 13:44:05.849 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-eleanor.helin&redirect_uri=%2Fjupyter%2Fuser%2Feleanor.helin%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/eleanor.helin/oauth_callback?code=[secret]&state=[secret] (eleanor.helin@140.177.234.164) 35.01ms
[I 2021-07-04 13:44:05.941 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (eleanor.helin@10.42.160.31) 55.59ms
[I 2021-07-04 13:44:05.978 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (eleanor.helin@10.42.160.31) 33.30ms
[I 2021-07-04 13:44:07.918 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (eleanor.helin@10.42.160.31) 29.84ms
[I 2021-07-04 13:44:08.299 JupyterHub proxy:319] Checking routes



[I 2021-07-04 13:45:08.306 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:45:53.541 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 0.96ms
[I 2021-07-04 13:45:53.567 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.75ms
[I 2021-07-04 13:45:53.594 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.51ms
[I 2021-07-04 13:45:55.882 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:45:55.883 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.61ms
[I 2021-07-04 13:46:08.310 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:46:17.669 JupyterHub base:757] User logged in: annie.cannon
[I 2021-07-04 13:46:17.670 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 3467.74ms
[I 2021-07-04 13:46:17.720 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (annie.cannon@140.177.234.164) 21.31ms
[I 2021-07-04 13:46:17.834 JupyterHub spawner:1875] Attempting to create pvc claim-annie-2ecannon, with timeout 3
[I 2021-07-04 13:46:17.837 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/annie.cannon (annie.cannon@140.177.234.164) 87.77ms
[I 2021-07-04 13:46:17.842 JupyterHub spawner:1887] PVC claim-annie-2ecannon already exists, so did not create new pvc.
[I 2021-07-04 13:46:17.846 JupyterHub spawner:1840] Attempting to create pod jupyter-annie-2ecannon, with timeout 3
[I 2021-07-04 13:46:17.871 JupyterHub pages:402] annie.cannon is pending spawn
[I 2021-07-04 13:46:17.872 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/annie.cannon (annie.cannon@140.177.234.164) 9.77ms
[I 2021-07-04 13:46:22.228 JupyterHub base:904] User annie.cannon took 4.470 seconds to start
[I 2021-07-04 13:46:22.228 JupyterHub proxy:257] Adding user annie.cannon to proxy /jupyter/user/annie.cannon/ => http://10.42.160.32:8888
[I 2021-07-04 13:46:22.233 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.32) 0.98ms
[I 2021-07-04 13:46:22.234 JupyterHub users:664] Server annie.cannon is ready
[I 2021-07-04 13:46:22.235 JupyterHub log:181] 200 GET /jupyter/hub/api/users/annie.cannon/server/progress (annie.cannon@140.177.234.164) 4230.01ms
[I 2021-07-04 13:46:22.307 JupyterHub log:181] 200 POST /jupyter/hub/api/users/annie.cannon/activity (annie.cannon@10.42.160.32) 43.25ms
[I 2021-07-04 13:46:22.316 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/annie.cannon -> /jupyter/user/annie.cannon/ (annie.cannon@140.177.234.164) 8.65ms
[I 2021-07-04 13:46:22.446 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-annie.cannon&redirect_uri=%2Fjupyter%2Fuser%2Fannie.cannon%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/annie.cannon/oauth_callback?code=[secret]&state=[secret] (annie.cannon@140.177.234.164) 39.42ms
[I 2021-07-04 13:46:22.541 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (annie.cannon@10.42.160.32) 60.06ms
[I 2021-07-04 13:46:22.576 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (annie.cannon@10.42.160.32) 30.14ms
[I 2021-07-04 13:46:24.815 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (annie.cannon@10.42.160.32) 31.88ms




[I 2021-07-04 13:46:40.229 JupyterHub log:181] 200 POST /jupyter/hub/api/users/vera.rubin/activity (vera.rubin@10.42.160.17) 39.04ms
[I 2021-07-04 13:47:08.308 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:47:10.781 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 1.02ms
[I 2021-07-04 13:47:10.810 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.67ms
[I 2021-07-04 13:47:10.840 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.62ms
[I 2021-07-04 13:47:12.602 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:47:12.604 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.80ms
[I 2021-07-04 13:47:40.005 JupyterHub log:181] 200 POST /jupyter/hub/api/users/helen.hogg/activity (helen.hogg@10.42.160.29) 49.31ms
[I 2021-07-04 13:47:41.987 JupyterHub base:757] User logged in: amy.mainzer
[I 2021-07-04 13:47:41.988 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 6670.81ms
[I 2021-07-04 13:47:42.109 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (amy.mainzer@140.177.234.164) 21.21ms
[I 2021-07-04 13:47:42.249 JupyterHub spawner:1875] Attempting to create pvc claim-amy-2emainzer, with timeout 3
[I 2021-07-04 13:47:42.251 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/amy.mainzer (amy.mainzer@140.177.234.164) 87.23ms
[I 2021-07-04 13:47:42.258 JupyterHub spawner:1887] PVC claim-amy-2emainzer already exists, so did not create new pvc.
[I 2021-07-04 13:47:42.317 JupyterHub spawner:1840] Attempting to create pod jupyter-amy-2emainzer, with timeout 3
[I 2021-07-04 13:47:42.346 JupyterHub pages:402] amy.mainzer is pending spawn
[I 2021-07-04 13:47:42.347 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/amy.mainzer (amy.mainzer@140.177.234.164) 10.42ms
[I 2021-07-04 13:47:46.627 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.33) 0.91ms
[I 2021-07-04 13:47:46.683 JupyterHub log:181] 200 POST /jupyter/hub/api/users/amy.mainzer/activity (amy.mainzer@10.42.160.33) 40.94ms
[I 2021-07-04 13:47:49.657 JupyterHub base:904] User amy.mainzer took 7.484 seconds to start
[I 2021-07-04 13:47:49.657 JupyterHub proxy:257] Adding user amy.mainzer to proxy /jupyter/user/amy.mainzer/ => http://10.42.160.33:8888
[I 2021-07-04 13:47:49.662 JupyterHub users:664] Server amy.mainzer is ready
[I 2021-07-04 13:47:49.663 JupyterHub log:181] 200 GET /jupyter/hub/api/users/amy.mainzer/server/progress (amy.mainzer@140.177.234.164) 7182.49ms
[I 2021-07-04 13:47:49.726 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/amy.mainzer -> /jupyter/user/amy.mainzer/ (amy.mainzer@140.177.234.164) 9.37ms
[I 2021-07-04 13:47:49.851 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-amy.mainzer&redirect_uri=%2Fjupyter%2Fuser%2Famy.mainzer%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/amy.mainzer/oauth_callback?code=[secret]&state=[secret] (amy.mainzer@140.177.234.164) 35.91ms
[I 2021-07-04 13:47:49.945 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (amy.mainzer@10.42.160.33) 56.77ms
[I 2021-07-04 13:47:49.983 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (amy.mainzer@10.42.160.33) 31.82ms
[I 2021-07-04 13:47:51.945 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (amy.mainzer@10.42.160.33) 29.76ms



[I 2021-07-04 13:48:08.312 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:48:24.879 JupyterHub log:181] 302 GET /jupyter -> /jupyter/hub/ (@140.177.234.164) 1.15ms
[I 2021-07-04 13:48:24.903 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 0.94ms
[I 2021-07-04 13:48:24.930 JupyterHub log:181] 200 GET /jupyter/hub/login?next=%2Fjupyter%2Fhub%2F (@140.177.234.164) 1.80ms
[I 2021-07-04 13:48:26.782 JupyterHub oauth2:104] OAuth redirect: 'https://example.com/jupyter/hub/oauth_callback'
[I 2021-07-04 13:48:26.784 JupyterHub log:181] 302 GET /jupyter/hub/oauth_login?next=%2Fjupyter%2Fhub%2F -> https://cloud.example.com/apps/oauth2/authorize?response_type=code&redirect_uri=https%3A%2F%2Fexample.com%2Fjupyter%2Fhub%2Foauth_callback&client_id=C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp&state=[secret] (@140.177.234.164) 1.67ms
[I 2021-07-04 13:49:04.347 JupyterHub log:181] 200 POST /jupyter/hub/api/users/eleanor.helin/activity (eleanor.helin@10.42.160.31) 41.40ms
[I 2021-07-04 13:49:07.127 JupyterHub base:757] User logged in: maura.tombelli
[I 2021-07-04 13:49:07.127 JupyterHub log:181] 302 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] -> /jupyter/hub/ (@140.177.234.164) 13171.30ms
[I 2021-07-04 13:49:07.225 JupyterHub log:181] 302 GET /jupyter/hub/ -> /jupyter/hub/spawn (maura.tombelli@140.177.234.164) 20.16ms
[I 2021-07-04 13:49:07.397 JupyterHub spawner:1875] Attempting to create pvc claim-maura-2etombelli, with timeout 3
[I 2021-07-04 13:49:07.399 JupyterHub log:181] 302 GET /jupyter/hub/spawn -> /jupyter/hub/spawn-pending/maura.tombelli (maura.tombelli@140.177.234.164) 84.67ms
[I 2021-07-04 13:49:07.410 JupyterHub spawner:1840] Attempting to create pod jupyter-maura-2etombelli, with timeout 3
[I 2021-07-04 13:49:07.500 JupyterHub pages:402] maura.tombelli is pending spawn
[I 2021-07-04 13:49:07.501 JupyterHub log:181] 200 GET /jupyter/hub/spawn-pending/maura.tombelli (maura.tombelli@140.177.234.164) 14.07ms
[I 2021-07-04 13:49:08.307 JupyterHub proxy:319] Checking routes
[I 2021-07-04 13:49:11.990 JupyterHub base:904] User maura.tombelli took 4.667 seconds to start
[I 2021-07-04 13:49:11.990 JupyterHub proxy:257] Adding user maura.tombelli to proxy /jupyter/user/maura.tombelli/ => http://10.42.160.34:8888
[I 2021-07-04 13:49:11.994 JupyterHub users:664] Server maura.tombelli is ready
[I 2021-07-04 13:49:11.995 JupyterHub log:181] 200 GET /jupyter/hub/api/users/maura.tombelli/server/progress (maura.tombelli@140.177.234.164) 4244.64ms
[I 2021-07-04 13:49:11.997 JupyterHub log:181] 200 GET /jupyter/hub/api (@10.42.160.34) 0.87ms
[I 2021-07-04 13:49:12.065 JupyterHub log:181] 200 POST /jupyter/hub/api/users/maura.tombelli/activity (maura.tombelli@10.42.160.34) 51.09ms
[I 2021-07-04 13:49:12.076 JupyterHub log:181] 302 GET /jupyter/hub/spawn-pending/maura.tombelli -> /jupyter/user/maura.tombelli/ (maura.tombelli@140.177.234.164) 9.89ms
[I 2021-07-04 13:49:12.203 JupyterHub log:181] 302 GET /jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-maura.tombelli&redirect_uri=%2Fjupyter%2Fuser%2Fmaura.tombelli%2Foauth_callback&response_type=code&state=[secret] -> /jupyter/user/maura.tombelli/oauth_callback?code=[secret]&state=[secret] (maura.tombelli@140.177.234.164) 36.80ms
[I 2021-07-04 13:49:12.300 JupyterHub log:181] 200 POST /jupyter/hub/api/oauth2/token (maura.tombelli@10.42.160.34) 59.55ms
[I 2021-07-04 13:49:12.341 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (maura.tombelli@10.42.160.34) 35.36ms
[I 2021-07-04 13:49:14.464 JupyterHub log:181] 200 GET /jupyter/hub/api/authorizations/token/[secret] (maura.tombelli@10.42.160.34) 32.49ms

Nextcloud:

{"reqId":"uuXkY6fcegzkBfcSuHSy","level":2,"time":"2021-07-04T13:39:28+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

{"reqId":"C8FiQsBKjQvZd6PtbVQ6","level":2,"time":"2021-07-04T13:40:15+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

{"reqId":"qUt7MFP121deeP4RUUhK","level":2,"time":"2021-07-04T13:42:14+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

{"reqId":"5ZoxnYKwGhYMOYOm0vSv","level":2,"time":"2021-07-04T13:44:00+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

{"reqId":"hiCCm1vgQj0Y0zBDanHk","level":2,"time":"2021-07-04T13:46:17+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

{"reqId":"9lAIkfXtjP5xXxmmBe0j","level":2,"time":"2021-07-04T13:47:41+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

{"reqId":"S9LBxQ2bvZOWb2aEzKaT","level":2,"time":"2021-07-04T13:49:06+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}

Failure

JupyterHub:


[I 2021-07-04 13:51:33.532 JupyterHub log:181] 200 POST /jupyter/hub/api/users/vera.rubin/activity (vera.rubin@10.42.160.17) 39.69ms
[E 2021-07-04 13:51:45.576 JupyterHub web:1789] Uncaught exception GET /jupyter/hub/oauth_callback?state=eyJzdGF0ZV9pZCI6ICJkZThiMjc5MTJlYTQ0ODc1YjUyMGEwM2ViMGMzNjc0NyIsICJuZXh0X3VybCI6ICIvanVweXRlci9odWIvIn0%3D&code=E8Fik9HRnOJDWlUsPFjdfg1CN9c9RzBksQKlpOsfzmRsfdo6sAQo4bbxXXkxm3NAXjVegnDzGxdgLzUrpP8rWx6trd3qk4A1CCHJPJImyxvzHVIsQHGEutSZJ3UuBfMK (140.177.234.164)
    HTTPServerRequest(protocol='http', host='example.com', method='GET', uri='/jupyter/hub/oauth_callback?state=eyJzdGF0ZV9pZCI6ICJkZThiMjc5MTJlYTQ0ODc1YjUyMGEwM2ViMGMzNjc0NyIsICJuZXh0X3VybCI6ICIvanVweXRlci9odWIvIn0%3D&code=E8Fik9HRnOJDWlUsPFjdfg1CN9c9RzBksQKlpOsfzmRsfdo6sAQo4bbxXXkxm3NAXjVegnDzGxdgLzUrpP8rWx6trd3qk4A1CCHJPJImyxvzHVIsQHGEutSZJ3UuBfMK', version='HTTP/1.1', remote_ip='140.177.234.164')
    Traceback (most recent call last):
      File "/usr/local/lib/python3.8/dist-packages/tornado/web.py", line 1704, in _execute
        result = await result
      File "/usr/local/lib/python3.8/dist-packages/oauthenticator/oauth2.py", line 224, in get
        user = await self.login_user()
      File "/usr/local/lib/python3.8/dist-packages/jupyterhub/handlers/base.py", line 749, in login_user
        authenticated = await self.authenticate(data)
      File "/usr/local/lib/python3.8/dist-packages/jupyterhub/auth.py", line 462, in get_authenticated_user
        authenticated = await maybe_future(self.authenticate(handler, data))
      File "/usr/local/lib/python3.8/dist-packages/oauthenticator/generic.py", line 155, in authenticate
        token_resp_json = await self._get_token(http_client, headers, params)
      File "/usr/local/lib/python3.8/dist-packages/oauthenticator/generic.py", line 97, in _get_token
        resp = await http_client.fetch(req)
    tornado.curl_httpclient.CurlError: HTTP 599: Operation timed out after 20000 milliseconds with 0 bytes received
    
[E 2021-07-04 13:51:45.604 JupyterHub log:173] {
      "X-Real-Ip": "140.177.234.164",
      "X-Forwarded-Server": "traefik-5684766988-sj49c",
      "X-Forwarded-Proto": "https,http",
      "X-Forwarded-Port": "443,80",
      "X-Forwarded-Host": "example.com",
      "X-Forwarded-For": "140.177.234.164,::ffff:10.42.160.30",
      "Upgrade-Insecure-Requests": "1",
      "Te": "trailers",
      "Dnt": "1",
      "Cookie": "oauthenticator-state=[secret]",
      "Accept-Language": "en-US,en;q=0.5",
      "Accept-Encoding": "gzip, deflate, br",
      "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8",
      "User-Agent": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:89.0) Gecko/20100101 Firefox/89.0",
      "Host": "example.com",
      "Connection": "close"
    }
[E 2021-07-04 13:51:45.604 JupyterHub log:181] 500 GET /jupyter/hub/oauth_callback?state=[secret]&code=[secret] (@140.177.234.164) 20030.49ms

Nextcloud:

{"reqId":"EB1wQ4COXvTMkPBIrW6g","level":2,"time":"2021-07-04T13:51:50+00:00","remoteAddr":"x.y.216.48","user":"--","app":"core","method":"POST","url":"/apps/oauth2/api/v1/token","message":"Login failed: 'C5UWHxTlbk7RwvDhsPoL8oZ640mORcJq5po6H4s9zyMy9xyOgoLOL0e66VZqUDKp' (Remote IP: 'x.y.216.48')","userAgent":"JupyterHub","version":"21.0.2.1"}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment