Skip to content

Instantly share code, notes, and snippets.

@epinzur
Created January 15, 2021 15:47
Show Gist options
  • Save epinzur/be58d46f13395d7b24d35f3ed36ade43 to your computer and use it in GitHub Desktop.
Save epinzur/be58d46f13395d7b24d35f3ed36ade43 to your computer and use it in GitHub Desktop.
linkerd-proxy fail-fast logs
Jan 15 16:34:57.783 WARN ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47800 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_app_core::errors: Failed to proxy request: error trying to connect: Connection refused (os error 111)\n
Jan 15 16:34:57.783 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47800 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_app_core::errors: Closing server-side connection\n
Jan 15 16:34:57.783 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47800 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_app_core::errors: Handling error with HTTP response status=502 Bad Gateway version=HTTP/2.0\n
Jan 15 16:34:57.783 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47800 target.addr=10.110.80.70:8558}: linkerd2_proxy_http::detect: The stack is tearing down the connection\n
Jan 15 16:34:57.783 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47800 target.addr=10.110.80.70:8558}: linkerd2_app_core::serve: Connection closed\n
Jan 15 16:34:57.889 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}: linkerd2_proxy_transport::tls::accept: Peeked bytes from TCP stream sz=285\n
Jan 15 16:34:57.891 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}: linkerd2_app_inbound::require_identity_for_ports: port=8558 peer.id=Some("egret-sandbox.sandbox.serviceaccount.identity.linkerd.cluster.local") id_required=false\n
Jan 15 16:34:57.891 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}: linkerd2_proxy_transport::prefix: Buffering prefix capacity=8192\n
Jan 15 16:34:57.891 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}: linkerd2_proxy_http::detect: Handling as H2\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_proxy_http::orig_proto: translating HTTP2 to orig-proto: "HTTP/1.1"\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:46856 target.addr=10.110.80.70:8558}:http{v=h2}:http1{name=marlin-0.marlin-internal:8558}:profile:http1: linkerd2_proxy_http::client: method=GET uri=http://marlin-0.marlin-internal:8558/ready version=HTTP/1.1\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:46856 target.addr=10.110.80.70:8558}:http{v=h2}:http1{name=marlin-0.marlin-internal:8558}:profile:http1: linkerd2_proxy_http::client: headers={"host": "marlin-0.marlin-internal:8558", "user-agent": "Go-http-client/1.1", "accept-encoding": "gzip"}\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:46856 target.addr=10.110.80.70:8558}:http{v=h2}:http1{name=marlin-0.marlin-internal:8558}:profile:http1: linkerd2_app_inbound::prevent_loop: addr=127.0.0.1:8558 self.port=4143\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:46856 target.addr=10.110.80.70:8558}:http{v=h2}:http1{name=marlin-0.marlin-internal:8558}:profile:http1: linkerd2_proxy_transport::connect: Connecting peer.addr=127.0.0.1:8558\n
Jan 15 16:34:57.892 WARN ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_app_core::errors: Failed to proxy request: error trying to connect: Connection refused (os error 111)\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_app_core::errors: Closing server-side connection\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}:http{v=h2}: linkerd2_app_core::errors: Handling error with HTTP response status=502 Bad Gateway version=HTTP/2.0\n
Jan 15 16:34:57.892 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}: linkerd2_proxy_http::detect: The stack is tearing down the connection\n
Jan 15 16:34:57.893 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:47812 target.addr=10.110.80.70:8558}: linkerd2_app_core::serve: Connection closed\n
Jan 15 16:34:58.081 DEBUG ThreadId(02) daemon:admin{listen.addr=0.0.0.0:4191}:accept{peer.addr=10.110.83.96:40702 target.addr=10.110.80.70:4191}: linkerd2_proxy_transport::tls::accept: Peeked bytes from TCP stream sz=119\n
Jan 15 16:34:58.081 DEBUG ThreadId(02) daemon:admin{listen.addr=0.0.0.0:4191}:accept{peer.addr=10.110.83.96:40702 target.addr=10.110.80.70:4191}: linkerd2_app_core::serve: Connection closed\n
Jan 15 16:35:00.200 DEBUG ThreadId(01) opencensus: linkerd2_dns: resolve_srv name=linkerd-collector.linkerd\n
Jan 15 16:35:00.584 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}: linkerd2_proxy_transport::tls::accept: Peeked bytes from TCP stream sz=285\n
Jan 15 16:35:00.586 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}: linkerd2_app_inbound::require_identity_for_ports: port=50051 peer.id=Some("egret-sandbox.sandbox.serviceaccount.identity.linkerd.cluster.local") id_required=false\n
Jan 15 16:35:00.586 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}: linkerd2_proxy_transport::prefix: Buffering prefix capacity=8192\n
Jan 15 16:35:00.586 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}: linkerd2_proxy_http::detect: Handling as H2\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}:profile: linkerd2_proxy_http::client: Building HTTP client settings=H2\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}:profile: linkerd2_app_inbound::prevent_loop: addr=127.0.0.1:50051 self.port=4143\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}:profile: linkerd2_proxy_transport::connect: Connecting peer.addr=127.0.0.1:50051\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_proxy_http::client: Building HTTP client settings=H2\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_app_inbound::prevent_loop: addr=127.0.0.1:50051 self.port=4143\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_proxy_transport::connect: Connecting peer.addr=127.0.0.1:50051\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_timeout::failfast: Failing\n
Jan 15 16:35:00.587 WARN ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}:http{v=h2}: linkerd2_app_core::errors: Failed to proxy request: Service in fail-fast\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}:http{v=h2}: linkerd2_app_core::errors: Closing server-side connection\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}:http{v=h2}: linkerd2_app_core::errors: Handling error with gRPC status code=Unavailable\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}: linkerd2_proxy_http::detect: The stack is tearing down the connection\n
Jan 15 16:35:00.587 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36656 target.addr=10.110.80.70:50051}: linkerd2_app_core::serve: Connection closed\n
Jan 15 16:35:00.695 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}: linkerd2_proxy_transport::tls::accept: Peeked bytes from TCP stream sz=285\n
Jan 15 16:35:00.696 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}: linkerd2_app_inbound::require_identity_for_ports: port=50051 peer.id=Some("egret-sandbox.sandbox.serviceaccount.identity.linkerd.cluster.local") id_required=false\n
Jan 15 16:35:00.696 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}: linkerd2_proxy_transport::prefix: Buffering prefix capacity=8192\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}: linkerd2_proxy_http::detect: Handling as H2\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}:profile: linkerd2_reconnect::service: Failed to connect error=Connection refused (os error 111)\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}:profile: linkerd2_reconnect::service: Recovering\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_reconnect::service: Failed to connect error=Connection refused (os error 111)\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_reconnect::service: Recovering\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_timeout::failfast: Failing\n
Jan 15 16:35:00.697 WARN ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}:http{v=h2}: linkerd2_app_core::errors: Failed to proxy request: Service in fail-fast\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}:http{v=h2}: linkerd2_app_core::errors: Closing server-side connection\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}:http{v=h2}: linkerd2_app_core::errors: Handling error with gRPC status code=Unavailable\n
Jan 15 16:35:00.697 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}: linkerd2_proxy_http::detect: The stack is tearing down the connection\n
Jan 15 16:35:00.698 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36664 target.addr=10.110.80.70:50051}: linkerd2_app_core::serve: Connection closed\n
Jan 15 16:35:00.807 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36672 target.addr=10.110.80.70:50051}: linkerd2_proxy_transport::tls::accept: Peeked bytes from TCP stream sz=285\n
Jan 15 16:35:00.808 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36672 target.addr=10.110.80.70:50051}: linkerd2_app_inbound::require_identity_for_ports: port=50051 peer.id=Some("egret-sandbox.sandbox.serviceaccount.identity.linkerd.cluster.local") id_required=false\n
Jan 15 16:35:00.808 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36672 target.addr=10.110.80.70:50051}: linkerd2_proxy_transport::prefix: Buffering prefix capacity=8192\n
Jan 15 16:35:00.809 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:36672 target.addr=10.110.80.70:50051}: linkerd2_proxy_http::detect: Handling as H2\n
Jan 15 16:35:00.809 DEBUG ThreadId(01) inbound:accept{peer.addr=10.110.16.96:35650 target.addr=10.110.80.70:50051}:http{v=h2}:http2{name=marlin-0.marlin-internal:50051}: linkerd2_timeout::failfast: Failing\n
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment