Skip to content

Instantly share code, notes, and snippets.

@mikhno-s
Created March 16, 2021 12:58
Show Gist options
  • Save mikhno-s/30d01c27bc57f9f02f879606b83d50ed to your computer and use it in GitHub Desktop.
Save mikhno-s/30d01c27bc57f9f02f879606b83d50ed to your computer and use it in GitHub Desktop.
vector debug log
Mar 16 10:09:55.704 INFO vector::app: Log level is enabled. level="vector=trace,codec=trace,vrl=trace,file_source=trace,tower_limit=trace"
Mar 16 10:09:55.704 INFO vector::sources::host_metrics: PROCFS_ROOT is unset. Using default '/proc' for procfs root.
Mar 16 10:09:55.704 INFO vector::sources::host_metrics: SYSFS_ROOT is unset. Using default '/sys' for sysfs root.
Mar 16 10:09:55.704 INFO vector::app: Loading configs. path=[("/etc/vector/envoy-logs.toml", None), ("/etc/vector/vector.toml", None)]
Mar 16 10:09:57.859 DEBUG vector::buffers::disk::leveldb_buffer: Compacting disk buffer.
Mar 16 10:10:05.379 DEBUG vector::buffers::disk::leveldb_buffer: Compacting disk buffer.
Mar 16 10:10:05.389 DEBUG vector::tls::settings: Fetching system root certs.
Mar 16 10:10:05.389 DEBUG vector::rusoto: Using default credentials provider for AWS.
Mar 16 10:10:05.389 INFO vector::topology: Running healthchecks.
Mar 16 10:10:05.389 INFO vector::topology: Starting source. name="internal_metrics"
Mar 16 10:10:05.390 INFO vector::topology: Starting source. name="in_envoy_logs"
Mar 16 10:10:05.390 INFO vector::topology: Starting sink. name="prometheus_exporter"
Mar 16 10:10:05.390 INFO vector::topology: Starting sink. name="s3_logs"
Mar 16 10:10:05.390 INFO vector: Vector has started. version="0.12.0" git_version="v0.12.0" released="Wed, 10 Mar 2021 15:03:01 +0000" arch="x86_64"
Mar 16 10:10:05.390 INFO vector::internal_events::api: API server running. address=127.0.0.1:8686 playground=http://127.0.0.1:8686/playground
Mar 16 10:10:05.390 INFO source{component_kind="source" component_name=in_envoy_logs component_type=file}: vector::sources::file: Starting file server. include=["/var/log/envoy/ingress.log"] exclude=["*gz"]
Mar 16 10:10:05.390 INFO source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::checkpointer: Loaded checkpoint data.
Mar 16 10:10:05.392 INFO source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: vector::internal_events::file::source: Resuming to watch file. path=/var/log/envoy/ingress.log file_position=1391905158
Mar 16 10:10:05.392 DEBUG sink{component_kind="sink" component_name=prometheus_exporter component_type=prometheus_exporter}: vector::utilization: utilization=0.017884733401345332
Mar 16 10:10:05.393 TRACE vector: Beep.
Mar 16 10:10:05.401 DEBUG http: vector::internal_events::http_client: Sending HTTP request. uri=https://s3.us-east-1.amazonaws.com/some_bucket method=HEAD version=HTTP/1.1 headers={"authorization": Sensitive, "content-length": "0", "content-type": "application/octet-stream", "host": "s3.us-east-1.amazonaws.com", "x-amz-content-sha256": "yhgy", "x-amz-date": "20210316T101005Z", "user-agent": "Vector/0.12.0 (v0.12.0 x86_64-unknown-linux-gnu 2021-03-10)", "accept-encoding": "identity"} body=[unknown]
Mar 16 10:10:05.401 INFO vector::topology::builder: Healthcheck: Passed.
Mar 16 10:10:05.401 TRACE vector::sinks::kafka: Healthcheck started.
Mar 16 10:10:05.409 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:06.201 DEBUG sink{component_kind="sink" component_name=s3_logs component_type=aws_s3}: vector::utilization: utilization=0.0004279871231208654
Mar 16 10:10:06.221 DEBUG http: vector::internal_events::http_client: HTTP response. status=200 OK version=HTTP/1.1 headers={"x-amz-id-2": "", "x-amz-request-id": "R34GC89AA9QJG19Z", "date": "Tue, 16 Mar 2021 10:10:07 GMT", "x-amz-bucket-region": "us-east-1", "content-type": "application/xml", "server": "AmazonS3"} body=[empty]
Mar 16 10:10:06.221 INFO vector::topology::builder: Healthcheck: Passed.
Mar 16 10:10:06.393 TRACE vector: Beep.
Mar 16 10:10:06.397 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=3
Mar 16 10:10:06.528 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=1.667k/sec bytes_throughput=2.282m/sec ratios={"discovery": 0.015691515, "other": 0.0010528311, "reading": 0.012417935, "sending": 0.11171997, "sleeping": 0.859118}
Mar 16 10:10:06.528 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:06.683 TRACE vector::sinks::kafka: Healthcheck completed.
Mar 16 10:10:06.683 INFO vector::topology::builder: Healthcheck: Passed.
Mar 16 10:10:07.393 TRACE vector: Beep.
Mar 16 10:10:07.401 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=2
Mar 16 10:10:08.066 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=833.000/sec bytes_throughput=1.141m/sec ratios={"discovery": 0.006800139, "other": 0.00048160483, "reading": 0.0052775885, "sending": 0.04745183, "sleeping": 0.93998885}
Mar 16 10:10:08.067 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:08.393 TRACE vector: Beep.
Mar 16 10:10:08.405 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=3
Mar 16 10:10:09.101 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=571.000/sec bytes_throughput=782.884k/sec ratios={"discovery": 0.004999738, "other": 0.000394569, "reading": 0.0039278176, "sending": 0.03504781, "sleeping": 0.9556301}
Mar 16 10:10:09.102 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:09.393 TRACE vector: Beep.
Mar 16 10:10:09.409 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=3
Mar 16 10:10:10.137 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=441.000/sec bytes_throughput=603.582k/sec ratios={"discovery": 0.0039967964, "other": 0.00036062184, "reading": 0.0032503929, "sending": 0.028191442, "sleeping": 0.96420085}
Mar 16 10:10:10.138 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:10.391 DEBUG sink{component_kind="sink" component_name=prometheus_exporter component_type=prometheus_exporter}: vector::utilization: utilization=0.0018387265802431436
Mar 16 10:10:10.391 DEBUG sink{component_kind="sink" component_name=s3_logs component_type=aws_s3}: vector::utilization: utilization=0.6249678553362783
Mar 16 10:10:10.393 TRACE vector: Beep.
Mar 16 10:10:10.393 DEBUG sink{component_kind="sink" component_name=payment_service_web_kafka component_type=kafka}: vector::utilization: utilization=0.001174318747608327
Mar 16 10:10:10.414 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=3
Mar 16 10:10:11.162 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=352.000/sec bytes_throughput=482.865k/sec ratios={"discovery": 0.0033495517, "other": 0.00030625492, "reading": 0.0026738027, "sending": 0.02318661, "sleeping": 0.97048384}
Mar 16 10:10:11.162 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:11.394 TRACE vector: Beep.
Mar 16 10:10:11.448 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=34
Mar 16 10:10:12.393 TRACE vector: Beep.
Mar 16 10:10:12.453 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=3
Mar 16 10:10:12.461 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=262.000/sec bytes_throughput=358.681k/sec ratios={"discovery": 0.002786438, "other": 0.0002850018, "reading": 0.0024990921, "sending": 0.019707836, "sleeping": 0.97472167}
Mar 16 10:10:12.462 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:13.393 TRACE vector: Beep.
Mar 16 10:10:13.457 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=2
Mar 16 10:10:13.487 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=229.000/sec bytes_throughput=313.846k/sec ratios={"discovery": 0.00247724, "other": 0.00025546862, "reading": 0.002183042, "sending": 0.017212255, "sleeping": 0.9778721}
Mar 16 10:10:13.487 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Mar 16 10:10:14.393 TRACE vector: Beep.
Mar 16 10:10:14.462 DEBUG vector::internal_events::file::source: Files checkpointed. count=1 duration_ms=3
Mar 16 10:10:14.522 DEBUG source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: event_throughput=209.000/sec bytes_throughput=286.365k/sec ratios={"discovery": 0.0022411202, "other": 0.0002484802, "reading": 0.0019989433, "sending": 0.015650317, "sleeping": 0.97986114}
Mar 16 10:10:14.523 TRACE source{component_kind="source" component_name=in_envoy_logs component_type=file}:file_server: file_source::file_server: Continue watching file. path="/var/log/envoy/ingress.log"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment