Skip to content

Instantly share code, notes, and snippets.

@jcsorvasi

jcsorvasi/gist:d442dc1f2c9076804c14229466cce140

Created May 14, 2018 08:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jcsorvasi/d442dc1f2c9076804c14229466cce140 to your computer and use it in GitHub Desktop.
Save jcsorvasi/d442dc1f2c9076804c14229466cce140 to your computer and use it in GitHub Desktop.
Download ZIP
filebeat debug logs
Raw
gistfile1.txt
May 14th 2018, 08:51:15.822 DEBUG Got a start event: map[meta:{"kubernetes":{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}}} config:[0xc4207ce0c0] start:true host:10.103.22.210 kubernetes:{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"id":"ab74190f32571c3f86f0df1e2d55155915c46d28411b034b00fe125a543b1018","image":"docker.elastic.co/beats/filebeat:6.2.3","name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}}], generated configs: [0xc4207ce0c0]
May 14th 2018, 08:51:15.822 DEBUG Got a stop event: map[config:[0xc4206b43f0] stop:true host:10.103.22.210 kubernetes:{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"id":"ab74190f32571c3f86f0df1e2d55155915c46d28411b034b00fe125a543b1018","image":"docker.elastic.co/beats/filebeat:6.2.3","name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}} meta:{"kubernetes":{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}}}], generated configs: [0xc4206b43f0]
May 14th 2018, 08:36:54.151 INFO Harvester started for file: /var/lib/docker/containers/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f-json.log
May 14th 2018, 08:36:54.151 INFO Configured paths: [/var/lib/docker/containers/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f/*.log]
May 14th 2018, 08:36:54.151 WARN EXPERIMENTAL: Docker prospector is enabled.
May 14th 2018, 08:36:54.151 DEBUG Got a meta field in the event
May 14th 2018, 08:36:54.151 INFO Autodiscover starting runner: prospector [type=docker, ID=11396961725806640378]
May 14th 2018, 08:36:54.151 DEBUG Got a start event: map[host:10.103.22.198 kubernetes:{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"id":"d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f","image":"busybox:1.28","name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}} meta:{"kubernetes":{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}}} config:[0xc42036ade0] start:true], generated configs: [0xc42036ade0]
May 14th 2018, 08:36:54.150 DEBUG Got a stop event: map[stop:true host:10.103.22.198 kubernetes:{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"id":"d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f","image":"busybox:1.28","name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}} meta:{"kubernetes":{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}}} config:[0xc420449f80]], generated configs: [0xc420449f80]
May 14th 2018, 08:36:54.150 DEBUG Config &{{<nil> } <nil> 0xc42047e9c0} is not running
May 14th 2018, 08:36:54.142 ERROR kubernetes: Watching API error proto: wrong wireType = 6 for field ServiceAccountName
May 14th 2018, 08:36:54.142 INFO kubernetes: Ignoring event, moving to most recent resource version
May 14th 2018, 08:36:54.142 INFO kubernetes: Watching API for pod events
May 14th 2018, 08:36:54.139 ERROR kubernetes: Watching API error EOF
May 14th 2018, 08:36:54.139 INFO kubernetes: Watching API for pod events
May 14th 2018, 08:08:16.310 DEBUG Got a stop event: map[stop:true host:10.103.22.210 kubernetes:{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"id":"ab74190f32571c3f86f0df1e2d55155915c46d28411b034b00fe125a543b1018","image":"docker.elastic.co/beats/filebeat:6.2.3","name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}} meta:{"kubernetes":{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}}} config:[0xc4206ef740]], generated configs: [0xc4206ef740]
May 14th 2018, 08:08:16.310 DEBUG Got a start event: map[meta:{"kubernetes":{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}}} config:[0xc420a93fb0] start:true host:10.103.22.210 kubernetes:{"annotations":{"logging.meltwater.io/service":"beats","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"filebeat"},"container":{"id":"ab74190f32571c3f86f0df1e2d55155915c46d28411b034b00fe125a543b1018","image":"docker.elastic.co/beats/filebeat:6.2.3","name":"filebeat-dev"},"labels":{"controller-revision-hash":"4011475420","k8s-app":"filebeat-dev","kubernetes.io/cluster-service":"true","pod-template-generation":"9"},"namespace":"monitoring","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"filebeat-dev-6dpts"}}], generated configs: [0xc420a93fb0]
May 14th 2018, 07:55:58.356 INFO Prospector ticker stopped
May 14th 2018, 07:55:58.356 DEBUG Got a meta field in the event
May 14th 2018, 07:55:58.356 INFO Autodiscover stopping runner: prospector [type=docker, ID=11396961725806640378]
May 14th 2018, 07:55:58.356 DEBUG Got a stop event: map[host:10.103.22.198 kubernetes:{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"id":"d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f","image":"busybox:1.28","name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}} meta:{"kubernetes":{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}}} config:[0xc4201de6f0] stop:true], generated configs: [0xc4201de6f0]
May 14th 2018, 07:55:58.356 INFO Reader was closed: /var/lib/docker/containers/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f-json.log. Closing.
May 14th 2018, 07:55:58.356 DEBUG Failed to create runner with config &{{<nil> } <nil> 0xc420287f40}: Can only start a prospector when all related states are finished: {Id: Finished:false Fileinfo:0xc4201fc410 Source:/var/lib/docker/containers/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f/d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f-json.log Offset:4880478 Timestamp:2018-05-14 07:55:31.824293331 +0000 UTC m=+248080.356467940 TTL:-1ns Type:docker FileStateOS:14696405-51713}
May 14th 2018, 07:55:58.356 WARN EXPERIMENTAL: Docker prospector is enabled.
May 14th 2018, 07:55:58.356 INFO Stopping Prospector: 11396961725806640378
May 14th 2018, 07:55:58.356 DEBUG Got a start event: map[start:true host:10.103.22.198 kubernetes:{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"id":"d76136a412b48c76b245633d118ec3690290c3a51107b709fc8455f8d595ae7f","image":"busybox:1.28","name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}} meta:{"kubernetes":{"annotations":{"harvest":"dev","logging.meltwater.io/service":"heartbeat","logging.meltwater.io/system":"foundation","logging.meltwater.io/type":"nested_json"},"container":{"name":"heartbeat"},"labels":{"app":"heartbeat-dev","pod-template-hash":"340294164"},"namespace":"foundation-prod","node":{"name":"ip-10-103-18-45.eu-west-1.compute.internal"},"pod":{"name":"heartbeat-dev-7846f85b8-lpkpd"}}} config:[0xc4201c8e40]], generated configs: [0xc4201c8e40]
May 14th 2018, 07:55:58.350 INFO kubernetes: Ignoring event, moving to most recent resource version
May 14th 2018, 07:55:58.350 INFO kubernetes: Watching API for pod events
May 14th 2018, 07:55:58.350 ERROR kubernetes: Watching API error proto: wrong wireType = 6 for field ServiceAccountName
May 14th 2018, 07:55:58.347 INFO kubernetes: Watching API for pod events
May 14th 2018, 07:55:58.347 ERROR kubernetes: Watching API error EOF
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment