Skip to content

Instantly share code, notes, and snippets.

@ritasker
Last active January 9, 2019 12:44
Show Gist options
  • Save ritasker/e16d812ee5861cd8abfef06ffb89cf59 to your computer and use it in GitHub Desktop.
Save ritasker/e16d812ee5861cd8abfef06ffb89cf59 to your computer and use it in GitHub Desktop.
K8s Fluentd Setup
apiVersion: v1
kind: ConfigMap
metadata:
name: fluentd-config
labels:
app: fluentd
data:
fluent.conf: |
@include kubernetes.conf
# Tell fluentd to listen on 24224 for TCP messages
<source>
@type forward
port 24224
bind 0.0.0.0
</source>
# Tell fluentd to listen on 24220 for HTTP requests to get health check info
<source>
@type monitor_agent
bind 0.0.0.0
port 24220
</source>
<match **>
type elasticsearch
log_level info
include_tag_key true
host "#{ENV['FLUENT_ELASTICSEARCH_HOST']}"
port "#{ENV['FLUENT_ELASTICSEARCH_PORT']}"
scheme "#{ENV['FLUENT_ELASTICSEARCH_SCHEME'] || 'http'}"
user "#{ENV['FLUENT_ELASTICSEARCH_USER']}"
password "#{ENV['FLUENT_ELASTICSEARCH_PASSWORD']}"
reload_connections "#{ENV['FLUENT_ELASTICSEARCH_RELOAD_CONNECTIONS'] || 'true'}"
logstash_prefix "#{ENV['FLUENT_ELASTICSEARCH_LOGSTASH_PREFIX'] || 'logstash'}"
logstash_format true
buffer_chunk_limit 2M
buffer_queue_limit 32
flush_interval 5s
max_retry_wait 30
disable_retry_limit
num_threads 8
logstash_dateformat %Y%m%d
time_key_exclude_timestamp false
time_key ts
time_key_format %Y-%m-%dT%H:%M:%S.%NZ
time_precision 6
include_tag_key true
type_name access_log
tag_key @log_name
remove_keys ts
</match>
apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
name: fluentd
namespace: kube-system
labels:
k8s-app: fluentd-logging
version: v1
kubernetes.io/cluster-service: "true"
spec:
template:
metadata:
labels:
k8s-app: fluentd-logging
version: v1
kubernetes.io/cluster-service: "true"
spec:
containers:
- name: fluentd
image: fluent/fluentd-kubernetes-daemonset:elasticsearch
env:
- name: FLUENT_ELASTICSEARCH_HOST
value: "vq-elasticsearch"
- name: FLUENT_ELASTICSEARCH_PORT
value: "9200"
- name: FLUENT_ELASTICSEARCH_LOGSTASH_PREFIX
value: "fluentd"
volumeMounts:
- name: varlog
mountPath: /var/log
- name: varlibdockercontainers
mountPath: /var/lib/docker/containers
readOnly: true
- name: fluentd-config
mountPath: /fluentd/etc/fluent.conf
subPath: fluent.conf
volumes:
- name: varlog
hostPath:
path: /var/log
- name: varlibdockercontainers
hostPath:
path: /var/lib/docker/containers
- name: fluentd-config
configMap:
name: fluentd-config
2017-11-23 09:36:54 +0000 [info]: reading config file path="/fluentd/etc/fluent.conf"
2017-11-23 09:36:54 +0000 [info]: starting fluentd-0.12.33
2017-11-23 09:36:54 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '1.10.0'
2017-11-23 09:36:54 +0000 [info]: gem 'fluent-plugin-kubernetes_metadata_filter' version '0.29.0'
2017-11-23 09:36:54 +0000 [info]: gem 'fluent-plugin-record-reformer' version '0.9.1'
2017-11-23 09:36:54 +0000 [info]: gem 'fluent-plugin-secure-forward' version '0.4.5'
2017-11-23 09:36:54 +0000 [info]: gem 'fluentd' version '0.12.33'
2017-11-23 09:36:54 +0000 [info]: adding match pattern="fluent.**" type="null"
2017-11-23 09:36:54 +0000 [info]: adding filter pattern="kubernetes.**" type="kubernetes_metadata"
2017-11-23 09:36:55 +0000 [info]: adding match pattern="**" type="elasticsearch"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="tail"
2017-11-23 09:36:55 +0000 [info]: adding source type="forward"
2017-11-23 09:36:55 +0000 [info]: adding source type="monitor_agent"
2017-11-23 09:36:55 +0000 [info]: using configuration file: <ROOT>
<match fluent.**>
type null
</match>
<source>
type tail
path /var/log/containers/*.log
pos_file /var/log/fluentd-containers.log.pos
time_format %Y-%m-%dT%H:%M:%S.%NZ
tag kubernetes.*
format json
read_from_head true
</source>
<source>
type tail
format /^(?<time>[^ ]* [^ ,]*)[^\[]*\[[^\]]*\]\[(?<severity>[^ \]]*) *\] (?<message>.*)$/
time_format %Y-%m-%d %H:%M:%S
path /var/log/salt/minion
pos_file /var/log/fluentd-salt.pos
tag salt
</source>
<source>
type tail
format syslog
path /var/log/startupscript.log
pos_file /var/log/fluentd-startupscript.log.pos
tag startupscript
</source>
<source>
type tail
format /^time="(?<time>[^)]*)" level=(?<severity>[^ ]*) msg="(?<message>[^"]*)"( err="(?<error>[^"]*)")?( statusCode=($<status_code>\d+))?/
path /var/log/docker.log
pos_file /var/log/fluentd-docker.log.pos
tag docker
</source>
<source>
type tail
format none
path /var/log/etcd.log
pos_file /var/log/fluentd-etcd.log.pos
tag etcd
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/kubelet.log
pos_file /var/log/fluentd-kubelet.log.pos
tag kubelet
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/kube-proxy.log
pos_file /var/log/fluentd-kube-proxy.log.pos
tag kube-proxy
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/kube-apiserver.log
pos_file /var/log/fluentd-kube-apiserver.log.pos
tag kube-apiserver
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/kube-controller-manager.log
pos_file /var/log/fluentd-kube-controller-manager.log.pos
tag kube-controller-manager
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/kube-scheduler.log
pos_file /var/log/fluentd-kube-scheduler.log.pos
tag kube-scheduler
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/rescheduler.log
pos_file /var/log/fluentd-rescheduler.log.pos
tag rescheduler
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/glbc.log
pos_file /var/log/fluentd-glbc.log.pos
tag glbc
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<source>
type tail
format kubernetes
multiline_flush_interval 5s
path /var/log/cluster-autoscaler.log
pos_file /var/log/fluentd-cluster-autoscaler.log.pos
tag cluster-autoscaler
format_firstline /^\w\d{4}/
format1 /^(?<severity>\w)(?<time>\d{4} [^\s]*)\s+(?<pid>\d+)\s+(?<source>[^ \]]+)\] (?<message>.*)/
time_format %m%d %H:%M:%S.%N
</source>
<filter kubernetes.**>
type kubernetes_metadata
</filter>
<source>
@type forward
port 24224
bind 0.0.0.0
</source>
<source>
@type monitor_agent
bind 0.0.0.0
port 24220
</source>
<match **>
type elasticsearch
log_level info
include_tag_key true
host vq-elasticsearch
port 9200
scheme http
user
password xxxxxx
reload_connections true
logstash_prefix fluentd
logstash_format true
buffer_chunk_limit 2M
buffer_queue_limit 32
flush_interval 5s
max_retry_wait 30
disable_retry_limit
num_threads 8
logstash_dateformat %Y%m%d
time_key_exclude_timestamp false
time_key ts
time_key_format %Y-%m-%dT%H:%M:%SZ
time_precision 6
type_name access_log
tag_key @log_name
remove_keys ts
</match>
</ROOT>
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/kube-proxy-gke-vq-vcb-default-pool-cf9255b1-rwts_kube-system_touch-lock-b0b7ef672a2f2c4157a7e1e82ea1da3227eafe307332b740a69f200d0d01be66.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/l7-default-backend-6497bcdb4d-b58ln_kube-system_default-http-backend-e6a75fa1993e4619ada3ecdabde5140ac5dbeee97e0d3e1a309a8427ee0ca344.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/heapster-5d67855584-q99n9_kube-system_heapster-c957c9925eaf8b3133bb6cedcb91712c3dfd710e77f4fb3a6b0fee36ee59df3f.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/l7-default-backend-6497bcdb4d-b58ln_kube-system_default-http-backend-07268d5b82bbc941152da2fed0e0c14769b526792f77d634ec49420ce6cb8c4d.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/vcb_vcb-master_vcb-d7368ac4819b91326b2f37626d054154aede941d5da2802315f8820ff9235f25.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/kube-dns-778977457c-wlcs2_kube-system_sidecar-db7af0073d8fd835985399bc54226c37cd8c17c74d37d746e0edc75071e18b30.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/kube-proxy-gke-vq-vcb-default-pool-cf9255b1-rwts_kube-system_kube-proxy-2600a6b4cf17b0091dd3832fb99fef3f876e52f7e8edd7548c89b2223380ee1e.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/fluentd-24h4m_kube-system_fluentd-9be638498854ce7b5d8634b1983d2b0874668a260c24eb3a9989b0e27b825b14.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/kube-dns-778977457c-wlcs2_kube-system_kubedns-9299d2910caba05ae763d25a8a4c6b47ea426bbddfbcaa284e4b6513e8c5e61d.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/kubernetes-dashboard-76c679977c-g2zhp_kube-system_kubernetes-dashboard-4f17ba8377ec9b520b80be2fbccff03bc0ba45b9fe68fc418b3aa3e64f731920.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/containers/kube-dns-778977457c-wlcs2_kube-system_dnsmasq-c642019b1c41923caf2fcc2884c203063e6ceef515c3570778e2433a632a0419.log
2017-11-23 09:36:55 +0000 [info]: following tail of /var/log/kube-proxy.log
2017-11-23 09:36:55 +0000 [info]: listening fluent socket on 0.0.0.0:24224
2017-11-23 09:37:01 +0000 [info]: Connection opened to Elasticsearch cluster => {:host=>"vq-elasticsearch", :port=>9200, :scheme=>"http", :user=>"", :password=>"obfuscated"}
2017-11-23 09:37:18 +0000 [info]: shutting down fluentd
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979dba0e8"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979dc8b20"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979dd6f04"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979dd0a28"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979dc2874"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac97976588c"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979db5318"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac97976bc00"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979dad71c"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979da6494"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979774008"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979de3948"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="tail" plugin_id="object:2ac979ddd41c"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="forward" plugin_id="object:2ac979de7c28"
2017-11-23 09:37:18 +0000 [info]: shutting down input type="monitor_agent" plugin_id="object:2ac979de6e2c"
2017-11-23 09:37:18 +0000 [info]: shutting down filter type="kubernetes_metadata" plugin_id="object:2ac978cc1728"
2017-11-23 09:37:18 +0000 [info]: shutting down output type="null" plugin_id="object:2ac978d4ab2c"
2017-11-23 09:37:18 +0000 [info]: shutting down output type="elasticsearch" plugin_id="object:2ac979d5d820"
2017-11-23 09:37:18 +0000 [info]: process finished code=0
kind: Service
apiVersion: v1
metadata:
name: fluentd
spec:
selector:
k8s-app: fluentd-logging
ports:
- name: fluentd-health
port: 24220
targetPort: 24220
- name: fluentd
port: 24224
targetPort: 24224
Name: fluentd
Selector: k8s-app=fluentd-logging,kubernetes.io/cluster-service=true,version=v1
Node-Selector: 63184c54-cbb8-11e7-ac6a-42010a9a0fd8=63184cf3-cbb8-11e7-ac6a-42010a9a0fd8
Labels: k8s-app=fluentd-logging
kubernetes.io/cluster-service=true
version=v1
Annotations: kubectl.kubernetes.io/last-applied-configuration={"apiVersion":"extensions/v1beta1","kind":"DaemonSet","metadata":{"annotations":{},"labels":{"k8s-app":"fluentd-logging","kubernetes.io/cluster-service...
Desired Number of Nodes Scheduled: 0
Current Number of Nodes Scheduled: 0
Number of Nodes Scheduled with Up-to-date Pods: 0
Number of Nodes Scheduled with Available Pods: 0
Number of Nodes Misscheduled: 2
Pods Status: 1 Running / 1 Waiting / 0 Succeeded / 0 Failed
Pod Template:
Labels: k8s-app=fluentd-logging
kubernetes.io/cluster-service=true
version=v1
Containers:
fluentd:
Image: fluent/fluentd-kubernetes-daemonset:elasticsearch
Port: <none>
Limits:
memory: 200Mi
Requests:
cpu: 100m
memory: 200Mi
Environment:
FLUENT_ELASTICSEARCH_HOST: vq-elasticsearch
FLUENT_ELASTICSEARCH_PORT: 9200
FLUENT_ELASTICSEARCH_LOGSTASH_PREFIX: fluentd
Mounts:
/fluentd/etc/fluent.conf from fluentd-config (rw)
/var/lib/docker/containers from varlibdockercontainers (ro)
/var/log from varlog (rw)
Volumes:
varlog:
Type: HostPath (bare host directory volume)
Path: /var/log
varlibdockercontainers:
Type: HostPath (bare host directory volume)
Path: /var/lib/docker/containers
fluentd-config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: fluentd-config
Optional: false
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal SuccessfulCreate 22s daemon-set Created pod: fluentd-hmmtt
Normal SuccessfulCreate 22s daemon-set Created pod: fluentd-ttqhb
Normal SuccessfulCreate 22s daemon-set Created pod: fluentd-gwwk9
Normal SuccessfulDelete 8s daemon-set Deleted pod: fluentd-ttqhb
Normal SuccessfulDelete 8s daemon-set Deleted pod: fluentd-gwwk9
Normal SuccessfulDelete 8s daemon-set Deleted pod: fluentd-hmmtt
10m 10m 1 fluentd-gwwk9.14f7edf3d840e578 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 MountVolume.SetUp succeeded for volume "varlog"
10m 10m 1 fluentd-gwwk9.14f7edf3d8484f02 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 MountVolume.SetUp succeeded for volume "varlibdockercontainers"
10m 10m 1 fluentd-gwwk9.14f7edf3d8795f7c Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 MountVolume.SetUp succeeded for volume "fluentd-config"
10m 10m 1 fluentd-gwwk9.14f7edf3d97ba403 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 MountVolume.SetUp succeeded for volume "default-token-qtwqp"
10m 10m 1 fluentd-gwwk9.14f7edf3e86bca8f Pod spec.containers{fluentd} Normal Pulled kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 Container image "fluent/fluentd-kubernetes-daemonset:elasticsearch" already present on machine
10m 10m 1 fluentd-gwwk9.14f7edf3eb4d8322 Pod spec.containers{fluentd} Normal Created kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 Created container
10m 10m 1 fluentd-gwwk9.14f7edf3ef676265 Pod spec.containers{fluentd} Normal Started kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 Started container
10m 10m 1 fluentd-gwwk9.14f7edf7426556fb Pod spec.containers{fluentd} Normal Killing kubelet, gke-vq-vcb-default-pool-cf9255b1-sp07 Killing container with id docker://fluentd:Need to kill Pod
10m 10m 1 fluentd-hmmtt.14f7edf3d291cd55 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts MountVolume.SetUp succeeded for volume "varlibdockercontainers"
10m 10m 1 fluentd-hmmtt.14f7edf3d29a8b8d Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts MountVolume.SetUp succeeded for volume "varlog"
10m 10m 1 fluentd-hmmtt.14f7edf3d2d218e5 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts MountVolume.SetUp succeeded for volume "fluentd-config"
10m 10m 1 fluentd-hmmtt.14f7edf3d38517d1 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts MountVolume.SetUp succeeded for volume "default-token-qtwqp"
10m 10m 1 fluentd-hmmtt.14f7edf3e5823214 Pod spec.containers{fluentd} Normal Pulled kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts Container image "fluent/fluentd-kubernetes-daemonset:elasticsearch" already present on machine
10m 10m 1 fluentd-hmmtt.14f7edf3e7536f31 Pod spec.containers{fluentd} Normal Created kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts Created container
10m 10m 1 fluentd-hmmtt.14f7edf3eb44939f Pod spec.containers{fluentd} Normal Started kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts Started container
10m 10m 1 fluentd-hmmtt.14f7edf73ce6eaf0 Pod spec.containers{fluentd} Normal Killing kubelet, gke-vq-vcb-default-pool-cf9255b1-rwts Killing container with id docker://fluentd:Need to kill Pod
10m 10m 1 fluentd-ttqhb.14f7edf3d6f5ff89 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs MountVolume.SetUp succeeded for volume "varlibdockercontainers"
10m 10m 1 fluentd-ttqhb.14f7edf3d6fbe068 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs MountVolume.SetUp succeeded for volume "varlog"
10m 10m 1 fluentd-ttqhb.14f7edf3d73d5d60 Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs MountVolume.SetUp succeeded for volume "fluentd-config"
10m 10m 1 fluentd-ttqhb.14f7edf3d82bf03b Pod Normal SuccessfulMountVolume kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs MountVolume.SetUp succeeded for volume "default-token-qtwqp"
10m 10m 1 fluentd-ttqhb.14f7edf3eb6ecf34 Pod spec.containers{fluentd} Normal Pulled kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs Container image "fluent/fluentd-kubernetes-daemonset:elasticsearch" already present on machine
10m 10m 1 fluentd-ttqhb.14f7edf3edc8b7e3 Pod spec.containers{fluentd} Normal Created kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs Created container
10m 10m 1 fluentd-ttqhb.14f7edf3f1d171eb Pod spec.containers{fluentd} Normal Started kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs Started container
10m 10m 1 fluentd-ttqhb.14f7edf74c0092ec Pod spec.containers{fluentd} Normal Killing kubelet, gke-vq-vcb-default-pool-cf9255b1-w3cs Killing container with id docker://fluentd:Need to kill Pod
10m 10m 1 fluentd.14f7edf3c7be8c23 DaemonSet Normal SuccessfulCreate daemon-set Created pod: fluentd-hmmtt
10m 10m 1 fluentd.14f7edf3c86d478a DaemonSet Normal SuccessfulCreate daemon-set Created pod: fluentd-ttqhb
10m 10m 1 fluentd.14f7edf3c885481d DaemonSet Normal SuccessfulCreate daemon-set Created pod: fluentd-gwwk9
10m 10m 1 fluentd.14f7edf7186c9220 DaemonSet Normal SuccessfulDelete daemon-set Deleted pod: fluentd-ttqhb
10m 10m 1 fluentd.14f7edf718b9685b DaemonSet Normal SuccessfulDelete daemon-set Deleted pod: fluentd-gwwk9
10m 10m 1 fluentd.14f7edf718baa9b9 DaemonSet Normal SuccessfulDelete daemon-set Deleted pod: fluentd-hmmtt
@cpersso9
Copy link

cpersso9 commented Jan 9, 2019

Hey! I have a similar issue with fluentd. What was the fix? : >

kube-system   0s    Normal   Pulled   Pod   Container image "fluent/fluentd-kubernetes-daemonset:elasticsearch" already present on machine
kube-system   0s    Normal   Created   Pod   Created container
kube-system   0s    Normal   Started   Pod   Started container
kube-system   0s    Normal   SuccessfulDelete   DaemonSet   Deleted pod: fluentd-lqhhw
kube-system   0s    Normal   SuccessfulDelete   DaemonSet   Deleted pod: fluentd-4rqkt
kube-system   0s    Normal   Killing   Pod   Killing container with id docker://fluentd:Need to kill Pod
kube-system   0s    Normal   Killing   Pod   Killing container with id docker://fluentd:Need to kill Pod

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment