Skip to content

Instantly share code, notes, and snippets.

@darshanime

darshanime/logs.md

Created September 29, 2018 04:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save darshanime/144a39bf219da86ae45003d2a424a7fe to your computer and use it in GitHub Desktop.
Save darshanime/144a39bf219da86ae45003d2a424a7fe to your computer and use it in GitHub Desktop.
Download ZIP
csi: hostpath-driver
Raw
logs.md
  • logs for hostpath-driver
 csi (master) ✗ k logs csi-pod hostpath-driver -n csi -f
I0929 03:37:29.686108       1 hostpath.go:89] Driver: csi-hostpath 
I0929 03:37:29.686165       1 driver.go:80] Enabling controller service capability: CREATE_DELETE_VOLUME
I0929 03:37:29.686171       1 driver.go:92] Enabling volume access mode: SINGLE_NODE_WRITER
I0929 03:37:29.690233       1 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"//csi/csi.sock", Net:"unix"}
I0929 03:37:29.693491       1 utils.go:96] GRPC call: /csi.v0.Identity/GetPluginInfo
I0929 03:37:29.693509       1 utils.go:97] GRPC request: 
I0929 03:37:29.693528       1 identityserver-default.go:32] Using default GetPluginInnfo
I0929 03:37:29.693534       1 utils.go:102] GRPC response: name:"csi-hostpath" vendor_version:"0.2.0" 
I0929 03:37:29.694112       1 utils.go:96] GRPC call: /csi.v0.Node/NodeGetId
I0929 03:37:29.694540       1 utils.go:97] GRPC request: 
I0929 03:37:29.694560       1 nodeserver-default.go:40] Using default NodeGetId
I0929 03:37:29.694564       1 utils.go:102] GRPC response: node_id:"ip-192-168-64-131.us-east-2.compute.internal" 
I0929 03:37:30.201005       1 utils.go:96] GRPC call: /csi.v0.Identity/GetPluginInfo
I0929 03:37:30.201020       1 utils.go:97] GRPC request: 
I0929 03:37:30.201066       1 identityserver-default.go:32] Using default GetPluginInnfo
I0929 03:37:30.201071       1 utils.go:102] GRPC response: name:"csi-hostpath" vendor_version:"0.2.0" 
I0929 03:37:30.201555       1 utils.go:96] GRPC call: /csi.v0.Identity/Probe
I0929 03:37:30.201569       1 utils.go:97] GRPC request: 
I0929 03:37:30.201584       1 utils.go:102] GRPC response: 
I0929 03:37:30.201985       1 utils.go:96] GRPC call: /csi.v0.Identity/GetPluginCapabilities
I0929 03:37:30.201995       1 utils.go:97] GRPC request: 
I0929 03:37:30.202002       1 identityserver-default.go:53] Using default capabilities
I0929 03:37:30.202006       1 utils.go:102] GRPC response: capabilities:<service:<type:CONTROLLER_SERVICE > > 
I0929 03:37:30.202377       1 utils.go:96] GRPC call: /csi.v0.Controller/ControllerGetCapabilities
I0929 03:37:30.202387       1 utils.go:97] GRPC request: 
I0929 03:37:30.202397       1 controllerserver-default.go:82] Using default ControllerGetCapabilities
I0929 03:37:30.202401       1 utils.go:102] GRPC response: capabilities:<rpc:<type:CREATE_DELETE_VOLUME > > 
I0929 03:37:49.240972       1 utils.go:96] GRPC call: /csi.v0.Identity/GetPluginCapabilities
I0929 03:37:49.240988       1 utils.go:97] GRPC request: 
I0929 03:37:49.241292       1 identityserver-default.go:53] Using default capabilities
I0929 03:37:49.241323       1 utils.go:102] GRPC response: capabilities:<service:<type:CONTROLLER_SERVICE > > 
I0929 03:37:49.241699       1 utils.go:96] GRPC call: /csi.v0.Controller/ControllerGetCapabilities
I0929 03:37:49.241709       1 utils.go:97] GRPC request: 
I0929 03:37:49.241739       1 controllerserver-default.go:82] Using default ControllerGetCapabilities
I0929 03:37:49.241744       1 utils.go:102] GRPC response: capabilities:<rpc:<type:CREATE_DELETE_VOLUME > > 
I0929 03:37:49.243138       1 utils.go:96] GRPC call: /csi.v0.Identity/GetPluginInfo
I0929 03:37:49.243174       1 utils.go:97] GRPC request: 
I0929 03:37:49.243206       1 identityserver-default.go:32] Using default GetPluginInnfo
I0929 03:37:49.243211       1 utils.go:102] GRPC response: name:"csi-hostpath" vendor_version:"0.2.0" 
I0929 03:37:49.245323       1 utils.go:96] GRPC call: /csi.v0.Controller/CreateVolume
I0929 03:37:49.245337       1 utils.go:97] GRPC request: name:"pvc-09787046c39911e8" capacity_range:<required_bytes:1073741824 > volume_capabilities:<mount:<> access_mode:<mode:SINGLE_NODE_WRITER > > 
I0929 03:37:49.245753       1 controllerserver.go:87] create volume /tmp/098d1ce5-c399-11e8-8f9f-2680ce526fb9
I0929 03:37:49.245764       1 utils.go:102] GRPC response: volume:<capacity_bytes:1073741824 id:"098d1ce5-c399-11e8-8f9f-2680ce526fb9" > 
I0929 03:38:15.414751       1 utils.go:96] GRPC call: /csi.v0.Node/NodeGetCapabilities
I0929 03:38:15.414765       1 utils.go:97] GRPC request: 
I0929 03:38:15.414778       1 nodeserver-default.go:48] Using default NodeGetCapabilities
I0929 03:38:15.414783       1 utils.go:102] GRPC response: capabilities:<rpc:<> > 
I0929 03:38:15.415724       1 utils.go:96] GRPC call: /csi.v0.Node/NodeGetCapabilities
I0929 03:38:15.415735       1 utils.go:97] GRPC request: 
I0929 03:38:15.415764       1 nodeserver-default.go:48] Using default NodeGetCapabilities
I0929 03:38:15.415770       1 utils.go:102] GRPC response: capabilities:<rpc:<> > 
I0929 03:38:15.418031       1 utils.go:96] GRPC call: /csi.v0.Node/NodePublishVolume
I0929 03:38:15.418041       1 utils.go:97] GRPC request: volume_id:"098d1ce5-c399-11e8-8f9f-2680ce526fb9" target_path:"/var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount" volume_capability:<mount:<> access_mode:<mode:SINGLE_NODE_WRITER > > volume_attributes:<key:"storage.kubernetes.io/csiProvisionerIdentity" value:"1538192248170-8081-csi-hostpath" > 
I0929 03:38:15.418185       1 mount_linux.go:188] Detected OS without systemd
I0929 03:38:15.418215       1 nodeserver.go:79] target /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount
fstype 
device 
readonly false
attributes 098d1ce5-c399-11e8-8f9f-2680ce526fb9
 mountflags map[storage.kubernetes.io/csiProvisionerIdentity:1538192248170-8081-csi-hostpath]
%!(EXTRA []string=[])
I0929 03:38:15.418318       1 mount_linux.go:188] Detected OS without systemd
I0929 03:38:15.418324       1 mount_linux.go:135] Mounting cmd (mount) with arguments ([-o bind /tmp/098d1ce5-c399-11e8-8f9f-2680ce526fb9 /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount])
I0929 03:38:15.419592       1 mount_linux.go:135] Mounting cmd (mount) with arguments ([-o remount /tmp/098d1ce5-c399-11e8-8f9f-2680ce526fb9 /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount])
I0929 03:38:15.420110       1 utils.go:102] GRPC response:
  • mounted on my-csi-app
 csi (master) ✗ k exec -it my-csi-app /bin/sh -n csi                
/ # df -h
Filesystem                Size      Used Available Use% Mounted on
none                     96.9G      9.9G     87.0G  10% /
tmpfs                     3.7G         0      3.7G   0% /dev
tmpfs                     3.7G         0      3.7G   0% /sys/fs/cgroup
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /data
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /dev/termination-log
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /etc/resolv.conf
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /etc/hostname
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /etc/hosts
shm                      64.0M         0     64.0M   0% /dev/shm
tmpfs                     3.7G     12.0K      3.7G   0% /var/run/secrets/kubernetes.io/serviceaccount
tmpfs                     3.7G         0      3.7G   0% /proc/kcore
tmpfs                     3.7G         0      3.7G   0% /proc/timer_list
tmpfs                     3.7G         0      3.7G   0% /proc/timer_stats
tmpfs                     3.7G         0      3.7G   0% /proc/sched_debug
tmpfs                     3.7G         0      3.7G   0% /sys/firmware



/ # mount | grep data
/dev/nvme0n1p1 on /data type ext4 (rw,relatime,discard,data=ordered)
  • Inside hostpath-driver
$ k exec -it csi-pod -c hostpath-driver /bin/sh -n csi
/ # df -h | grep csi
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /csi
tmpfs                     3.7G     12.0K      3.7G   0% /var/lib/kubelet/pods/fc3d32ca-c398-11e8-8e7c-0263c638b168/volumes/kubernetes.io~secret/csi-service-account-token-xrp69
none                     96.9G      9.9G     87.0G  10% /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount



/ # mount | grep csi
/dev/nvme0n1p1 on /csi type ext4 (rw,relatime,discard,data=ordered)
tmpfs on /var/lib/kubelet/pods/fc3d32ca-c398-11e8-8e7c-0263c638b168/volumes/kubernetes.io~secret/csi-service-account-token-xrp69 type tmpfs (rw,relatime)
none on /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount type aufs (rw,relatime,si=851f43f259786f79,dio,dirperm1)
  • on writing 10G of data from my-csi-app
$ k exec -it my-csi-app /bin/sh -n csi     
/ # cd /data
/data # df -h /data
Filesystem                Size      Used Available Use% Mounted on
/dev/nvme0n1p1           96.9G      9.9G     87.0G  10% /data

/data # dd if=/dev/zero of=/data/dd-file bs=10M count=1024
1024+0 records in
1024+0 records out
10737418240 bytes (10.0GB) copied, 76.855570 seconds, 133.2MB/s
/data # du -sh /data/dd-file 
10.0G	/data/dd-file

/data # df -h /data
Filesystem                Size      Used Available Use% Mounted on
/dev/nvme0n1p1           96.9G     19.9G     76.9G  21% /data
  • checking the file from csi-pod -c hostpath-driver
$ k exec -it csi-pod -c hostpath-driver /bin/sh -n csi
/ # mount | grep csi
/dev/nvme0n1p1 on /csi type ext4 (rw,relatime,discard,data=ordered)
tmpfs on /var/lib/kubelet/pods/fc3d32ca-c398-11e8-8e7c-0263c638b168/volumes/kubernetes.io~secret/csi-service-account-token-xrp69 type tmpfs (rw,relatime)
none on /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount type aufs (rw,relatime,si=851f43f259786f79,dio,dirperm1)


/ # df -h | grep csi
/dev/nvme0n1p1           96.9G     19.9G     76.9G  21% /csi
tmpfs                     3.7G     12.0K      3.7G   0% /var/lib/kubelet/pods/fc3d32ca-c398-11e8-8e7c-0263c638b168/volumes/kubernetes.io~secret/csi-service-account-token-xrp69
none                     96.9G     19.9G     76.9G  21% /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount

/ # ls /var/lib/kubelet/pods/149192fa-c399-11e8-8e7c-0263c638b168/volumes/kubernetes.io~csi/pvc-09787046c39911e8/mount
/ #
  • flags on kubelet
ubuntu@kubernetes-services-k8s-worker1:~$ ps -ef | grep kubelet
root      1518     1  6 Sep12 ?        1-01:11:59 /usr/local/bin/kubelet --logtostderr=true --v=2 --address=192.168.27.172 --node-ip=192.168.27.172 --allow-privileged=true --pod-manifest-path=/etc/kubernetes/manifests --cadvisor-port=0 --pod-infra-container-image=gcr.io/google_containers/pause-amd64:3.0 --node-status-update-frequency=10s --docker-disable-shared-pid=True --client-ca-file=/etc/kubernetes/ssl/ca.pem --tls-cert-file=/etc/kubernetes/ssl/node-kubernetes-services-k8s-worker1.pem --tls-private-key-file=/etc/kubernetes/ssl/node-kubernetes-services-k8s-worker1-key.pem --anonymous-auth=false --read-only-port=0 --cgroup-driver=cgroupfs --cgroups-per-qos=True --max-pods=110 --fail-swap-on=True --authentication-token-webhook --enforce-node-allocatable= --cluster-dns=10.233.0.3 --cluster-domain=cluster.local --resolv-conf=/etc/resolv.conf --kubeconfig=/etc/kubernetes/node-kubeconfig.yaml --kube-reserved cpu=100m,memory=256M --node-labels=node-role.kubernetes.io/node=true --feature-gates=PersistentLocalVolumes=False,VolumeScheduling=False,MountPropagation=False --network-plugin=cni --cni-conf-dir=/etc/cni/net.d --cni-bin-dir=/opt/cni/bin --volume-plugin-dir=/var/lib/kubelet/volume-plugins --cloud-provider=aws
  • flags on apiserver
$ kubectl get po -n kube-system $(kubectl get po -n kube-system | grep apiserver | awk '{print $1}') -o yaml
    - /hyperkube
    - apiserver
    - --advertise-address=192.168.64.131
    - --etcd-servers=https://192.168.64.131:2379,https://192.168.8.121:2379,https://192.168.27.172:2379
    - --etcd-cafile=/etc/ssl/etcd/ssl/ca.pem
    - --etcd-certfile=/etc/ssl/etcd/ssl/node-kubernetes-services-k8s-master0.pem
    - --etcd-keyfile=/etc/ssl/etcd/ssl/node-kubernetes-services-k8s-master0-key.pem
    - --insecure-bind-address=127.0.0.1
    - --bind-address=0.0.0.0
    - --apiserver-count=1
    - --endpoint-reconciler-type=lease
    - --service-cluster-ip-range=10.233.0.0/18
    - --service-node-port-range=30000-32767
    - --client-ca-file=/etc/kubernetes/ssl/ca.pem
    - --profiling=false
    - --repair-malformed-updates=false
    - --kubelet-client-certificate=/etc/kubernetes/ssl/node-kubernetes-services-k8s-master0.pem
    - --kubelet-client-key=/etc/kubernetes/ssl/node-kubernetes-services-k8s-master0-key.pem
    - --service-account-lookup=true
    - --kubelet-preferred-address-types=InternalDNS,InternalIP,Hostname,ExternalDNS,ExternalIP
    - --tls-cert-file=/etc/kubernetes/ssl/apiserver.pem
    - --tls-private-key-file=/etc/kubernetes/ssl/apiserver-key.pem
    - --service-account-key-file=/etc/kubernetes/ssl/service-account-key.pem
    - --secure-port=6443
    - --insecure-port=8080
    - --storage-backend=etcd3
    - --runtime-config=admissionregistration.k8s.io/v1alpha1
    - --v=2
    - --allow-privileged=true
    - --cloud-provider=aws
    - --anonymous-auth=True
    - --authorization-mode=Node,RBAC
    - --feature-gates=PersistentLocalVolumes=False,VolumeScheduling=False,MountPropagation=False
    - --requestheader-client-ca-file=/etc/kubernetes/ssl/front-proxy-ca.pem
    - --requestheader-allowed-names=front-proxy-client
    - --requestheader-extra-headers-prefix=X-Remote-Extra-
    - --requestheader-group-headers=X-Remote-Group
    - --requestheader-username-headers=X-Remote-User
    - --enable-aggregator-routing=False
    - --proxy-client-cert-file=/etc/kubernetes/ssl/front-proxy-client.pem
    - --proxy-client-key-file=/etc/kubernetes/ssl/front-proxy-client-key.pem
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment