Skip to content

Instantly share code, notes, and snippets.

@fdeantoni
Created September 12, 2019 07:11
Show Gist options
  • Save fdeantoni/e461656ba5d58003780b4866cfa520a9 to your computer and use it in GitHub Desktop.
Save fdeantoni/e461656ba5d58003780b4866cfa520a9 to your computer and use it in GitHub Desktop.
Rook on k3s
apiVersion: ceph.rook.io/v1
kind: CephCluster
metadata:
name: rook-ceph
namespace: rook-ceph
spec:
cephVersion:
image: ceph/ceph:v14.2.1-20190430
dataDirHostPath: /var/lib/rook
mon:
count: 3
allowMultiplePerNode: true
dashboard:
enabled: true
storage:
useAllNodes: true
useAllDevices: true
config:
osdsPerDevice: "1"
apiVersion: v1
kind: Service
metadata:
name: rook-ceph-mgr-dashboard-external-https
namespace: rook-ceph
labels:
app: rook-ceph-mgr
rook_cluster: rook-ceph
spec:
ports:
- name: dashboard
port: 8443
protocol: TCP
targetPort: 8443
selector:
app: rook-ceph-mgr
rook_cluster: rook-ceph
sessionAffinity: None
type: NodePort
$ kubectl get services
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
kubernetes ClusterIP 10.43.0.1 <none> 443/TCP 4d18h
webdav-service LoadBalancer 10.43.136.21 10.0.2.120,10.0.2.121,10.0.2.122,... 8082:30158/TCP 10m
$ kubectl -n rook-ceph get pod
NAME READY STATUS RESTARTS AGE
rook-ceph-agent-7f9s6 1/1 Running 0 9m 10.0.2.123 node3 <none> <none>
rook-ceph-agent-9746b 1/1 Running 0 9m 10.0.2.127 node7 <none> <none>
rook-ceph-agent-c9hv6 1/1 Running 0 9m 10.0.2.122 node2 <none> <none>
rook-ceph-agent-ckwfc 1/1 Running 0 9m 10.0.2.124 node4 <none> <none>
rook-ceph-agent-gcvbp 1/1 Running 0 9m 10.0.2.126 node6 <none> <none>
rook-ceph-agent-kl492 1/1 Running 0 9m 10.0.2.125 node5 <none> <none>
rook-ceph-agent-whl66 1/1 Running 0 9m 10.0.2.121 node1 <none> <none>
rook-ceph-agent-wkqtl 1/1 Running 0 9m 10.0.2.120 node0 <none> <none>
rook-ceph-mgr-a-7c86d8c55b-29n8b 1/1 Running 0 7m56s 10.42.9.23 node7 <none> <none>
rook-ceph-mon-a-b969d4775-xckl7 1/1 Running 0 8m40s 10.42.0.29 node0 <none> <none>
rook-ceph-mon-b-865f89ffc4-vn8ns 1/1 Running 0 8m32s 10.42.1.24 node1 <none> <none>
rook-ceph-mon-c-9f74fd6bc-vs9g4 1/1 Running 0 8m18s 10.42.7.22 node2 <none> <none>
rook-ceph-operator-7bbb59d7bd-kxn2x 1/1 Running 0 9m2s 10.42.10.22 node6 <none> <none>
rook-ceph-osd-0-77464bc789-rdp6b 1/1 Running 0 6m52s 10.42.2.24 node4 <none> <none>
rook-ceph-osd-1-55569b7749-hvcd6 1/1 Running 0 6m50s 10.42.6.25 node5 <none> <none>
rook-ceph-osd-2-585759759-4qp7k 1/1 Running 0 6m45s 10.42.10.25 node6 <none> <none>
rook-ceph-osd-3-7d776bc679-62vrj 1/1 Running 0 6m47s 10.42.9.25 node7 <none> <none>
rook-ceph-osd-prepare-node0-kpzdh 0/2 Completed 0 7m30s 10.42.0.30 node0 <none> <none>
rook-ceph-osd-prepare-node1-w7tcp 0/2 Completed 0 7m30s 10.42.1.25 node1 <none> <none>
rook-ceph-osd-prepare-node2-z9nnz 0/2 Completed 0 7m30s 10.42.7.23 node2 <none> <none>
rook-ceph-osd-prepare-node3-fz6br 0/2 Completed 0 7m30s 10.42.4.16 node3 <none> <none>
rook-ceph-osd-prepare-node4-wjjzk 0/2 Completed 0 7m29s 10.42.2.23 node4 <none> <none>
rook-ceph-osd-prepare-node5-927jh 0/2 Completed 0 7m29s 10.42.6.24 node5 <none> <none>
rook-ceph-osd-prepare-node6-849h5 0/2 Completed 0 7m28s 10.42.10.24 node6 <none> <none>
rook-ceph-osd-prepare-node7-kn25p 0/2 Completed 0 7m27s 10.42.9.24 node7 <none> <none>
rook-ceph-tools-b8c679f95-rkn4r 1/1 Running 0 9m1s 10.0.2.124 node4 <none> <none>
rook-discover-5thnt 1/1 Running 0 9m 10.42.2.22 node4 <none> <none>
rook-discover-7w5j5 1/1 Running 0 9m 10.42.1.23 node1 <none> <none>
rook-discover-9j97b 1/1 Running 0 9m 10.42.0.28 node0 <none> <none>
rook-discover-ccggp 1/1 Running 0 9m 10.42.4.15 node3 <none> <none>
rook-discover-cgmbz 1/1 Running 0 9m 10.42.10.23 node6 <none> <none>
rook-discover-cmqww 1/1 Running 0 9m 10.42.7.21 node2 <none> <none>
rook-discover-ggm7q 1/1 Running 0 9m 10.42.9.22 node7 <none> <none>
rook-discover-j7xjr 1/1 Running 0 9m 10.42.6.23 node5 <none> <none>
$ kubectl -n rook-ceph get pods -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
...
rook-ceph-mgr-a-7c86d8c55b-29n8b 1/1 Running 0 3d18h 10.42.9.23 node7 <none> <none>
...
$ kubectl -n rook-ceph get service
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
rook-ceph-mgr ClusterIP 10.43.49.73 <none> 9283/TCP 26m
rook-ceph-mgr-dashboard ClusterIP 10.43.68.50 <none> 8443/TCP 26m
rook-ceph-mgr-dashboard-external-https NodePort 10.43.114.102 <none> 8443:32411/TCP 6m9s
rook-ceph-mon-a ClusterIP 10.43.214.249 <none> 6789/TCP,3300/TCP 27m
rook-ceph-mon-b ClusterIP 10.43.229.139 <none> 6789/TCP,3300/TCP 27m
rook-ceph-mon-c ClusterIP 10.43.57.138 <none> 6789/TCP,3300/TCP 26m
$ kubectl -n rook-ceph get service
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
rook-ceph-mgr ClusterIP 10.43.49.73 <none> 9283/TCP 15m
rook-ceph-mgr-dashboard ClusterIP 10.43.68.50 <none> 8443/TCP 15m
rook-ceph-mon-a ClusterIP 10.43.214.249 <none> 6789/TCP,3300/TCP 16m
rook-ceph-mon-b ClusterIP 10.43.229.139 <none> 6789/TCP,3300/TCP 16m
rook-ceph-mon-c ClusterIP 10.43.57.138 <none> 6789/TCP,3300/TCP 16m
apiVersion: v1
kind: Service
metadata:
name: webdav-service
labels:
app: webdav-service
spec:
ports:
- port: 8082
targetPort: 80
type: LoadBalancer
selector:
name: webdav-rook
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
annotations:
deployment.kubernetes.io/revision: "1"
creationTimestamp: null
generation: 1
labels:
name: webdav-rook
name: webdav-rook
selfLink: /apis/extensions/v1beta1/namespaces/default/deployments/webdav
spec:
progressDeadlineSeconds: 2147483647
replicas: 2
revisionHistoryLimit: 10
selector:
matchLabels:
name: webdav-rook
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 1
type: RollingUpdate
template:
metadata:
creationTimestamp: null
labels:
name: webdav-rook
spec:
containers:
- image: atlp/esp-webdav
imagePullPolicy: Always
name: webdav-rook
volumeMounts:
- mountPath: "/shared"
name: volume
resources: {}
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
dnsPolicy: ClusterFirst
restartPolicy: Always
schedulerName: default-scheduler
securityContext: {}
terminationGracePeriodSeconds: 30
volumes:
- name: volume
flexVolume:
driver: ceph.rook.io/rook
fsType: ceph
options:
fsName: myfs # name of the filesystem specified in the filesystem CRD.
clusterNamespace: rook-ceph
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment