Mark Builds a k8s cluster.
- Install kops
Last login: Wed Jul 13 14:08:05 on ttys020
~ % go get -d k8s.io/kops
~ % cd ${GOPATH}/src/k8s.io/kops/
kops [master] % make
GO15VENDOREXPERIMENT=1 go install -ldflags "-X main.BuildVersion=git-25d1e97" k8s.io/kops/cmd/...
ln -sfn /Users/mark.turner/mygo/src/k8s.io/kops/upup/models/ /Users/mark.turner/mygo/bin/models
kops [master] %
- Use existing customer-domain.com zone in my AWS account
- Create S3 Bucket
kops [master] % aws s3api create-bucket --bucket amerine-k8s-bucket --region us-west-1
{
"Location": "/amerine-k8s-bucket"
}- Setup Env
kops [master] % export NAME=k8s.customer-domain.com
kops [master] % export KOPS_STATE_STORE=s3://amerine-k8s-bucket- Try a create
kops [master] % ${GOPATH}/bin/kops create cluster --v=0 --cloud=aws --zones=us-west-1b,us-west-1c --name ${NAME}
I0713 15:53:52.708425 17489 cluster.go:278] Assigned CIDR 172.20.64.0/19 to zone us-west-1b
I0713 15:53:52.708462 17489 cluster.go:278] Assigned CIDR 172.20.96.0/19 to zone us-west-1c
I0713 15:53:53.609687 17489 create_cluster.go:273] Using kubernetes latest stable version: v1.3.0
W0713 15:53:53.609719 17489 create_cluster.go:285] Normalizing kubernetes version: "v1.3.0" -> "1.3.0"
I0713 15:53:53.609738 17489 create_cluster.go:294] Adding default kubelet release asset: https://storage.googleapis.com/kubernetes-release/release/v1.3.0/bin/linux/amd64/kubelet
I0713 15:53:53.609750 17489 create_cluster.go:297] Adding default kubelet release asset: https://storage.googleapis.com/kubernetes-release/release/v1.3.0/bin/linux/amd64/kubectl
I0713 15:53:53.609789 17489 create_cluster.go:306] Using default nodeup location: "https://kubeupv2.s3.amazonaws.com/nodeup/nodeup-1.3.tar.gz"
I0713 15:53:54.452210 17489 create_cluster.go:440] Defaulting DNS zone to: Z2FA1PPOAX30TN
I0713 15:53:54.574363 17489 executor.go:70] Tasks: 0 done / 49 total; 22 can run
I0713 15:53:55.104249 17489 vfs_castore.go:336] Issuing new certificate: "master"
I0713 15:53:55.219263 17489 vfs_castore.go:336] Issuing new certificate: "kubelet"
I0713 15:53:55.315156 17489 vfs_castore.go:336] Issuing new certificate: "kubecfg"
I0713 15:53:56.641778 17489 executor.go:70] Tasks: 22 done / 49 total; 11 can run
I0713 15:53:57.247815 17489 executor.go:70] Tasks: 33 done / 49 total; 14 can run
W0713 15:53:57.753965 17489 executor.go:86] error running task "launchConfiguration/nodes.k8s.customer-domain.com": IAM instance profile not yet created/propagated
W0713 15:53:57.754018 17489 executor.go:86] error running task "launchConfiguration/master-us-west-1b.masters.k8s.customer-domain.com": IAM instance profile not yet created/propagated
I0713 15:53:57.754077 17489 executor.go:70] Tasks: 45 done / 49 total; 2 can run
W0713 15:53:58.002223 17489 executor.go:86] error running task "launchConfiguration/nodes.k8s.customer-domain.com": IAM instance profile not yet created/propagated
W0713 15:53:58.002268 17489 executor.go:86] error running task "launchConfiguration/master-us-west-1b.masters.k8s.customer-domain.com": IAM instance profile not yet created/propagated
I0713 15:53:58.002294 17489 executor.go:100] No progress made, sleeping before retrying failed tasks
I0713 15:54:08.004900 17489 executor.go:70] Tasks: 45 done / 49 total; 2 can run
I0713 15:54:08.529515 17489 executor.go:70] Tasks: 47 done / 49 total; 2 can run
I0713 15:54:09.153139 17489 executor.go:70] Tasks: 49 done / 49 total; 0 can run
I0713 15:54:09.153303 17489 create_cluster.go:372] Exporting kubecfg for cluster
Wrote config for k8s.customer-domain.com to "/Users/mark.turner/.kube/config"- List Nodes Now
kops [master] % kubectl get nodes
NAME STATUS AGE
ip-172-20-80-35.us-west-1.compute.internal NotReady 3s
ip-172-20-90-251.us-west-1.compute.internal Ready,SchedulingDisabled 2s
ip-172-20-97-99.us-west-1.compute.internal NotReady 3s- Lets Deploy something
% kubectl run my-nginx --image=nginx --replicas=2 --port=80
deployment "my-nginx" created
% kubectl get pods
NAME READY STATUS RESTARTS AGE
my-nginx-2494149703-6tuje 0/1 ContainerCreating 0 8s
my-nginx-2494149703-vjs1u 0/1 ContainerCreating 0 8s
hellojs % kubectl get pods
NAME READY STATUS RESTARTS AGE
my-nginx-2494149703-6tuje 0/1 ContainerCreating 0 10s
my-nginx-2494149703-vjs1u 1/1 Running 0 10s
% kubectl get pods
NAME READY STATUS RESTARTS AGE
my-nginx-2494149703-6tuje 1/1 Running 0 11s
my-nginx-2494149703-vjs1u 1/1 Running 0 11s
% kubectl get pods
NAME READY STATUS RESTARTS AGE
my-nginx-2494149703-6tuje 1/1 Running 0 12s
my-nginx-2494149703-vjs1u 1/1 Running 0 12s
% kubectl get pods
NAME READY STATUS RESTARTS AGE
my-nginx-2494149703-6tuje 1/1 Running 0 13s
my-nginx-2494149703-vjs1u 1/1 Running 0 13s
% kubectl get deployments
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
my-nginx 2 2 2 2 21s- Expose it to the world
% kubectl expose deployment my-nginx --port=80 --type=LoadBalancer
service "my-nginx" exposed
~ % kubectl describe service/my-nginx
Name: my-nginx
Namespace: default
Labels: run=my-nginx
Selector: run=my-nginx
Type: LoadBalancer
IP: 100.65.159.242
LoadBalancer Ingress: a59da6c06494f11e6a9f006fad1d38cc-298750444.us-west-1.elb.amazonaws.com
Port: <unset> 80/TCP
NodePort: <unset> 30264/TCP
Endpoints: 100.96.0.3:80,100.96.1.4:80
Session Affinity: None
Events:
FirstSeen LastSeen Count From SubobjectPath Type Reason Message
--------- -------- ----- ---- ------------- -------- ------ -------
16m 16m 1 {service-controller } Normal CreatingLoadBalancer Creating load balancer
16m 16m 1 {service-controller } Normal CreatedLoadBalancer Created load balancer
- Lets try hitting that IP
~ % http a59da6c06494f11e6a9f006fad1d38cc-298750444.us-west-1.elb.amazonaws.com
HTTP/1.1 200 OK
Accept-Ranges: bytes
Connection: keep-alive
Content-Length: 612
Content-Type: text/html
Date: Wed, 13 Jul 2016 23:30:15 GMT
ETag: "574da256-264"
Last-Modified: Tue, 31 May 2016 14:40:22 GMT
Server: nginx/1.11.1
<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
body {
width: 35em;
margin: 0 auto;
font-family: Tahoma, Verdana, Arial, sans-serif;
}
</style>
</head>
<body>
<h1>Welcome to nginx!</h1>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>
<p>For online documentation and support please refer to
<a href="http://nginx.org/">nginx.org</a>.<br/>
Commercial support is available at
<a href="http://nginx.com/">nginx.com</a>.</p>
<p><em>Thank you for using nginx.</em></p>
</body>
</html>- Scale up to 10 processes
~ % kubectl scale deployment my-nginx --replicas=10
deployment "my-nginx" scaled
~ % kubectl get deployment
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
my-nginx 10 10 10 10 21m
~ % kubectl get nodes
NAME STATUS AGE
ip-172-20-80-35.us-west-1.compute.internal Ready 35m
ip-172-20-90-251.us-west-1.compute.internal Ready,SchedulingDisabled 35m
ip-172-20-97-99.us-west-1.compute.internal Ready 35m
~ % kubectl get pods
NAME READY STATUS RESTARTS AGE
my-nginx-2494149703-6tuje 1/1 Running 0 21m
my-nginx-2494149703-8tm8r 1/1 Running 0 26s
my-nginx-2494149703-b0dua 1/1 Running 0 26s
my-nginx-2494149703-hac0l 1/1 Running 0 26s
my-nginx-2494149703-vjs1u 1/1 Running 0 21m
my-nginx-2494149703-vmtes 1/1 Running 0 26s
my-nginx-2494149703-xwtql 1/1 Running 0 26s
my-nginx-2494149703-yh8t7 1/1 Running 0 26s
my-nginx-2494149703-zi2st 1/1 Running 0 26s
my-nginx-2494149703-zq142 1/1 Running 0 26s- Lets start a shell
~ % kubectl run -i --tty load-generator --image=busybox /bin/sh
Waiting for pod default/load-generator-1487968570-l8mqm to be running, status is Pending, pod ready: false
Waiting for pod default/load-generator-1487968570-l8mqm to be running, status is Pending, pod ready: false
Hit enter for command prompt
/ #- Lets use the internal service DNS
/ # wget -O- http://my-nginx.default.svc.cluster.local
Connecting to my-nginx.default.svc.cluster.local (100.65.159.242:80)
<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
body {
width: 35em;
margin: 0 auto;
font-family: Tahoma, Verdana, Arial, sans-serif;
}
</style>
</head>
<body>
<h1>Welcome to nginx!</h1>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>
<p>For online documentation and support please refer to
<a href="http://nginx.org/">nginx.org</a>.<br/>
Commercial support is available at
<a href="http://nginx.com/">nginx.com</a>.</p>
<p><em>Thank you for using nginx.</em></p>
</body>
</html>
- 100% |*******************************| 612 0:00:00 ETA- Lets enter a running container
~ % kubectl get pods
NAME READY STATUS RESTARTS AGE
load-generator-1487968570-l8mqm 1/1 Running 1 5m
my-nginx-2494149703-6tuje 1/1 Running 0 31m
my-nginx-2494149703-8tm8r 1/1 Running 0 10m
my-nginx-2494149703-b0dua 1/1 Running 0 10m
my-nginx-2494149703-hac0l 1/1 Running 0 10m
my-nginx-2494149703-vjs1u 1/1 Running 0 31m
my-nginx-2494149703-vmtes 1/1 Running 0 10m
my-nginx-2494149703-xwtql 1/1 Running 0 10m
my-nginx-2494149703-yh8t7 1/1 Running 0 10m
my-nginx-2494149703-zi2st 1/1 Running 0 10m
my-nginx-2494149703-zq142 1/1 Running 0 10m
~ % kubectl exec -ti my-nginx-2494149703-b0dua -- bash
root@my-nginx-2494149703-b0dua:/# w
23:44:04 up 49 min, 0 users, load average: 0.14, 0.10, 0.10
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
root@my-nginx-2494149703-b0dua:/# ls
bin dev home lib64 mnt proc run srv tmp var
boot etc lib media opt root sbin sys usr
root@my-nginx-2494149703-b0dua:/# ls -la
total 72
drwxr-xr-x 35 root root 4096 Jul 13 23:33 .
drwxr-xr-x 35 root root 4096 Jul 13 23:33 ..
-rwxr-xr-x 1 root root 0 Jul 13 23:33 .dockerenv
drwxr-xr-x 2 root root 4096 May 23 17:52 bin
drwxr-xr-x 2 root root 4096 Mar 13 23:46 boot
drwxr-xr-x 5 root root 380 Jul 13 23:33 dev
drwxr-xr-x 58 root root 4096 Jul 13 23:33 etc
drwxr-xr-x 2 root root 4096 Mar 13 23:46 home
drwxr-xr-x 10 root root 4096 Jun 1 18:00 lib
drwxr-xr-x 2 root root 4096 May 23 17:51 lib64
drwxr-xr-x 2 root root 4096 May 23 17:51 media
drwxr-xr-x 2 root root 4096 May 23 17:51 mnt
drwxr-xr-x 2 root root 4096 May 23 17:51 opt
dr-xr-xr-x 123 root root 0 Jul 13 23:33 proc
drwx------ 2 root root 4096 May 23 17:51 root
drwxr-xr-x 4 root root 4096 Jul 13 23:33 run
drwxr-xr-x 2 root root 4096 May 23 17:52 sbin
drwxr-xr-x 2 root root 4096 May 23 17:51 srv
dr-xr-xr-x 13 root root 0 Jul 13 23:33 sys
drwxrwxrwt 2 root root 4096 Jun 1 18:00 tmp
drwxr-xr-x 15 root root 4096 Jun 1 18:00 usr
drwxr-xr-x 16 root root 4096 Jul 13 23:33 var
root@my-nginx-2494149703-b0dua:/# env
HOSTNAME=my-nginx-2494149703-b0dua
KUBERNETES_PORT_443_TCP_PORT=443
KUBERNETES_PORT=tcp://100.64.0.1:443
MY_NGINX_SERVICE_PORT=80
KUBERNETES_SERVICE_PORT=443
KUBERNETES_SERVICE_HOST=100.64.0.1
MY_NGINX_PORT_80_TCP_ADDR=100.65.159.242
MY_NGINX_PORT_80_TCP=tcp://100.65.159.242:80
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
PWD=/
NGINX_VERSION=1.11.1-1~jessie
MY_NGINX_PORT=tcp://100.65.159.242:80
SHLVL=1
HOME=/root
KUBERNETES_PORT_443_TCP_PROTO=tcp
KUBERNETES_SERVICE_PORT_HTTPS=443
MY_NGINX_PORT_80_TCP_PORT=80
MY_NGINX_PORT_80_TCP_PROTO=tcp
KUBERNETES_PORT_443_TCP_ADDR=100.64.0.1
KUBERNETES_PORT_443_TCP=tcp://100.64.0.1:443
MY_NGINX_SERVICE_HOST=100.65.159.242
_=/usr/bin/env- Delete everything
~ % ${GOPATH}/bin/kops delete cluster --name=${NAME} --yes
TYPE NAME ID
autoscaling-config master-us-west-1b.masters.k8s.customer-domain.com-20160713225408master-us-west-1b.masters.k8s.customer-domain.com-20160713225408
autoscaling-config nodes.k8s.customer-domain.com-20160713225408 nodes.k8s.customer-domain.com-20160713225408
autoscaling-group master-us-west-1b.masters.k8s.customer-domain.com master-us-west-1b.masters.k8s.customer-domain.com
autoscaling-group nodes.k8s.customer-domain.com nodes.k8s.customer-domain.com
dhcp-options k8s.customer-domain.com dopt-6e3b530b
iam-instance-profile masters.k8s.customer-domain.com masters.k8s.customer-domain.com
iam-instance-profile nodes.k8s.customer-domain.com nodes.k8s.customer-domain.com
iam-role masters.k8s.customer-domain.com masters.k8s.customer-domain.com
iam-role nodes.k8s.customer-domain.com nodes.k8s.customer-domain.com
instance master-us-west-1b.masters.k8s.customer-domain.com i-97005222
instance nodes.k8s.customer-domain.com i-2f03519a
instance nodes.k8s.customer-domain.com i-52bcd917
internet-gateway k8s.customer-domain.com igw-0930a46c
keypair kubernetes.k8s.customer-domain.com kubernetes.k8s.customer-domain.com
load-balancer a59da6c06494f11e6a9f006fad1d38cc
route-table k8s.customer-domain.com rtb-d44249b1
route53-record api.internal.k8s.customer-domain.com. Z2FA1PPOAX30TN/api.internal.k8s.customer-domain.com.
route53-record api.k8s.customer-domain.com. Z2FA1PPOAX30TN/api.k8s.customer-domain.com.
route53-record etcd-events-us-west-1b.internal.k8s.customer-domain.com. Z2FA1PPOAX30TN/etcd-events-us-west-1b.internal.k8s.customer-domain.com.
route53-record etcd-us-west-1b.internal.k8s.customer-domain.com. Z2FA1PPOAX30TN/etcd-us-west-1b.internal.k8s.customer-domain.com.
security-group sg-bb4726df
security-group masters.k8s.customer-domain.com sg-22432246
security-group nodes.k8s.customer-domain.com sg-21432245
subnet us-west-1b.k8s.customer-domain.com subnet-cdf9ca94
subnet us-west-1c.k8s.customer-domain.com subnet-13a05577
volume us-west-1b.etcd-events.k8s.customer-domain.com vol-5f03bee3
volume us-west-1b.etcd-main.k8s.customer-domain.com vol-ce02bf72
vpc k8s.customer-domain.com vpc-bea388db
autoscaling-group:master-us-west-1b.masters.k8s.customer-domain.com ok
load-balancer:a59da6c06494f11e6a9f006fad1d38cc ok
autoscaling-group:nodes.k8s.customer-domain.com ok
keypair:kubernetes.k8s.customer-domain.com ok
instance:i-2f03519a ok
internet-gateway:igw-0930a46c still has dependencies, will retry
instance:i-52bcd917 ok
instance:i-97005222 ok
route53-record:Z2FA1PPOAX30TN/api.k8s.customer-domain.com. ok
iam-instance-profile:nodes.k8s.customer-domain.com ok
iam-instance-profile:masters.k8s.customer-domain.com ok
iam-role:masters.k8s.customer-domain.com ok
iam-role:nodes.k8s.customer-domain.com ok
autoscaling-config:master-us-west-1b.masters.k8s.customer-domain.com-20160713225408 ok
subnet:subnet-13a05577 still has dependencies, will retry
autoscaling-config:nodes.k8s.customer-domain.com-20160713225408 ok
subnet:subnet-cdf9ca94 still has dependencies, will retry
volume:vol-ce02bf72 still has dependencies, will retry
volume:vol-5f03bee3 still has dependencies, will retry
security-group:sg-22432246 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
security-group:sg-bb4726df
volume:vol-ce02bf72
route-table:rtb-d44249b1
subnet:subnet-13a05577
volume:vol-5f03bee3
internet-gateway:igw-0930a46c
vpc:vpc-bea388db
security-group:sg-21432245
subnet:subnet-cdf9ca94
dhcp-options:dopt-6e3b530b
security-group:sg-22432246
subnet:subnet-cdf9ca94 still has dependencies, will retry
volume:vol-ce02bf72 still has dependencies, will retry
subnet:subnet-13a05577 still has dependencies, will retry
volume:vol-5f03bee3 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-22432246 still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
security-group:sg-bb4726df
volume:vol-ce02bf72
route-table:rtb-d44249b1
subnet:subnet-13a05577
volume:vol-5f03bee3
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
security-group:sg-22432246
subnet:subnet-13a05577 still has dependencies, will retry
subnet:subnet-cdf9ca94 still has dependencies, will retry
volume:vol-ce02bf72 still has dependencies, will retry
volume:vol-5f03bee3 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-22432246 still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
security-group:sg-bb4726df
volume:vol-ce02bf72
route-table:rtb-d44249b1
subnet:subnet-13a05577
volume:vol-5f03bee3
internet-gateway:igw-0930a46c
vpc:vpc-bea388db
security-group:sg-21432245
subnet:subnet-cdf9ca94
dhcp-options:dopt-6e3b530b
security-group:sg-22432246
subnet:subnet-cdf9ca94 still has dependencies, will retry
subnet:subnet-13a05577 still has dependencies, will retry
volume:vol-5f03bee3 still has dependencies, will retry
volume:vol-ce02bf72 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-22432246 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
security-group:sg-22432246
security-group:sg-bb4726df
volume:vol-ce02bf72
route-table:rtb-d44249b1
subnet:subnet-13a05577
volume:vol-5f03bee3
internet-gateway:igw-0930a46c
vpc:vpc-bea388db
security-group:sg-21432245
subnet:subnet-cdf9ca94
dhcp-options:dopt-6e3b530b
subnet:subnet-13a05577 still has dependencies, will retry
volume:vol-ce02bf72 still has dependencies, will retry
subnet:subnet-cdf9ca94 still has dependencies, will retry
volume:vol-5f03bee3 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
security-group:sg-22432246 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
security-group:sg-22432246
route-table:rtb-d44249b1
subnet:subnet-13a05577
security-group:sg-bb4726df
volume:vol-ce02bf72
volume:vol-5f03bee3
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
subnet:subnet-13a05577 still has dependencies, will retry
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
volume:vol-5f03bee3 still has dependencies, will retry
volume:vol-ce02bf72 still has dependencies, will retry
security-group:sg-22432246 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
security-group:sg-22432246
security-group:sg-bb4726df
volume:vol-ce02bf72
route-table:rtb-d44249b1
subnet:subnet-13a05577
volume:vol-5f03bee3
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
subnet:subnet-13a05577 still has dependencies, will retry
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
volume:vol-ce02bf72 ok
security-group:sg-21432245 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
volume:vol-5f03bee3 ok
security-group:sg-22432246 ok
Not all resources deleted; waiting before reattempting deletion
security-group:sg-bb4726df
route-table:rtb-d44249b1
subnet:subnet-13a05577
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
subnet:subnet-13a05577 still has dependencies, will retry
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
security-group:sg-bb4726df still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
security-group:sg-bb4726df
route-table:rtb-d44249b1
subnet:subnet-13a05577
internet-gateway:igw-0930a46c
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
subnet:subnet-13a05577 ok
security-group:sg-21432245 still has dependencies, will retry
security-group:sg-bb4726df ok
Not all resources deleted; waiting before reattempting deletion
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
route-table:rtb-d44249b1
internet-gateway:igw-0930a46c
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
route-table:rtb-d44249b1
internet-gateway:igw-0930a46c
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
route-table:rtb-d44249b1
internet-gateway:igw-0930a46c
vpc:vpc-bea388db
security-group:sg-21432245
subnet:subnet-cdf9ca94
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
route-table:rtb-d44249b1
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
route-table:rtb-d44249b1
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
subnet:subnet-cdf9ca94 still has dependencies, will retry
internet-gateway:igw-0930a46c still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
Not all resources deleted; waiting before reattempting deletion
internet-gateway:igw-0930a46c
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
route-table:rtb-d44249b1
subnet:subnet-cdf9ca94 still has dependencies, will retry
security-group:sg-21432245 still has dependencies, will retry
internet-gateway:igw-0930a46c ok
Not all resources deleted; waiting before reattempting deletion
security-group:sg-21432245
vpc:vpc-bea388db
dhcp-options:dopt-6e3b530b
subnet:subnet-cdf9ca94
route-table:rtb-d44249b1
subnet:subnet-cdf9ca94 ok
security-group:sg-21432245 ok
route-table:rtb-d44249b1 ok
vpc:vpc-bea388db ok
dhcp-options:dopt-6e3b530b ok
Cluster deleted