etcd membership

etcd.md

• Clustering: https://coreos.com/etcd/docs/latest/v2/clustering.html#etcd-discovery

• Discovery Protocol: https://coreos.com/etcd/docs/latest/v2/discovery_protocol.html

• Docker: https://coreos.com/etcd/docs/latest/op-guide/container.html#docker

• Runtime Reconfig:

  • https://coreos.com/etcd/docs/latest/op-guide/runtime-configuration.html
  • https://coreos.com/etcd/docs/latest/op-guide/runtime-reconf-design.html

• Members HTTP v2 API: https://coreos.com/etcd/docs/latest/v2/members_api.html

• Members v3 GRPC API: https://coreos.com/etcd/docs/latest/dev-guide/api_reference_v3.html#service-cluster-etcdserveretcdserverpbrpcproto

• Disaster Recovery: https://coreos.com/etcd/docs/latest/op-guide/recovery.html

• ENV/ Flags: https://github.com/coreos/etcd/blob/master/Documentation/op-guide/configuration.md

• TLS:

  • https://github.com/coreos/etcd/blob/master/Documentation/op-guide/security.md#notes-for-dns-srv
  • https://coreos.com/os/docs/latest/generate-self-signed-certificates.html

{
    "signing": {
        "default": {
            "expiry": "43800h"
        },
        "profiles": {
            "server": {
                "expiry": "43800h",
                "usages": [
                    "signing",
                    "key encipherment",
                    "server auth"
                ]
            },
            "client": {
                "expiry": "43800h",
                "usages": [
                    "signing",
                    "key encipherment",
                    "client auth"
                ]
            },
            "peer": {
                "expiry": "43800h",
                "usages": [
                    "signing",
                    "key encipherment",
                    "server auth",
                    "client auth"
                ]
            }
        }
    }
}

initial-cluster-token: If you are spinning up multiple clusters (or creating and destroying a single cluster) with same configuration for testing purpose, it is highly recommended that you specify a unique initial-cluster-token for the different clusters. By doing this, etcd can generate unique cluster IDs and member IDs for the clusters even if they otherwise have the exact same configuration. This can protect you from cross-cluster-interaction, which might corrupt your clusters.

Raft:

• Visualization: http://thesecretlivesofdata.com/raft/
• Website: https://raft.github.io/
• Library: https://github.com/coreos/etcd/tree/master/raft
• Example: https://github.com/coreos/etcd/tree/master/contrib/raftexample

Video:

• https://www.youtube.com/watch?v=6bBggO6KN_k
• https://www.youtube.com/watch?v=c2RyuTyVHxE
• https://www.youtube.com/watch?v=YbZ3zDzDnrw

CRDT: https://medium.com/@istanbul_techie/a-look-at-conflict-free-replicated-data-types-crdt-221a5f629e7e
CRDT vs OT: https://stackoverflow.com/questions/26694359/differences-between-ot-and-crdt

etcd: https://github.com/Quentin-M/etcd-cloud-operator

Config: https://github.com/coreos/etcd/blob/master/embed/config.go#L105:2

ETCD clientv3 usage examples:

• https://github.com/Quentin-M/etcd-cloud-operator/blob/master/pkg/etcd/client.go
• https://godoc.org/github.com/coreos/etcd/clientv3

Glossary: https://github.com/coreos/etcd/blob/master/Documentation/learning/glossary.md

• How to detect membership changes?

Leader Election: https://www.sandtable.com/etcd3-leader-election-using-python/

		ECO: operator.Config{
			UnhealthyMemberTTL: 2 * time.Minute,
			Etcd: etcd.EtcdConfiguration{
				DataDir: "/var/lib/etcd",
				PeerTransportSecurity: etcd.SecurityConfig{
					AutoTLS: true,
				},
				BackendQuota: 2 * 1024 * 1024 * 1024,
			},
			Snapshot: snapshot.Config{
				Interval: 30 * time.Minute,
				TTL:      24 * time.Hour,
			},
		},