Cilium vxlan overlay w/ Terraform
The AWS EKS team works extremely hard. We appreciate all of their effort.
aws-vpc-cni requires fine-tuning of complex settings, and:
- Limits the number of pods you can run on an EC2, based on the number of ENIs that instance size (or type) can support. Pod density is valuable.
- Requires you to play with settings like
- Runs into conditions where Pods get stuck in "Creating," since IP management gets tricky based on cluster pod churn, and aws-vpc-cni...and
ENABLE_PREFIX_DELEGATION+ branching can lead to a lot of wasted IPs