How fast can I create 10,000 kubernetes pods?!

I managed to squeeze over 11k pods into a cluster with just 44 x 1vCPU worker nodes. I had to deploy my own control plane, increase the maximum number of pods/node, and use a tiny container that could run with just couple thousandths of a CPU!

This was a fun challenge to celebrate reaching 10,000 subscribers! In case you are wondering, the cost to spin this cluster up for the time spent recording was $1.67.

---
Join the Community:

---
Timestamps:

00:00 - Intro
00:19 - Jeff Geerling's 10k pod video
00:47 - Google Kubernetes Engine (GKE) Autopilot
01:35 - Quota increases
01:48 - New tactics!
02:30 - Kops (Kubernetes Operations)
02:51 - Cluster modifications
03:06 - Defining deployment config
03:28 - Attempt footage!
05:00 - Halfway
05:38 - Success!
05:55 - Turning it up to 11
06:50 - Outro

---

Community size at time of posting:
- Subscribers: 10209
- Channel Views: 245054

[JeffGeerling]

Heh, getting the quota increases is probably the part that took me the longest!

I wish it were easier to increase max pods per node, since there are use cases where you want more than the default and know the potential pitfalls. With AWS's default networking it's even harder though, since their networking stack can't assign more than a pretty tiny number of IP addresses per node!

Good job getting it working, and here's to the next 10, 000 subs—and beyond!

I think next up, someone does need to partner up with a cloud platform and try to get 100, 000k pods :D

[Henoknowz]

Just stumbled across this video, super interesting work! Do you happen to still have that python script that you used to monitor the pods and map it out to that neat graph? I'm starting to learn python myself and am curious about how you did that.

[eleah]

Cool. I saw my pod being created at 5:11. Hope you haven't taken it down already.

[uploadvoice]

Great job! Btw do u know how many pods I can run on a 8cores cpu with 32GB of ram ? (.. my laptop :) )

[sampath]

Just 73 likes for this awesome video. it is not fare...