Proxmox Docker Monster! Running 13000 containers on a single host!
Following up on a blog post that is hot off the press on my site, I wanted to create the video form of this topic. I have been playing around with Proxmox and Docker containers in the lab. With my SuperMicro E300-9D hardware with 16 cores and 128 GB of memory, how many containers can you run?
Subscribe to the channel: / @virtualizationhowto
My blog:
https://www.virtualizationhowto.com
_____________________________________________________
Social Media:
/ vspinmaster
LinkedIn:
/ brandon-lee-vht
Github:
https://github.com/brandonleegit
Introduction - 0:10
How many containers can you run? 0:50
Docker Swarm to initialize thousands of containers - 1:00
Creating a Docker host template - 1:20
Experimenting with LXC vs virtual machines - 1:39
The memory configuration and what I settled upon - 2:15
Creating a single node Docker swarm host and service, as well as scaling replicas - 2:34
Alterating between nginx and redis containers - 3:00
How did I decide on 1000 containers for each virtual machine? 3:38
Workaround for the maximum connections to the Linux bridge - 4:29
Bringing up the 10th and 11th hosts up - 5:00
Initializing the Docker Swarm host - 5:40
Scaling the host to 1000 containers - 6:40
Containers starting to scale up - 7:10
Checking out the host hardware performance - 7:23
Reached 10000 Docker containers running on the Proxmox host - 8:00
We hit 10000, can we go higher? 8:23
Bringing up the additional Docker container hosts - 8:50
Also spun up host 11, on way to 13000 containers - 9:17
CPU is pegged at 100% but still have memory headroom - 9:34
100% CPU usage and over 90% memory usage - 10:17
We made it! 13000 containers - 10:35
Proxmox allows you to run Docker, LXC, and even Docker on the host itself - 11:20
Can't believe achieved 13,000 containers, concluding thoughts - 11:50
Read the written blog post covering this experiment in the home lab!
https://www.virtualizationhowto.com/2...
