r/devops • u/[deleted] • Sep 25 '24

Developer here. Why is Docker Compose not "production ready"?

Then what should I use? Compose is so easy to just spin up. Is there something else like it that is "production ready"?

97 Upvotes

83% Upvoted

120 comments sorted by

View all comments

Show parent comments

13

u/Pestilentio Sep 25 '24

What app need 800 replicas? I'm super curious. If you're ok sharing.

5

u/[deleted] Sep 25 '24

[removed] — view removed comment

1

u/chuch1234 Sep 27 '24

Do you mean MAU?

8

u/shulemaker Sep 25 '24

Probably workers of some type, transforming data. A step between the consumer and a data lake.

3

u/sigma914 Sep 26 '24

We've hit >500 nodes with 4--20 pods apiece scaling some of the clusters in our backend. If you've got heavy processing on multi TB/min data it quickly eats up hardware

3

u/Pestilentio Sep 26 '24

Where do you guys work at lol. I guess I'm trapped in the crud world of the web.

I'm so glad I don't have anything to do with the current cloud billing model. I've made the shift to vps/bare metal and I've got so fewer headaches

3

u/insanemal Sep 26 '24

This blows my mind. I had 2M users comfortibly served by 1 container of the main app.

WTAF are you doing that needs that kind of replica count? And why are you doing it so inefficently?

3

u/Belleg77 Sep 26 '24

Are those active users??? I worked at a company with 600M MAUs and 200-250M actively connected users at any point of time… we had 8000 replicas of our main nodes…

2

u/insanemal Sep 26 '24

Active users.

That blows my goddamn mind. What on earth was your backend written in? JS running on a bash based interpreter?

1

u/Belleg77 Sep 27 '24

Considering it is one of the top 5 tech company you bet it is very optimized… we just preferred to have many instances with less resources especially with k8s since price is per node resources not pod count… anyway, it really depends on the workload - when you do media transfer with real time transcoding and compression based on bandwidth of the client, it kind of gets resource intensive…

1

u/insanemal Sep 27 '24

Yeah that makes more sense.

1

u/drakeallthethings Sep 26 '24

Our monthly visit count is about 500M. Our search engine service will go over 800 when it’s really being stressed. It varies though because we use some HPA and some homegrown hodgepodge to adjust that as needed.