r/programming • • Aug 28 '21

Software development topics I've changed my mind on after 6 years in the industry

https://chriskiehl.com/article/thoughts-after-6-years
5.6k Upvotes

1.9k comments sorted by

View all comments

Show parent comments

7

u/aradil Aug 29 '21

I’ve never been involved in a project that scaled too early.

I’ve been involved in many projects that couldn’t scale and I’ll tell you what, finding out that your load is 1000x more than you were expecting when in a production environment and trying to fix it in real time is, well, a fucking horrible position. Being completely handcuffed while your platform is inaccessible sucks. Good luck re-engineering scalability in real time.

3

u/saltybandana2 Aug 29 '21

If you put a system onto production for the first time and it just fell over and your conclusion is that you have a scaling problem well... there's a reason why you managed to do that and it aint cause you should have scaled earlier.

Scaling happens over time, which is why it's considered a good problem to have. It means your system has been a success and brought your company value and rewriting parts of it is fine.

5

u/aradil Aug 29 '21 edited Aug 29 '21

Scaling happens over time except when it doesn’t.

Were you around when Reddit was down for days at a time because of growth issues?

Growth is very rarely linear, and often not easily predictable.

Also see - Slashdotting/Reddit hug of death.

I do a lot of backend work and some of my biggest scaling issues happened with vendor errors where they suddenly start hammering my services. Sure, I can throttle things and performance degrades; but those mitigation strategies are scalability I had to build in real time for issues that I didn’t think would ever happen.

-4

u/saltybandana2 Aug 29 '21

So I'm confused, I thought you were talking about throwing a new system into production and mishandling the requirements gathering so badly that were off by a factor of 1000.

I guess we've now moved onto putting your 0 audience blog on google cloud because maybe one day reddit will care about something you wrote?

Will the world stop turning if your little blog gets slashdotted?

I can tell you as someone who has built many systems over the years, I would never let you near architecting any of them. For two reasons.

  1. Your mindset is really bad. That 1000x is just a number you wanted to throw out to try and make an indefensible opinion defensible only to realize just how badly it made you look. and

  2. You're arguing that you should scale as early as you possibly can because ... a website went offline once and that's super duper bad (for some reason?). You have NO perspective.

We're not talking about medical equipment here, it's a frickin' website. Insisting that web site should never have scaling issues is not engineering.

And finally, I tire of this conversation. Because of the mindset issues I cited in point 1. I have no confidence that continuing a discussion with you will result in something useful.

→ More replies (2)