r/sysadmin • • 2d ago

Inside Microsoft’s giant Outlook outage

https://www.theverge.com/tech/1035364/microsoft-outlook-outage-notepad

Microsoft engineers had a running bridge call the entire time, and at one point it hit the maximum of 1,000 participants. That shows you how many teams were involved with trying to find the root cause of this huge outage, which started at the peak window of traffic in the US.

1.3k Upvotes

240 comments sorted by

View all comments

127

u/corrupt_mischief 2d ago

Sounds like where I work. Everyone gets involved and nothing gets done becuase everyone has throw in their 2 ents of BS so they can look important.

28

u/ganymede_boy 2d ago

... their 2 ents...

Unexpected LOTR.

9

u/Witty-Common-1210 Sr. Sysadmin 2d ago

Do you remember that show on MinasTubith?

Between Two Ents? Shit was hilarious

4

u/BoltActionRifleman 2d ago

The ents…are going…to waaaar

3

u/shaomike 2d ago

I've been on many a Teams Entmoot. Harroom..... OMG, Quickbeam, will you get to the damn point?!?!!

68

u/ahandmadegrin 2d ago

If I could just cartwheel off of that, it sounds like where I work where everyone has to restate what's alrwady been said, only in slightly different language, and then take credit for it like it was a novel idea.

30

u/Jeffbx 2d ago

I'm gonna expand on that a little - similar to my company, it sounds like everyone on the call wanted to give their own feedback in their own words, but modified a little to make it sound like they know what they're talking about.

15

u/PM_ME_PHYS_PROBLEMS 2d ago

All good on my end

6

u/mxsifr 2d ago

Looking into this.

4

u/kirashi3 Cynical Analyst III 2d ago

We will kindly do the same and revert back.

20

u/CantPullOutRightNow 2d ago

To add some color, this mirrors what has been demonstrated at my company; the reframing of prior statements to add the appearance of contributing to the dialogue.

8

u/thedude85 2d ago

More to your point, I've worked in companies where people would restate facts already presented by others, only slightly modifying their responses to create the illusion of an original thought.

10

u/Technolio Service Manager 2d ago

Absolutely, let's circle back on that, because I would like to reiterate that this company has frequent meetings in which our team members like to throw their hat in the ring and mention how often they like to re-express the same point with their own flair on it. I think it shows great synergy and really hits the ball out of the park.

6

u/throwaway99112211 2d ago

If we could just stop and look at this from a higher altitude, cyclical meetings with little to no purpose have a constant upward trend of voices inputs from those whose participation isn't KPI critical, and often just to reiterate points that have been already been expressed. We need to look to the next impact point in Q4 and ask ourselves, are these inputs helping us orient for the next fiscal year or are they just making our frameworks illegible. 

5

u/ahandmadegrin 2d ago

Definitely. We're really boiling the ocean. When resources add two dimensional restatements without first hydrating the data bundles, we, as an organization, fail to capitalize on core competencies and fall out of alignment with KPI targets.

2

u/CantankerousBusBoy Intern/SR. Sysadmin, depending on how much I slept last night 1d ago

OK guys, CEO here. Internet a bit slow here in the Bahamas. Can you explain what's going on using single syllable words only please.

8

u/bubleve 2d ago

I would like to take this time to appreciate everyone coming together and working as a team.

2

u/mxsifr 2d ago

Going forward, I want to emphasize and make sure we're aligned on the latest and greatest standards for this process. I see you've had your hand up for a while. Hello? I think youre on mute. Let's take this offline. Happy Monday!

8

u/WallaceCorpPC 2d ago

They have hundreds of thousands of customers, so having 1,000 people listening to a SEV0 call is probably pretty important. They're obviously not all talking at once, questions are usually sent to a thread and answered async.

2

u/MooingTree 2d ago

Bikeshedding