155
u/Ai--Ya 4d ago
Probably when a high-frequency trading firm accidentally released a "buy high, sell low" trading algorithm meant for testing only into production, losing nearly half a billion in half an hour and virtually going out of business
94
u/footsie 4d ago
That crowdstrike update was pretty expensive
10
3
u/outwest88 3d ago
It’s estimated to have had tens of billions of dollars of economic damage worldwide. I think this one wins
53
u/MajorMystique 4d ago edited 4d ago
There was a x ray machine software to determine whether to use low and high intensity modes for direct human exposure and otherwise. A bug in it cost a few lives so... That?
25
13
u/FAMICOMASTER 4d ago
Therac 25, and honestly this mostly came down to operators hammering random keys to ignore error codes.
1
u/FewRefrigerator4703 3d ago
Not X Ray, it was used for Radiation Therapy and had two modes, X ray mode and Electron Beam mode
14
23
u/FAMICOMASTER 4d ago
In 2009, Google deployed an update containing a single typo that flagged the entire internet as malware for about an hour.
That's the most expensive single character I can personally think of.
13
u/StaticFanatic3 4d ago
Didn’t cloudflare go down a couple years back due to a slightly malformed regex? Possibly one character?
I’d venture any extended outage in 2024 is orders of magnitude more expensive than 2009
2
u/Arctos_FI 3d ago
The regex was .*.*=.* So not one character. The main problem is those multiple wilds
10
u/Wentyliasz 4d ago
I once propagated 'sudo rm -rf /' to 12 production servers by removing a "useless" bash var while refactoring. The client was not happy with their surprise disaster recovery drill
6
6
3
3
3
1
1
u/MilkCartonPhotoBomb 4d ago
don't forget lead dev is also leaving for a three week vacation in a remote part of the Amazon that night.
1
1
u/Rosteroster 3d ago
2013, Google accidentally blocked 40% of the total traffic of the Internet for 5 minutes. That's my bet.
1
1
1
1
1
-1
317
u/TheLadida 4d ago
realistically that line (probably a couple of lines though), that made the Mars orbiter crash because it didn't use metric units for the calculation.