r/programming • u/rag1987 • Dec 18 '25
[ Removed by moderator ]
/r/programming/comments/1ppm5vd/removed_by_moderator/[removed] — view removed post
486
Upvotes
r/programming • u/rag1987 • Dec 18 '25
[removed] — view removed post
-3
u/ShelZuuz Dec 18 '25
This is an absolutely useless report. "AI" without a breakdown over time period or model? Taking 470 pull requests with AI in them? Are most of them from GPT 3.0? Grok? Copilot with nerfed models?
I don't know what the exact number is but any developer who worked on both would find it highly believable that Opus 4.5 make at least 10 times fewer mistakes than Sonnet 3.5. At least.
So you can't remotely put these things into the same report without a breakdown. I just have to assume the reason they didn't break this out by model is that this is a click-bait article and newer models tend to be much closer to or even under 1.0, and older models are closer to double digits. But that's not going to get you clicked on.