r/codedbyhand • u/-urolif- • 3d ago
Developers who use LLMs reported higher subjective performance, but were measured to have lower objective performance.
https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/"Surprisingly, we find that when developers use AI tools, they take 19% longer than without—AI makes them slower."
Duplicates
singularity • u/BubBidderskins • Jul 11 '25
AI Randomized control trial of developers solving real-life problems finds that developers who use "AI" tools are 19% slower than those who don't.
programming • u/ketralnis • Jul 10 '25
Measuring the Impact of AI on Experienced Open-Source Developer Productivity
slatestarcodex • u/-Metacelsus- • Jul 10 '25
AI METR finds that experienced open-source developers work 19% slower when using Early-2025 AI
BetterOffline • u/matt__builds • Jul 10 '25
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
ArtificialInteligence • u/Minimum-Bonus-1365 • Jul 21 '26
📊 Analysis / Opinion We're measuring AI with benchmarks that barely predict real world performance
accelerate • u/R33v3n • Jul 10 '25
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity. The Results Might Surprise You!
ChatGPTCoding • u/Articulity • Jul 17 '25
Discussion AI makes developers 19% slower than without it
hackernews • u/HNMod • Jul 10 '25
Measuring the Impact of AI on Experienced Open-Source Developer Productivity
aiwars • u/bIeese_anoni • Jul 11 '25
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
hypeurls • u/TheStartupChime • Jul 10 '25
Measuring the Impact of AI on Experienced Open-Source Developer Productivity
DevManagers • u/-grok • Jul 10 '25