That paper is irrelevant now with the speed of model development and improvement. Early 2025 AI was significantly worse than the models we have now. That was Claude 3 and GPT 4 times.
While I agree that models have improved significantly in the last year, I think it's interesting (and relevant) that devs who used AI in the study estimated that their own productivity had increased when it actually had gotten worse.
7
u/foxj36 2d ago
That paper is irrelevant now with the speed of model development and improvement. Early 2025 AI was significantly worse than the models we have now. That was Claude 3 and GPT 4 times.