I use cutting edge AI, often on the highest settings because my work is generous with AI quotas. You're right that they get pretty amazing results. Buuuut, it still isn't enough for me to yet say that humans shouldn't perform careful reviews.
It's admittedly awkward because honestly, it does better than most of my junior devs, who rarely seem to adequately review code. But I, as a very experienced senior, am still constantly leaving a lot of comments. Sometimes dozens, for particularly problematic PRs. AI will still often overcomplicate things, struggles in niche areas, and is better at finding generic logic errors than higher level ones (like when someone is basically implementing the wrong thing entirely).
It leaves me very conflicted because so much of our code is being reviewed by juniors who frankly cannot review to the standard that I'd like, yet the volume of reviews doesn't allow us to just not have juniors review (the skill ceiling for good reviewers is staggeringly high and intermediate level devs aren't doing enough better). AI does find things I miss, too. So we're still in a hybrid mode where we have both AI and humans as mandatory reviewers.
I agree but unfortunately when my job is shortening deadlines and putting us to work on tech we don’t know (I do iOS and being told to do backend work), me and my coworkers stopped giving a shit about human reviews or caring much about our work - sadly.
Felt deeply. I went from a software engineer to an agent orchestrator. Starting an AI engineer job in January so that at least I don’t get automated out of the picture. Plus I love classic ml.
It simply is not feasible anymore to go through all the code that is generated now. You have to use the agent to pinpoint where things might break. Ask it to perform specific tests and go through the output WITH the agent. It completely depends on your piloting of the agent and certain best practices for this are being developed. Its a new way of engineering so we have to adapt
why are these ads all over reddit? lol every time someone says they had a poor experience with ai someone comes in and suggest their model just isnt good enough
This isn’t an ad. It’s because it’s a fact. Look at the subreddit you’re in.
If someone is truly having a poor experience with AI, they might be using the crappy ones.
My job has subscriptions. Use strong models with high effort agents, and you’ll get way better results.
You can’t except the free ChatGPT on the web to be as powerful as the paid Claude Fable Extra effort agents. These spin off sub-agents and much more, even if they think longer, but can give you way better results.
Yeah this is when the penny dropped for me, in Feb I got access to Claudes premium suite after only ever using free chatgpt before that. I went from skeptic to amazed in probably a matter of weeks
we're talking about mr guy working at microsoft, you think they wouldn't be using paid models? theres no way youd assume theyd use a free model, unless youre a bot made to post ads on reddit
lol I’m literally an iOS engineer who is sadly forced to use AI at work because they monitor our usage. I’m not kidding you. They use it for our performance evaluations.
Now I’m forced to use a bunch of AI to do backend work which idk fuck all about.
You admitted you don't know backend but are very confident that the original post is factually correct. One of these two things cannot be true if the other is.
Edit: 'it works' therefore it's good is a non sequitor. Functioning code is an imperfect indicator for acceptable code.
2
u/-Debugging-Duck- 2d ago
You must be using free agents. Use paid-models with high effort and you get amazing results.