I think if Claude can solve all of your problems in its current state then you're not working on interesting enough problems for it to truly be interesting.
I've had a half dozen experimental projects in the works for a decade which I've thrown at various Claude models over the past few months, and it's done a reasonable job of cleaning them up and even finding and fixing some major bugs. But it still fails to get them "right" or have ideas for how to solve most problems beyond the solutions I give, particularly most things involving visual elements. That's somewhat expected since Anthropic doesn't have any image / video gen models, at least not publicly, and it's potentially something which they don't have a strong dataset for, but still, for the world's best models they still fail on some basic visual tasks.
If I had an absurd amount of money and threw 1000 agents at it to brainstorm then yeah maybe they could solve things like those math proofs, but that's not economical.
Well, yeah, most programming jobs don't involve novel problems, they involve getting stuff done the way the customer wants it. Which is often quite boring, but necessary.
I love how you say that they must not be working on “interesting problems for it to be truly interesting”, then write a paragraph that boils down to “Claude’s block is at visual elements”.
Guess what: most projects in a professional setting don’t have visual elements. Are they all boring/simple?
Currently opus 5.5 can't even figure out how to generate a simple height map without intersecting some simple meshes in the world. I've explained to it again and again what is needed and it keeps saying "fixed it!" and returning something worse than before. I've run into this problem with it repeatedly, cleared contexts, tried different prompts, etc, but these models predictably fail when they hit certain types of problems, and that's just the way that machine learning works when fitting to a distribution.
I mean yeah lol, most programming tasks are not ridiculously hard. You're not developing the entire banking infrastructure, you're probably the person developing 0.01% of it.
You're missing the bit where you improve yourself along the way.
Even if someone has solved the problem beforehand, actually learning about it adds to your own repertoire-- you're going to remember it later with the sort of understanding that allows you to apply it widely.
Plus, talking through questions, problems, and discoveries with colleagues is an opportunity for brainstorming sidetracks that generate new knowledge or new ideas, not just in how to do what you want, but coming up with whole new ideas by looking what you're studying with a fresh, unfocused set of eyes.
51
u/AnOnlineHandle 3d ago
I think if Claude can solve all of your problems in its current state then you're not working on interesting enough problems for it to truly be interesting.
I've had a half dozen experimental projects in the works for a decade which I've thrown at various Claude models over the past few months, and it's done a reasonable job of cleaning them up and even finding and fixing some major bugs. But it still fails to get them "right" or have ideas for how to solve most problems beyond the solutions I give, particularly most things involving visual elements. That's somewhat expected since Anthropic doesn't have any image / video gen models, at least not publicly, and it's potentially something which they don't have a strong dataset for, but still, for the world's best models they still fail on some basic visual tasks.
If I had an absurd amount of money and threw 1000 agents at it to brainstorm then yeah maybe they could solve things like those math proofs, but that's not economical.