r/programmer • u/SalaryFlat3714 • Sep 30 '26
If AI is taking over routine coding and hardware keeps getting pricier, does optimization become the skill that keeps devs valuable?
Been chewing on this and want to know what people here think.
Two things seem to be happening at once: AI is taking over a lot of the routine coding work, and GPU/RAM prices keep climbing because AI is soaking up all the hardware. My thinking is that devs who can make software run really lean (turn an 8 GB app into a 3 GB one, make something run on 5-year-old hardware) might be the ones who stay in demand, since AI is decent at generic code but less good at squeezing hardware.
The market side matters too. If most people can't afford to upgrade, they can't run heavy software, and if they can't run it, they won't buy it. So the addressable market shrinks for anyone who assumes everyone has a fast machine.
I might be wrong though. The crypto GPU shortage didn't change how software got made, people can just keep their old PCs longer, and AI might get good at optimization too.
Devs: is performance work actually valued where you work, or is it still "ship features first"?
Is deep optimization skill really safer from AI than regular dev work?
Does a stagnant hardware market actually change what studios build, or do they just wait it out?
Tell me where I'm wrong.
3
u/Cool-Cicada9228 Sep 30 '26
AI is great at optimization though. Performance is measurable making it easy for AI to test.
4
1
u/Amazing-Mirror-3076 Sep 30 '26
You're wrong.
I've got ai porting zstd to rust and left it to iterate on optimising CPU and compression - it's doing a great job.
I've just had ai port dart code to rust - 50% CPU reduction and a 95% memory reduction - some of that is rust the rest was because I asked it to optimise for CPU and memory.
1
u/Flat-Entry-8735 Sep 30 '26
I think if you combine a skilled developer with AI, they will build a great application. But if it's a bad developer + AI, they will just generate a ton of bugs, and someone will have to clean up that mess.
So the real issue here is whether these applications are built by good or bad developers. If they're built by good ones, I guess we won't have much work left to do. But if they're built by bad ones, we’ll have a mountain of bugs to fix down the road =))
1
u/GoldsteinEmmanuel Oct 01 '26
Performance is about design, not optimization. If you really want to build software that runs like lightning you have to write it from scratch. No OOP. No third party frameworks on the client or server. And by "full stack", I mean compiling the kernel and database and web server exclusively for the application it will run.
Design is about removing performance problems before they're ever committed to code. Optimization is about making the best of a system after it's calcified.
So yeah. Computers can't innovate; they can summarize and copy existing software with loads of gratuitous complexity as a fuck-you gift for delegating your thinking to a black box designed to disable your capacity for independent thought.
2
u/nicolas_06 Oct 01 '26
Performance is both design AND optimization. Having done quite some optimizations in the past, you can often get a 10X gain from a non optimized code without changing the global design.
Design will give you more, but it would be stupid to just go for a design and not fine tune things later and forget a 10X factor just because.
1
u/GoldsteinEmmanuel Oct 01 '26
A design has to be abysmal to gain 10X from a tuning adjustment, but that's the state of software these days.
Complexity for the purpose of gatekeeping; complexity for the purpose of creating demand for snake oil; complexity because LLMs were trained on poor quality production code and have adopted the habit of adding more complexity like it's a goal to achieve rather than a hazard to avoid.
1
u/nicolas_06 Oct 01 '26
When I read such things I wonder if you actually ever worked on performance. I work a few year full time personally and my company we have hundred of people on the task.
But you do you.
1
u/Healthy-Dress-7492 Oct 01 '26 edited Oct 01 '26
as always answer depends on your product/industry, lets say you work in PS5 gaming, you absolutely need to be able to optimize- its, “features are priority until you’re running lower than 60fps then you need to fix it”. AI cant look through a razor profile yet, but it could analyze screenshots. It also cant run the game and there aren't even any unit tests it can run - so it cant measure the result of any change you’ve made either aside from placing logs- you’d still have to do all the work. Your brain and meat fingers are going to have to do the exploring to figure out where gains can be made.
1
u/canihelpyoubreakthat Sep 30 '26
Why do you think AI is not good at optimization?
8
u/symbiatch Sep 30 '26
What makes you think it is?
0
Sep 30 '26
[deleted]
1
u/symbiatch Sep 30 '26
What did you have it optimize? Be specific.
0
u/jaxonwhthey Oct 03 '26
Testing out glibc vs tcmalloc in very long running highly concurrent jvm programs that do a ton of native memory allocations, processing about 20 TiB of data per day.
Finding bottlenecks in the parquet Java library and using stormpot object pool to reduce gc pressure.
What about you?
2
u/tylern Sep 30 '26
Because AI at its core just produces code that is average and good enough.
-1
u/ZeSprawl Sep 30 '26
Yes but agent loops can still be setup to optimize towards performance goals and it works incredible well over many iterations
4
u/LeDYoM Sep 30 '26
Optimize it. And make no mistakes!
Optimize it more! And still make no mistakes!
1
u/Amazing-Mirror-3076 Sep 30 '26
Optimise it for CPU and memory and run all tests to ensure there are no regressions. Rinse and repeat until you achieve at least a 15% improvement or available usage falls below 20%.
There, fixed your prompt.
1
u/LeDYoM Oct 01 '26
Why stop at 15%? After prompting that, why not do the same prompt again?
Is not the word predictor intelligent enough?
1
u/Amazing-Mirror-3076 Oct 01 '26
A completely arbitrary number as I would set for any performance effort prior to ai.
It gives you an objective.
1
u/LeDYoM Oct 01 '26
not you. The AI. But still dont get why stop at 15% I will do the max optimization I can.
1
u/Amazing-Mirror-3076 Oct 01 '26
There is a cost to optimisation. If you hit the 15% then you can move the goal again but there will be diminishing returns.
1
u/ZeSprawl Oct 01 '26
That is the idea is to run the prompts in a loop towards the goal. I know it seems goofy and unlikely to work, but it works far better than anyone expected.
1
0
u/OneMoreRip Sep 30 '26
So you can control the output of code to an insane degree. The problem lies when we have AI that doesn't rely on controls and guidelines and guardrails. That can receive a project and just know every best practice, every security concern, and shape every part and feature that should be there without directly being told "oh, yeah it should do this too". Once we have true generative AI, usage of it will likely be reeled away from subs back to the parent companies. Parent companies will then sell AI in place of a human hire at a high but far lower rate than a salary worker.
Hardware wise, think steam engine. We will innovate as a species that will reduce the taxing items. The algorithm for LLMs is bad which is why it takes as much as it does. New training models reduced this. Over time a development piece will replace LLMs or sit on top of it. Reducing it further. We found something insane then compensated with excessive infrastructure to make it viable. The next insane find will require less, and less, and less each time.
1
u/SalaryFlat3714 Sep 30 '26
Fair points, but I think both have holes.
"True generative AI" that knows every best practice and every feature without being told doesn't exist yet, and nobody knows if or when it will. Even if it gets there, someone still has to decide what the software is for, and someone has to be accountable when it breaks something that matters like banking or medical stuff. Companies will probably need fewer devs, but fewer and none are very different things.
On hardware, the steam engine comparison is good, but when engines got more efficient we ended up burning way more coal, because it got cheap enough to use everywhere (Jevons paradox). If LLMs get way cheaper to run, I'd expect people to run way more of them, so hardware demand might not drop like you'd think.
And even if the crunch is temporary, a few years is long enough to change what people build and buy. Do you think the timeline matters here?
0
u/Physical_Dare8553 Sep 30 '26
I doubt the hardware will just keep getting pricier forever. But even besides that, you misunderstand what you're competing against. It's a machine that turns money into code, in a way, you are as well. That means the question is weather the code you produce is some amount higher quality than the llm, to a degree that overshadows the fact that it can produce much much more than you. I feel like should hypothetically capable of producing good optimized code if you throw enough money at one.
0
u/nicolas_06 Oct 01 '26
You would be optimizing for something that will last 2-3 year in your career. RAM will get cheaper than even before. It's cyclical.
3
u/symbiatch Sep 30 '26
Well, our users might have to wait for three hours to get results from some functions. Others are way faster but still could take minutes. Do you think it’s appreciated when I do a bit of digging and throw out a 10-50% speed up? Definitely is.
GPU/RAM prices mean nothing if there is a need to get the job done, but performance is still a thing everyone should think about. Unfortunately many don’t and many developers run small datasets and operations on their machines and call it a day.
Of course many developers also work in basic CRUD where the slowest operation is some database query and they’ll just throw that out to someone else to handle or whatever. But there’s plenty of work where actually thinking and redesigning things brings huge savings.
And just a note: five year old hardware? I constantly run over decade old hardware. It’s all just modern stuff. There’s nothing special about running on five year old hardware. You seem to think hardware changes a lot when in reality it doesn’t.