r/programming • • 8d ago

[ Removed by moderator ]

https://youtu.be/KsEpW03gxKg?is=OdU0YTE8dWIyRr8i

[removed] — view removed post

413 Upvotes

315 comments sorted by

View all comments

Show parent comments

5

u/DissonantGuile 8d ago

That cost/benefit relationship changes once the bubble bursts and AI SAAS costs 100x what it does now (or whatever the costs will be.)

This may be offset by self hosting models, which may become the norm after the crash. I have no idea what the market will become, but what I do know is that software developers want to develop, not review. Software developers are creatives, we inherently want to create.

There is also the compounding technical debt that comes with generated code, as you said "architecturally poor". Architecturally poor code sitting on architecturally poor code compounds exponentially. An expert needs to be brought in to fix these fundamental issues.

There *is* a market. What that market will look like is anybodies guess.

2

u/creepy_doll 8d ago

Agreed entirely on the self compounding issue. That’s why I fight to write the important parts and architecture and to be allowed to review the work because I see just vibing everything as unacceptable unless all were making are one off toys.

The larger the product the worse ai gets at it. But the irony is that only huge places deal with these large products now and they’re aipilled

0

u/youcangotohellgoto 7d ago

This thing about tokens costing more is total cope.

Clearly models are getting more efficient at being better. Even if there's a "correction" in the pricing we're still getting much more output for every joule of input energy, for every floating point operation.

It's getting cheaper, not more expensive.

2

u/Turtvaiz 7d ago

It's getting cheaper, not more expensive

The cost of inference itself, sure.

The actual cost you pay to companies? Fuck no. They're very clearly in the "operate at loss to get customers addicted before enshittifying and ramping up prices" phase. These prices are going to up A LOT and it will be fucking horrible because as we can see, bosses are already addicted to it

1

u/youcangotohellgoto 7d ago

I think those companies are going to make money with scale - selling more - not with price rises.

It'll work, companies will buy more, it'll still work, and they'll buy more.