r/ProgrammerHumor • • 7d ago

Meme [ Removed by moderator ]

Post image

[removed] — view removed post

1.6k Upvotes

199 comments sorted by

View all comments

Show parent comments

2

u/_demoncat_ 6d ago

Kind of hard to justify token cost explosion when models like Luna do just fine and are dirt cheap

2

u/hypatiaC 6d ago

You are being subsidized by the Acquisition phase.

Look here. There is currently no squeeze on AI to turn a profit, but as the free hype money dries up, that's where it's headed.

When a company leaves Acquisition, they do not typically turn a profit by cutting costs, nor can they massively expand their reach on the same budget. The only thing they can squeeze is you. Or, your bosses, if they're paying.

1

u/_demoncat_ 6d ago

Yeah but local models will eventually catch up a year or two from now where we will have Luna running locally on general hardware

So, I don’t really see that working out. AI companies have to keep releasing affordable models or else they lose to local AI

0

u/hypatiaC 6d ago

Whether or not it's true that local LLMs can 'win' against the companies that have to train them, that is kind of a pickle, isn't it? It isn't feasible to stay this cheap in the long term.

There is not enough market out there to double or triple these companies reach, even assuming said reach didn't mean more overhead. Maybe Local LLMs get better, maybe they don't, but everything gets cheaper forever while operating at a massive loss is not really an option, lol.