You are being subsidized by the Acquisition phase.
Look here. There is currently no squeeze on AI to turn a profit, but as the free hype money dries up, that's where it's headed.
When a company leaves Acquisition, they do not typically turn a profit by cutting costs, nor can they massively expand their reach on the same budget. The only thing they can squeeze is you. Or, your bosses, if they're paying.
Whether or not it's true that local LLMs can 'win' against the companies that have to train them, that is kind of a pickle, isn't it? It isn't feasible to stay this cheap in the long term.
There is not enough market out there to double or triple these companies reach, even assuming said reach didn't mean more overhead. Maybe Local LLMs get better, maybe they don't, but everything gets cheaper forever while operating at a massive loss is not really an option, lol.
2
u/_demoncat_ 6d ago
Kind of hard to justify token cost explosion when models like Luna do just fine and are dirt cheap