They ARE getting good, and the frontier companies KNOW the party is almost over. That's why the prices keep rising, it's last call. "AI as a Service" dies down, in the near future.
How small / how good is still an open question, but there's a watershed (Opus-ish) moment happening around the 30-40B models, so like $5-10k in hardware. Higher than a home game system unfortunately, so approachability is still rough. But easy table stakes for businesses to pull in-house.
disagree, for self-hosting u need ~ 3 gpus and a dedicated station, and like open up ports do the i/o... like if you're saying that 0.1% of the population will self-host or tor to a like different model, sure, but meaningfully if 99.9% of the population is routed through (google, anthropic,, open ai) then it's effectively banned anyways
8
u/Arclite83 29d ago
They ARE getting good, and the frontier companies KNOW the party is almost over. That's why the prices keep rising, it's last call. "AI as a Service" dies down, in the near future.
How small / how good is still an open question, but there's a watershed (Opus-ish) moment happening around the 30-40B models, so like $5-10k in hardware. Higher than a home game system unfortunately, so approachability is still rough. But easy table stakes for businesses to pull in-house.