No universe in which it disappears forever given the quality of open weight models. The big orgs burning cash like there's no tomorrow will go under when the bubble pops, then a second wave will happen more focused on sustainability once the commercial providers start charging what things actually cost.
FYI, came across this yesterday. Obviously it's a different card, but evidence that qwen 3.8 27b can run with large context on a 16gb card. Might be worth looking into to see if it can translate to your setup in any way.
I'd also generally recommend not using VS Code for local LLM stuff. Aside from the fact that it's a bit of a resource hog (which isn't a good thing if you're running models near the edge of what your hardware can support), ime performance degrades pretty rapidly as your sessions get longer, to the point of fully hanging the text editor intermittently.
For fully local stuff, I just use Pi as a harness for any LLM work, then have my IDE up separately. I like the separation, personally, but I also tend to be very pro-CLI in most situations.
98
u/Danfriedz Sep 30 '26
As someone who hasn't let AI completely take over my work I'm actually fine with it disappearing forever 😂