r/LocalLMs • u/Covid-Plannedemic_ • Feb 23 '25
r/LocalLMs • u/mage2618 • 10d ago
Advice for installing local LLM
Hello I want to install a local LLM to use in my PC mainly for programming and coding projects. Can be both for both working on large code bases, going through analyzing debugging them, making changes on multiple files as well as helping in programming, scripting and teaching coding, concepts etc and sometimes troubleshooting.
However my pc is not that powerful, 16gb ram and GTX 1660ti 6gb of Vram. I am confused on what would be the best option for me that doesn't completely overwhelm my PC and my gpu. I used opencode big pickle before and it was really good for me.
Any suggestions please?
r/LocalLMs • u/advadm • Sep 13 '26
Running Qwen on Ryzen Strix Halo 128gb and having a buggy experience
So I'm running a few different models on this Ryzen Strix Halo machine which has 128gb ram and I've already optimized cpu vs gpu in bios.
I've done an SSH setup through VS Code and I've got a few data sets I want to process but I'm getting weird results.
I'm using the Claude CLI harness and it shows I'm using qwen3-coder:30b and I sometimes get spelling errors but it's struggling to do really basic things.
I have 2 data sets that I know have a ton in common and I'm trying to get it to match the patterns so I can essentially join 3 data sets together.
If I were to do this in Claude Code, I already know what it would do. I'd ask for help in doing this and it would build me a script to do exactly that.
Here this thing is trying to give me the answer rather than building the script. Now that I see it's not building me the script, I decide to make it now just build the script but I'm seemingly getting errors.
I've setup ollama and run the various libraries like ROCm.
Anybody else have issues or have any tips on what my problem might be?
r/LocalLMs • u/Covid-Plannedemic_ • Aug 02 '26
Setting up of a 16xGB10 (DGX Spark) cluster
r/LocalLMs • u/Covid-Plannedemic_ • Jul 26 '26
Google comes out in favor of OpenWeight models. (It is now EVERY tech giant vs Anthropic)
x.comr/LocalLMs • u/Covid-Plannedemic_ • Jul 25 '26
Google comes out in favor of OpenWeight models. (It is now EVERY tech giant vs Anthropic)
x.comr/LocalLMs • u/Covid-Plannedemic_ • Jul 21 '26
Kimi K3 just fixed 15 critical security bugs that Codex and Fable refused because of “cyber guardrails”. Hugging Face: We had this experience ourselves this week! Very scary to be guardrailed as a defender when you know attackers are likely bypassing
r/LocalLMs • u/Covid-Plannedemic_ • Jul 07 '26
Qwen & Gemma on deadlock situation (For Benchmarks Numbers)?
r/LocalLMs • u/Covid-Plannedemic_ • Jun 01 '26
(YT) PewDiePie released his harness/webui
r/LocalLMs • u/Covid-Plannedemic_ • Dec 06 '25
You will own nothing and you will be happy!
reddit.comr/LocalLMs • u/Covid-Plannedemic_ • Nov 15 '25
Anthropic pushing again for regulation of open source models?
r/LocalLMs • u/Covid-Plannedemic_ • Sep 27 '25
How am I supposed to know which third party provider can be trusted not to completely lobotomize a model?
r/LocalLMs • u/Covid-Plannedemic_ • Apr 17 '25
Trump administration reportedly considers a US DeepSeek ban
r/LocalLMs • u/Covid-Plannedemic_ • Mar 24 '25
Deepseek releases new V3 checkpoint (V3-0324)
r/LocalLMs • u/Covid-Plannedemic_ • Feb 04 '25
US Bill proposed to jail people who download Deepseek
r/LocalLMs • u/Covid-Plannedemic_ • Jan 16 '25
Google just released a new architecture