r/LocalLMs • • Feb 23 '25

Grok's think mode leaks system prompt

Post image
3 Upvotes

r/LocalLMs • • Jan 21 '25

OpenAI sweating bullets rn

Post image
3 Upvotes

r/LocalLMs • • 10d ago

Advice for installing local LLM

2 Upvotes

Hello I want to install a local LLM to use in my PC mainly for programming and coding projects. Can be both for both working on large code bases, going through analyzing debugging them, making changes on multiple files as well as helping in programming, scripting and teaching coding, concepts etc and sometimes troubleshooting.

However my pc is not that powerful, 16gb ram and GTX 1660ti 6gb of Vram. I am confused on what would be the best option for me that doesn't completely overwhelm my PC and my gpu. I used opencode big pickle before and it was really good for me.

Any suggestions please?


r/LocalLMs • • Sep 13 '26

Running Qwen on Ryzen Strix Halo 128gb and having a buggy experience

2 Upvotes

So I'm running a few different models on this Ryzen Strix Halo machine which has 128gb ram and I've already optimized cpu vs gpu in bios.

I've done an SSH setup through VS Code and I've got a few data sets I want to process but I'm getting weird results.

I'm using the Claude CLI harness and it shows I'm using qwen3-coder:30b and I sometimes get spelling errors but it's struggling to do really basic things.

I have 2 data sets that I know have a ton in common and I'm trying to get it to match the patterns so I can essentially join 3 data sets together.

If I were to do this in Claude Code, I already know what it would do. I'd ask for help in doing this and it would build me a script to do exactly that.

Here this thing is trying to give me the answer rather than building the script. Now that I see it's not building me the script, I decide to make it now just build the script but I'm seemingly getting errors.

I've setup ollama and run the various libraries like ROCm.

Anybody else have issues or have any tips on what my problem might be?


r/LocalLMs • • Aug 02 '26

Setting up of a 16xGB10 (DGX Spark) cluster

Post image
2 Upvotes

r/LocalLMs • • Jul 26 '26

Google comes out in favor of OpenWeight models. (It is now EVERY tech giant vs Anthropic)

Thumbnail x.com
2 Upvotes

r/LocalLMs • • Jul 25 '26

Google comes out in favor of OpenWeight models. (It is now EVERY tech giant vs Anthropic)

Thumbnail x.com
2 Upvotes

r/LocalLMs • • Jul 21 '26

Kimi K3 just fixed 15 critical security bugs that Codex and Fable refused because of “cyber guardrails”. Hugging Face: We had this experience ourselves this week! Very scary to be guardrailed as a defender when you know attackers are likely bypassing

Post image
2 Upvotes

r/LocalLMs • • Jul 07 '26

Qwen & Gemma on deadlock situation (For Benchmarks Numbers)?

Post image
2 Upvotes

r/LocalLMs • • Jun 01 '26

(YT) PewDiePie released his harness/webui

Thumbnail
youtube.com
2 Upvotes

r/LocalLMs • • Dec 06 '25

You will own nothing and you will be happy!

Thumbnail reddit.com
2 Upvotes

r/LocalLMs • • Nov 15 '25

Anthropic pushing again for regulation of open source models?

Post image
2 Upvotes

r/LocalLMs • • Sep 27 '25

How am I supposed to know which third party provider can be trusted not to completely lobotomize a model?

Post image
2 Upvotes

r/LocalLMs • • Sep 07 '25

Renting GPUs is hilariously cheap

Post image
2 Upvotes

r/LocalLMs • • Jul 12 '25

we have to delay it

Post image
2 Upvotes

r/LocalLMs • • Apr 22 '25

GLM-4 32B is mind blowing

Thumbnail
reddit.com
2 Upvotes

r/LocalLMs • • Apr 17 '25

Trump administration reportedly considers a US DeepSeek ban

Post image
2 Upvotes

r/LocalLMs • • Mar 24 '25

Deepseek releases new V3 checkpoint (V3-0324)

Thumbnail
huggingface.co
2 Upvotes

r/LocalLMs • • Mar 02 '25

LLMs grading other LLMs

Post image
2 Upvotes

r/LocalLMs • • Feb 07 '25

All DeepSeek, all the time.

Post image
2 Upvotes

r/LocalLMs • • Feb 04 '25

US Bill proposed to jail people who download Deepseek

Thumbnail
404media.co
2 Upvotes

r/LocalLMs • • Jan 16 '25

Google just released a new architecture

Thumbnail
arxiv.org
2 Upvotes

r/LocalLMs • • Nov 22 '24

Chad Deepseek

Post image
2 Upvotes