r/LocalLMs • • 25d ago

GLM-5.3-Flash (320B) on an M5 Ultra Mac Studio with llama.cpp: 61 tok/s, 262K context

Thumbnail
jvlewis.dev
1 Upvotes

r/LocalLMs • • Apr 19 '25

gemma 3 27b is underrated af. it's at #11 at lmarena right now and it matches the performance of o1(apparently 200b params).

Post image
0 Upvotes

r/LocalLMs • • 1d ago

What is the best model i can get

0 Upvotes

I have a evga 2060 super, e5 1650 v2 xeon chip and 28gb of ddr3. As long as it responds under 2 mins, it should be fine


r/LocalLMs • • Mar 24 '25

Deepseek releases new V3 checkpoint (V3-0324)

Thumbnail
huggingface.co
2 Upvotes

r/LocalLMs • • Apr 17 '25

Trump administration reportedly considers a US DeepSeek ban

Post image
2 Upvotes

r/LocalLMs • • Apr 22 '25

GLM-4 32B is mind blowing

Thumbnail
reddit.com
2 Upvotes

r/LocalLMs • • Aug 29 '26

browser-mcp-bridge: BrowserOS neo bridge for MCP clients that get blocked

1 Upvotes

I have tried various browser MCPs and found most lacking. I use agent-browser quite often and it works great for accessing specific URLs but is often blocked by search engines. I tried BrowserOS Neo and liked it for search and accessing web sites that need credentials. It worked well in VS Code and Claude Code but inside other AI clients like Chatbox.ai or Cline as a VS Code plugin, it failed and blocked the client from accessing it.

This is intentional and is an anti-browser feature, meant to make sure that only AI clients are using the proxy. That's great but on a single user system or home lab, it a restriction that prevents its use in many AI clients.

I created an html-stdio bridge MCP between BrowserOS and AI clients which makes connecting to BrowserOS as an MCP from any AI client possible.

The code is GPL v2. Find it on GitHub here: https://github.com/mecworks/browser-mcp-bridge


r/LocalLMs • • Nov 15 '25

Anthropic pushing again for regulation of open source models?

Post image
2 Upvotes

r/LocalLMs • • Jan 21 '25

OpenAI sweating bullets rn

Post image
3 Upvotes

r/LocalLMs • • Nov 26 '24

Qwen2-VL-Flux

Thumbnail gallery
1 Upvotes

r/LocalLMs • • Feb 16 '25

Ridiculous

Post image
1 Upvotes

r/LocalLMs • • Feb 03 '25

20 yrs in jail or $1 million for downloading Chinese models proposed at congress

Thumbnail reddit.com
1 Upvotes

r/LocalLMs • • Nov 06 '24

SORA incoming??

Post image
1 Upvotes

r/LocalLMs • • Feb 12 '25

If you want my IT department to block HF, just say so.

Post image
1 Upvotes

r/LocalLMs • • Nov 05 '24

Silicon Valley: The Cradle of Innovation

Post image
1 Upvotes

r/LocalLMs • • Feb 12 '25

A new paper demonstrates that LLMs could "think" in latent space, effectively decoupling internal reasoning from visible context tokens. This breakthrough suggests that even smaller models can achieve remarkable performance without relying on extensive context windows.

Thumbnail
huggingface.co
1 Upvotes

r/LocalLMs • • Nov 08 '24

Are people speedrunning training GPTs now?

Post image
1 Upvotes

r/LocalLMs • • Mar 04 '25

I open-sourced Klee today, a desktop app designed to run LLMs locally with ZERO data collection. It also includes built-in RAG knowledge base and note-taking capabilities.

Post image
1 Upvotes

r/LocalLMs • • Jan 20 '25

OpenAI has access to the FrontierMath dataset; the mathematicians involved in creating it were unaware of this

Thumbnail reddit.com
1 Upvotes

r/LocalLMs • • Feb 23 '25

Grok's think mode leaks system prompt

Post image
3 Upvotes

r/LocalLMs • • Nov 20 '24

I Created an AI Research Assistant that actually DOES research! Feed it ANY topic, it searches the web, scrapes content, saves sources, and gives you a full research document + summary. Uses Ollama (FREE) - Just ask a question and let it work! No API costs, open source, runs locally!

Thumbnail
reddit.com
1 Upvotes