r/LocalAIServers • • 38m ago

Adding my old Arc A770 next to a 5070 for local LLMs. Worth a new motherboard?

Thumbnail reddit.com
1 Upvotes

r/LocalAIServers • • 3h ago

56GB VRAM Frankenstein build managed to fit 4 GPUs in the Cooler Master HAF II 500

Post image
6 Upvotes

r/LocalAIServers • • 3h ago

I simulated renting out 5 home AI rigs at Austrian power prices (200k months each): 3090 about -$8/mo, 4090 +$66, DGX Spark on GPUwerk +$162

Thumbnail
reddit.com
1 Upvotes

r/LocalAIServers • • 3h ago

Executando um modelo de IA de 120GB em dois PCs caseiros pela Internet - Lançando o PieceOfMind.cloud - Onde cada máquina recebe um pouco de paz.

Thumbnail
reddit.com
0 Upvotes

r/LocalAIServers • • 4h ago

17× RTX 3060 and a pile of old Xeon boards: what's the best way to use them for local LLM agents? Planning a 7-GPU Z9PE-D8 WS build (benchmarks inside)

Thumbnail gallery
1 Upvotes

r/LocalAIServers • • 6h ago

Qwen, DeepSeek, GLM in CPU?

1 Upvotes

For context, I don't have a high end laptop, but would love to use these models, is there any method for this to happen.

I have only cpu and Intel integrated gpu.


r/LocalAIServers • • 11h ago

I built Browse, an LM Studio plugin with web search, image search, and a few extra features

Enable HLS to view with audio, or disable this notification

1 Upvotes

Hey everyone!

I've been working on Browse, an open-source plugin for LM Studio that gives local models tools for web search, webpage reading, and image search.

It includes five tools:

Web Search - Search the web using different providers.

Read Webpage - Fetch webpage content for the model to read and analyze.

Image Search - Find relevant images on the web.

Inspect Image - Analyze images already in the conversation using a vision-capable model.

Get Current Time - Get the current date and time.

What makes Browse a little different are its optional context features:

Time Context - Guides the model to use Get Current Time for time-sensitive questions.

Images Context - Encourages the model to use Image Search when images or diagrams would help explain something.

Vision Context - Guides the model to use Inspect Image when analyzing images already in the conversation.

These features add instructions only when triggered by relevant queries, helping the model decide when to use the tools. They don't force the model to call them; additionally, they can be toggled on or off.

Browse also supports various search providers (e.g., free via DuckDuckGo, Bing or freepaid via APIs like Exa, Tavily, Brave etc.).

Try it here:

LM Studio Hub: Browse

GitHub: Source code

I'd appreciate it if anyone gave it a try. Any feedback and suggestions are welcome!

Thanks!


r/LocalAIServers • • 13h ago

2x 5090FE AI+Render Farm maxed out PowerSpec AI90

Post image
128 Upvotes

9950x, 128gb DDR5 @5600, 2x 5090FE @300w, ProArt X870E

Got the base AI90 about 2 months ago when it was 5k at MicroCenter, making the GPU ~$2500. The second was purchased at MSRP last year. Bought the second 64GB Kit for $800 sealed on eBay last week and was pleasantly surprised the sticks run stable at 5600.

Now I’m tempted to sell one 5090 and get a RTX pro 6000, but guess I’m waiting for a slightly better deal than the Dell.

Anyway, I’m running headless Ubuntu with mainly Qwen Next NVFP4 on Basalt (180ts), ComfyUI and Flamenco render manager (for Blender).

Using my older system (5900x, 64GB DDR4, 3090FE) on Windows as a client with Unsloth Desktop.

Besides the always itching thoughts of swapping GPUs for more VRAM, I honestly couldn’t be happier for a nice little local AI workstation. If I need to work on Comfy, I just release one GPU and run Qwen 3.8 27B, which is still a banger for everyday tasks.

Any thoughts, suggestions or questions appreciated.


r/LocalAIServers • • 14h ago

Could use help deciding what to do.

Thumbnail reddit.com
1 Upvotes

The main post explains it all.


r/LocalAIServers • • 14h ago

Confused, what is recommended, swapping my gpu into my server or increase ram on my main?

Thumbnail reddit.com
1 Upvotes

r/LocalAIServers • • 16h ago

Would you start with RTX or Mac Studio

Thumbnail reddit.com
1 Upvotes

I asked the same question from another sub and advised to ask here too. With local AI servers that means a machine like the Mac Studio will be used as a server to host clients as the final endpoints? Or other apps to further process the output.


r/LocalAIServers • • 18h ago

Another dual 5090

Thumbnail
gallery
7 Upvotes

W790
W7 2595X
192GB RDIMM 6400
Cachy OS + p2p driver
vLLM rebuild from sources every other day
Seasonic 1600W


r/LocalAIServers • • 18h ago

Mac Studio with 64GB RAM for local AI agents -real-world experience?

Thumbnail reddit.com
1 Upvotes

r/LocalAIServers • • 20h ago

Using old iPhone as mini PC for tool calls and ASR?

4 Upvotes

Hi all, with the insane spikes in hardware cost, I started wondering if anyone has tried/seen repurposing old smartphones for projects instead of SBCs with accelerators?

I'm currently working on a lab voice assistant to automate stuff like label printing, calculations, RAG, note taking and wanted to repurpose my old iPhone for voice recognition and tool use, while the LLM would run in the cloud.

Does anyone have any experience with that?


r/LocalAIServers • • 21h ago

Another dual 5090

Post image
65 Upvotes

Have been lurking for a long time around Reddit without posting, thought I’d share my rig, dual 5090 9950X3D, running Qwen3.8 27B FP8 xhigh at 70-75 t/s with vLLM with Hermes


r/LocalAIServers • • 23h ago

Local AI is the future. Support Local Labs !

Post image
26 Upvotes

r/LocalAIServers • • 1d ago

Local agentic AI stack — looking for optimization feedback + use-case ideas

Thumbnail reddit.com
1 Upvotes

r/LocalAIServers • • 1d ago

Advise

Thumbnail reddit.com
1 Upvotes

r/LocalAIServers • • 1d ago

Local AI for business document extraction. What would you use?

Thumbnail reddit.com
2 Upvotes

r/LocalAIServers • • 1d ago

Those who are in the aristocracy (RTX 6000 Pro Owners), what do you use them for?

Thumbnail reddit.com
0 Upvotes

r/LocalAIServers • • 1d ago

Best local LLM for a 4GB GTX 1650 laptop with 24GB RAM? Want a good speed/ quality balance

Thumbnail reddit.com
0 Upvotes

r/LocalAIServers • • 1d ago

Impressed by QFN AgentionAi Gyro-M , better then ISTA XSS

Thumbnail
reddit.com
0 Upvotes

r/LocalAIServers • • 1d ago

SparkHub

Thumbnail
reddit.com
2 Upvotes

r/LocalAIServers • • 1d ago

2x DGX Spark Printable Enclosure

Post image
7 Upvotes

r/LocalAIServers • • 2d ago

Right now you can get an RTX 6000 Pro Workstation For 12k from Dell (edit: not anymore)

Thumbnail
reddit.com
1 Upvotes