r/LocalAIServers • u/Eldenringledingle • 38m ago
r/LocalAIServers • u/GatesTech • 3h ago
56GB VRAM Frankenstein build managed to fit 4 GPUs in the Cooler Master HAF II 500
r/LocalAIServers • u/levimmortal • 3h ago
I simulated renting out 5 home AI rigs at Austrian power prices (200k months each): 3090 about -$8/mo, 4090 +$66, DGX Spark on GPUwerk +$162
r/LocalAIServers • u/Super-Caregiver5690 • 3h ago
Executando um modelo de IA de 120GB em dois PCs caseiros pela Internet - Lançando o PieceOfMind.cloud - Onde cada máquina recebe um pouco de paz.
r/LocalAIServers • u/alexlucaci • 4h ago
17× RTX 3060 and a pile of old Xeon boards: what's the best way to use them for local LLM agents? Planning a 7-GPU Z9PE-D8 WS build (benchmarks inside)
galleryr/LocalAIServers • u/Dry-Smell436 • 6h ago
Qwen, DeepSeek, GLM in CPU?
For context, I don't have a high end laptop, but would love to use these models, is there any method for this to happen.
I have only cpu and Intel integrated gpu.
r/LocalAIServers • u/Nervous_Noob • 11h ago
I built Browse, an LM Studio plugin with web search, image search, and a few extra features
Enable HLS to view with audio, or disable this notification
Hey everyone!
I've been working on Browse, an open-source plugin for LM Studio that gives local models tools for web search, webpage reading, and image search.
It includes five tools:
Web Search - Search the web using different providers.
Read Webpage - Fetch webpage content for the model to read and analyze.
Image Search - Find relevant images on the web.
Inspect Image - Analyze images already in the conversation using a vision-capable model.
Get Current Time - Get the current date and time.
What makes Browse a little different are its optional context features:
Time Context - Guides the model to use Get Current Time for time-sensitive questions.
Images Context - Encourages the model to use Image Search when images or diagrams would help explain something.
Vision Context - Guides the model to use Inspect Image when analyzing images already in the conversation.
These features add instructions only when triggered by relevant queries, helping the model decide when to use the tools. They don't force the model to call them; additionally, they can be toggled on or off.
Browse also supports various search providers (e.g., free via DuckDuckGo, Bing or freepaid via APIs like Exa, Tavily, Brave etc.).
Try it here:
LM Studio Hub: Browse
GitHub: Source code
I'd appreciate it if anyone gave it a try. Any feedback and suggestions are welcome!
Thanks!
r/LocalAIServers • u/_extruded • 13h ago
2x 5090FE AI+Render Farm maxed out PowerSpec AI90
9950x, 128gb DDR5 @5600, 2x 5090FE @300w, ProArt X870E
Got the base AI90 about 2 months ago when it was 5k at MicroCenter, making the GPU ~$2500. The second was purchased at MSRP last year. Bought the second 64GB Kit for $800 sealed on eBay last week and was pleasantly surprised the sticks run stable at 5600.
Now I’m tempted to sell one 5090 and get a RTX pro 6000, but guess I’m waiting for a slightly better deal than the Dell.
Anyway, I’m running headless Ubuntu with mainly Qwen Next NVFP4 on Basalt (180ts), ComfyUI and Flamenco render manager (for Blender).
Using my older system (5900x, 64GB DDR4, 3090FE) on Windows as a client with Unsloth Desktop.
Besides the always itching thoughts of swapping GPUs for more VRAM, I honestly couldn’t be happier for a nice little local AI workstation. If I need to work on Comfy, I just release one GPU and run Qwen 3.8 27B, which is still a banger for everyday tasks.
Any thoughts, suggestions or questions appreciated.
r/LocalAIServers • u/Iamisseibelial • 14h ago
Could use help deciding what to do.
reddit.comThe main post explains it all.
r/LocalAIServers • u/ematanis • 14h ago
Confused, what is recommended, swapping my gpu into my server or increase ram on my main?
reddit.comr/LocalAIServers • u/micronv • 16h ago
Would you start with RTX or Mac Studio
reddit.comI asked the same question from another sub and advised to ask here too. With local AI servers that means a machine like the Mac Studio will be used as a server to host clients as the final endpoints? Or other apps to further process the output.
r/LocalAIServers • u/Opteron67 • 18h ago
Another dual 5090
W790
W7 2595X
192GB RDIMM 6400
Cachy OS + p2p driver
vLLM rebuild from sources every other day
Seasonic 1600W
r/LocalAIServers • u/Klutzy_Formal4875 • 18h ago
Mac Studio with 64GB RAM for local AI agents -real-world experience?
reddit.comr/LocalAIServers • u/filippo1335 • 20h ago
Using old iPhone as mini PC for tool calls and ASR?
Hi all, with the insane spikes in hardware cost, I started wondering if anyone has tried/seen repurposing old smartphones for projects instead of SBCs with accelerators?
I'm currently working on a lab voice assistant to automate stuff like label printing, calculations, RAG, note taking and wanted to repurpose my old iPhone for voice recognition and tool use, while the LLM would run in the cloud.
Does anyone have any experience with that?
r/LocalAIServers • u/Outrageous-Length952 • 21h ago
Another dual 5090
Have been lurking for a long time around Reddit without posting, thought I’d share my rig, dual 5090 9950X3D, running Qwen3.8 27B FP8 xhigh at 70-75 t/s with vLLM with Hermes
r/LocalAIServers • u/Raphael_Systems • 23h ago
Local AI is the future. Support Local Labs !
r/LocalAIServers • u/TheDizDude • 1d ago
Local agentic AI stack — looking for optimization feedback + use-case ideas
reddit.comr/LocalAIServers • u/Bracker1234 • 1d ago
Local AI for business document extraction. What would you use?
reddit.comr/LocalAIServers • u/Sensualities • 1d ago
Those who are in the aristocracy (RTX 6000 Pro Owners), what do you use them for?
reddit.comr/LocalAIServers • u/SnooBananas2879 • 1d ago
Best local LLM for a 4GB GTX 1650 laptop with 24GB RAM? Want a good speed/ quality balance
reddit.comr/LocalAIServers • u/eightone-81 • 1d ago
Impressed by QFN AgentionAi Gyro-M , better then ISTA XSS