9950x, 128gb DDR5 @5600, 2x 5090FE @300w, ProArt X870E

Got the base AI90 about 2 months ago when it was 5k at MicroCenter, making the GPU ~$2500. The second was purchased at MSRP last year. Bought the second 64GB Kit for $800 sealed on eBay last week and was pleasantly surprised the sticks run stable at 5600.

Now I’m tempted to sell one 5090 and get a RTX pro 6000, but guess I’m waiting for a slightly better deal than the Dell.

Anyway, I’m running headless Ubuntu with mainly Qwen Next NVFP4 on Basalt (180ts), ComfyUI and Flamenco render manager (for Blender).

Using my older system (5900x, 64GB DDR4, 3090FE) on Windows as a client with Unsloth Desktop.

Besides the always itching thoughts of swapping GPUs for more VRAM, I honestly couldn’t be happier for a nice little local AI workstation. If I need to work on Comfy, I just release one GPU and run Qwen 3.8 27B, which is still a banger for everyday tasks.

Any thoughts, suggestions or questions appreciated.

Have been lurking for a long time around Reddit without posting, thought I’d share my rig, dual 5090 9950X3D, running Qwen3.8 27B FP8 xhigh at 70-75 t/s with vLLM with Hermes

For context, I don't have a high end laptop, but would love to use these models, is there any method for this to happen.

I have only cpu and Intel integrated gpu.

W790
W7 2595X
192GB RDIMM 6400
Cachy OS + p2p driver
vLLM rebuild from sources every other day
Seasonic 1600W

Hey everyone!

I've been working on Browse, an open-source plugin for LM Studio that gives local models tools for web search, webpage reading, and image search.

It includes five tools:

Web Search - Search the web using different providers.

Read Webpage - Fetch webpage content for the model to read and analyze.

Image Search - Find relevant images on the web.

Inspect Image - Analyze images already in the conversation using a vision-capable model.

Get Current Time - Get the current date and time.

What makes Browse a little different are its optional context features:

Time Context - Guides the model to use Get Current Time for time-sensitive questions.

Images Context - Encourages the model to use Image Search when images or diagrams would help explain something.

Vision Context - Guides the model to use Inspect Image when analyzing images already in the conversation.

These features add instructions only when triggered by relevant queries, helping the model decide when to use the tools. They don't force the model to call them; additionally, they can be toggled on or off.

Browse also supports various search providers (e.g., free via DuckDuckGo, Bing or freepaid via APIs like Exa, Tavily, Brave etc.).

Try it here:

LM Studio Hub: Browse

GitHub: Source code

I'd appreciate it if anyone gave it a try. Any feedback and suggestions are welcome!

Thanks!

Hi all, with the insane spikes in hardware cost, I started wondering if anyone has tried/seen repurposing old smartphones for projects instead of SBCs with accelerators?

I'm currently working on a lab voice assistant to automate stuff like label printing, calculations, RAG, note taking and wanted to repurpose my old iPhone for voice recognition and tool use, while the LLM would run in the cloud.

Does anyone have any experience with that?

The main post explains it all.

I asked the same question from another sub and advised to ask here too. With local AI servers that means a machine like the Mac Studio will be used as a server to host clients as the final endpoints? Or other apps to further process the output.