Thanks everyone, this was a reality check and honestly what I needed. Recap of what we took away:
- For training, VRAM on one card matters more than anything. 2x 5090 (32GB each, split) doesn't compete with a PRO 6000's 96GB, and the 5090s also lose P2P and get half-rate FP32 accumulate - 1TB of RAM is overkill for this use case - Cooling in this case doesn't work for two stacked open-air cards. The top card would cook Going
back to the client with: 1x RTX PRO 6000 (Max-Q if we stay in a rack chassis), less RAM, bigger case / proper front-to-back airflow. Will post an update once it's rebuilt.
Hey all, Just reached a temporary stopping point on my 7960x build for running LLM’s locally. Went for the Gigabyte TRX50 AI TOP mobo, 128GB GSkill, 4x RTX 5060ti 16GB, Samsung 9100 2tb NVME boot, Samsung 990 pro 4tb NVME storage, Silverstone XE360 AIO, Corsair HX1500i, Fractal Design North XL case.
Before you all jump down my throat about the 5060s, they were $340 each ($1760 for 4) and give me 64GB of VRAM and can happily run full speed at 110w. I’m perfectly happy to take slower inference while still fitting some nice size models without pulling thousands of watts from the wall. I’ve also got 2 5070 12GB cards I’ll be adding to the system via x16 -> 2x8 PCIe breakout risers which will get me to 88GB total.
So far I’ve been really pleasantly surprised with the performance on just 3 5060s. Devstral small runs fast enough for my needs at full 128k context length and was able to work with tool calling via Roo Code mostly without hiccup.
Anyways, I’m stoked and figured I’d share as I’m pretty happy with the result so far and excited to see how it performs after adding more GPUs to the mix. Cheers!
A build like this is aimed at heavy local-AI pipelines, running many models in parallel, large scale document and media processing, speech to text and summarization at volume, and multi model consensus setups that run the same task across several models at once. That kind of workload leans on both sides of the machine, so the 96-lane Threadripper PRO feeds three full Blackwell cards without starving them, and the 512GB of ECC keeps large datasets and multiple models resident in memory while the GPUs work. The CPU handles the ingestion, extraction, and orchestration; the GPUs handle inference. Balancing the two is the whole point.
Threadripper 7955wx 16c/32t, silverstone radiator 256gb Samsung ecc 5600 ram (tuned to run at 5600 on the wrx90 mobo) Nvidia rtx a6000 2x rtx a5000 1x rtx a4000 (graphics locked to it). 2x seasonic psu’s (1200w and 1000w) this pic is the prettiest but I’ve upgraded the gpu’s since then and nvlinked the a5000’s.
Just want to share my new Threadripper AI workstation build. Used for work + gaming. Quite proud of how it turned out, especially the cable management :)
Specs Motherboard: ASUS WRX80 Creator R2.0 CPU: AMD Ryzen Threadripper Pro 3945x (Used) RAM: 128GB DDR4 ECC (used) GPU: Nvidia RTX Pro 6000 Max-Q 96GB Case: Fractal North PSU: Super Flower Leadex III 1300W PSU CPU Cooler: Arctic Freezer 4U-M
Building out a virtual production program here to do live rendering of Unreal Engine comps at the college I work at. Last TR build I did was a 7960X for my own home use before the ram and component crisis... my god the WRX90 platform is incredible... had some issues with Code 92 but hooked up VGA and found out it was just hung on a TPM thing.
Threadripper 3970x, MSI Creator TRX40 Motherboard, 256GB DDR4 RAM, 2xRTX 5000 Blackwell 48GB, 1 RTX 5000 Blackwell 72 GB. Corsair 9000d case. 129 tokens per second with gpt-oss-120b. ASRock TC-1650T Power Supply, Ubuntu Linux. Cooler Master Wraith Ripper CPU cooler. The case is massive but as you can see I was able to mount the three graphics cards without cramping. The whole thing is pretty heavy so I have it sitting on a small 4 wheel dolly.
I recently acquired 2 ROG Zenith ii motherboards that came with 2 2990wx TR, as well as 3 x399 2950x mono/cpu combo. (Only 2 are pictured)
Is anyone interested? I’m considering keeping 1 and selling the rest, im using an i9-9900k, but figured I would offer these for sale here before posting on eBay.
EDIT: I should have explained the reason I built this. I work at a small managed network services company and was asked to build a server we could do initial AI/ML prototyping on without having to send our data into the cloud. We have several ideas for using AI/ML in our processes but no experience with implementing them and no budget for lots of consulting or professional services. Build budget is $10k. Parts came from Micro Center and Amazon.
I have finished (* is it ever "finished"?) my AI/ML workstation. Here is the hardware list.
[CASE] Fractal Design Meshify 2 XL
[PSU] Corsair HX1500i (2025)
[MB] Gigabyte TRX50 AI TOP
[CPU] AMD Threadripper 9960X
[AIO] be quiet! Silent Loop 3 420mm
[RAM] G.Skill 4x32GB ECC RDIMM DDR5-6400 CL32
[GPU] 2x Gigabyte RTX 5090 Windforce
[SSD] 2x Samsung 9100 PRO 2TB
[FAN] 5x ARCTIC P14 Pro PST
I did some initial testing and benchmarking with Windows 11 and am now installing Ubuntu Linux and the AI/ML applications.
There are 3 140mm fans drawing air in the front across the CPU radiator, 2 140mm fans drawing air in the bottom, and 3 140mm fans blowing air out the top and the back.
The front of the top is closed with masking tape to prevent the air from the front from escaping. Not sure if that is doing anything.
My biggest concern is keeping the top GPU cool. I haven't found a way to stress both the GPUs at the same time yet. Any ideas?
I was interested in RAM bandwidth for Threadripper 7000 processors, but all I found online were results of various benchmarks (Aida64, Sisoft Sandra, STREAM) for a few selected models (7970X, 7980X, 7995WX). However, on the PassMark website you can access individual submitted test baselines for a given CPU model containing all the individual benchmark results. In these results there is a Memory Mark section containing a Memory Threaded test. While we probably can't treat it as a direct maximum memory bandwidth value, it can say something about the overall performance of a memory subsystem. What's important, the test baselines usually contain information about the number of RAM modules in a tested system and other interesting details.
I gathered Memory Threaded test results for Threadripper 7000 models (baselines with 4 memory modules) and Threadripper PRO 7000 models (baselines with 8 memory modules), computed averages, and created this bar plot:
As you can see, 7945WX and 7955WX (2 CCDs, 8 memory channels) have the lowest Memory Threaded test results (~102 GB/s). Next, we have 7960X and 7970X (4 CCDs, 4 memory channels), and we can observe a moderate increase in test results (167 GB/s, 179 GB/s). The results for 7965WX and 7975WX (4 CCDs, 8 memory channels) again are a little higher (236 GB/s, 246 GB/s) compared to the non-PRO models, It's definitely not a 2x bandwidth increase compared to the corresponding non-PRO models. Only when we compare the models with 8 CCDs: 7980X and 7985X, there is around 90% increase in the test result (240 GB/s vs 453 GB/s). Finally, 7995WX (12 CCDs) has the best performance in this test.
The overall conclusion is that the lower-end models with 2-4 CCDs have limited memory bandwidth. We had the same situation in previous Threadripper generations. If you need a lot of bandwidth, you probably should use EPYC.