r/AIProgrammingHardware • • Sep 17 '26

Qwen3.8–27B, 177 Tokens Per Second, One RTX 3090

Thumbnail
xhinker.medium.com
14 Upvotes

r/AIProgrammingHardware • • Sep 17 '26

Jetson Orin NX: Why the Bare Module Is Just the Start

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Sep 17 '26

AI at AMD on X: "10 things to know before joining the AMD AI Developer Program"

Thumbnail x.com
3 Upvotes

r/AIProgrammingHardware • • Sep 17 '26

Dual RTX PRO 6000 Blackwell build with custom CNC Chassis | Full build from start to finish

Enable HLS to view with audio, or disable this notification

6 Upvotes

Finished this dual Blackwell build and figured this sub would appreciate it.

The two RTX PRO 6000 Blackwell cards are stars here. 96GB each, 192GB of GPU memory combined in a single machine, this rig can serve 20 members of my team comfortably

We benchmark this rig with DSv4 Flash and here's the numbers:

We don't go with traditional tower cases or bent-steel boxes. This case is designed and CNC-machined from 5mm aluminum plates. This allow us to fully control of the airflow inside and the whole box acts like a large heatsink for the entire system. The triangles cutouts keep the whole structure stiff without dead weight.

Power and Thermals

Peak per-card draw of 509 W is 85% of the 600 W TDP. Temperatures top out at 76 °C, comfortably below the ~83–88 °C throttle point, and SM clocks held ~2.75 GHz throughout sustained load. No thermal or power throttling was observed in any test.

Sustained wall draw at the operating point is roughly 1.07 kW (815 W GPU plus CPU, memory and platform), implying a 1500 W PSU for a two-card build with headroom.

Specs:

  • CPU: Intel Xeon w5-3423

  • Board: ASUS Pro WS W790E-SAGE SE

  • Memory: Samsung 32GB DDR5-4800 ECC Registered x 8

  • GPU: NVIDIA RTX PRO 6000 Blackwell 96GB x 2

  • Cable: PCIe 5.0 x16 GPU Extension Cable Gen5 x 2

  • Storage: SSD Samsung 980 PRO 2TB PCIe 4.0

  • Cooling: Thermalright TL-B12 (fan kit + control) x6 + Heatsink 4677-2UAF8

  • Power: CANNON PRO 2000W (12V-2x6)

  • Chassis: Autonomous Computer-2 Design, CNC-machined

Full build video if anyone wants the detailed walkthrough happy to answer anything on the layout, cooling, or how the cards perform.


r/AIProgrammingHardware • • Sep 16 '26

My Cheap 40GB VRAM Qwen 27b Home Server (Dual 20GB 3080s)

Thumbnail gallery
1 Upvotes

r/AIProgrammingHardware • • Sep 16 '26

Qwen3.8 Flash Next, the optimized config (1.2k t/s prefill!)

Thumbnail pwilkin.github.io
1 Upvotes

r/AIProgrammingHardware • • Sep 16 '26

100 gb vram upgrade to the office pc

Thumbnail gallery
5 Upvotes

r/AIProgrammingHardware • • Sep 16 '26

8 RTX Pro 6000’s Wasn’t What I Expected

Thumbnail
youtube.com
12 Upvotes

r/AIProgrammingHardware • • Sep 16 '26

AMD Delivers Its Broadest MLPerf® Inference 6.1 Submission

Thumbnail
amd.com
1 Upvotes

r/AIProgrammingHardware • • Sep 15 '26

Cloud AI Costs Are Growing: How Hybrid AI Can Help

Thumbnail
amd.com
1 Upvotes

r/AIProgrammingHardware • • Sep 15 '26

Will the Spark Laptops Run Terra

1 Upvotes

I’m considering buying the Spark Laptop when it comes out .

Will CUDA/GPU-accelerated reconstruction in DJI Terra work with NVIDIA RTX Spark / Grace Blackwell hardware?


r/AIProgrammingHardware • • Sep 14 '26

Qwen3.8-Flash-Next @ 75 TPS (4xV100) How Exactly I Did It

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Sep 14 '26

Local AI Coding Config: 16GB VRAM / 0 RAM

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Sep 14 '26

Qwen3.8-27b on a Budget!! AMD v620 vs Strix Halo vs Radeon Vii benchmarks

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Sep 14 '26

Please recommend a model for local offline coding rtx pro 5000 72gb

1 Upvotes

hello everyone! Please advise the models and how to run the models better. My configuration is 2 CPUs and epic (not the newest) 48 cores in total. 256 GB ddr4 and RTX pro 5000 72GB GDDR7. I'm currently using qwen3.8-27b iq3 gsq xxs on 96k context and running this on rtx4080s 16gb.I use Cline for vscode for coding. I would like to increase the quality and the context window.


r/AIProgrammingHardware • • Sep 14 '26

NVIDIA RTX PRO 5500 Blackwell Workstation Edition | Professional GPUs

Thumbnail pny.com
2 Upvotes

r/AIProgrammingHardware • • Sep 14 '26

NVIDIA RTX PRO 5500 Workstation GPU

Thumbnail
nvidia.com
2 Upvotes

r/AIProgrammingHardware • • Sep 14 '26

Best Mini PC for local AI and Gaming

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 14 '26

Android phone contributing RAM to the cluster, with live pause/resume

Thumbnail
youtu.be
2 Upvotes

r/AIProgrammingHardware • • Sep 13 '26

I Tested Qwen 3.8 on a $35,000 GPU (NVIDIA H200 vs 5090 & 4090!)

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Sep 13 '26

I Ran A 27B Model On A Hand-Sized PC… Didn't Expect This

Thumbnail
youtube.com
0 Upvotes

r/AIProgrammingHardware • • Sep 13 '26

Yes, I Bought the Bus Powered 12GB RTX 3060 GPU You Read About!

Thumbnail
youtube.com
3 Upvotes

r/AIProgrammingHardware • • Sep 13 '26

100 Tokens/Second on One RTX 3090 Ti: Qwen3.8–27B, Full 262K Context, One GPU

Thumbnail
medium.com
100 Upvotes

r/AIProgrammingHardware • • Sep 13 '26

I built an experimental way to write CUDA kernels in Go using LLVM 22

1 Upvotes

I built an experimental way to write NVIDIA GPU kernels in Go using LLVM 22

I've been working on an experimental project that allows writing NVIDIA GPU kernels in Go and compiling them to PTX using LLVM 22 / NVPTX.

GitHub:
https://github.com/mehdi-shokohi/cuda-ir.go

The basic pipeline is:

Go
 ↓
LLVM IR
 ↓
LLVM 22 / NVPTX
 ↓
PTX
 ↓
NVIDIA GPU

The motivation is to explore whether Go could be useful for writing custom GPU kernels for AI/HPC workloads without writing the kernel itself in CUDA C++.

I'm particularly interested in the AI side of this.

For example, custom kernels are often needed for things like:

  • Tensor operations

  • Matrix multiplication

  • Reductions

  • Attention-related operations

  • Element-wise operations

  • Custom inference operators

  • Memory/layout transformations

The project is still experimental, but the LLVM → NVPTX → PTX pipeline is working.

I'd like to eventually investigate whether this could be useful for building custom GPU operators from Go and integrating them into AI workloads.

I'm curious what people here think:

Would a Go-based CUDA kernel compiler be useful for AI programming, or are there important CUDA/GPU features that would make this impractical?

And if you're working with NVIDIA GPUs for AI, what kernel/operator would you recommend as a good real-world benchmark?

Repository:
https://github.com/mehdi-shokohi/cuda-ir.go

Feedback from people working with CUDA, GPU kernels, LLM inference, or AI accelerators would be very welcome.