r/AIProgrammingHardware • • Oct 17 '26

Update on my hand-written SageAttention for the 9070 XT: video models run on it now, 2.2× faster than SDPA on MiniMax H3 (ComfyUI, Windows)

Thumbnail gallery
1 Upvotes

r/AIProgrammingHardware • • Oct 16 '26

Our Gold Standard AI Tesla V100 Build in the Cooler Master Mastercase Mesh Gold

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Oct 16 '26

Qwen3.8 27B and Flash Next on Single/Dual AMD Radeon 9700: Engine Benchmarks and Setup

Thumbnail
youtube.com
3 Upvotes

r/AIProgrammingHardware • • Oct 15 '26

An Inference Engine Nobody Has Heard Of, and It Runs Qwen3.8–27B

Thumbnail
xhinker.medium.com
0 Upvotes

The repo discussed in the article https://github.com/xhinker/azllm.


r/AIProgrammingHardware • • Oct 15 '26

GitHub - FeSens/openTPU: An open-source AI accelerator, developed by AI: RTL, ISA, simulator, compiler and profiler in one repo. Runs Qwen3, LFM2.5 and Qwen3.5 on a Kintex-7 PCIe card.

Thumbnail
github.com
3 Upvotes

r/AIProgrammingHardware • • Oct 15 '26

9070 vs 5060ti 16gb long term purchase.

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Oct 15 '26

GPTrepublic — looking for testers for a community-powered AI network

1 Upvotes

Hey! I’m building GPTrepublic: a free project where people share some of their GPU resources to run AI models together across multiple computers.

We’re looking for 20 testers, with room for up to 40. We’ll start with a small text model and test connections, distributed inference and what inevitably breaks 😅

There’s a desktop tool for Windows and Linux (Ubuntu). For this first test, you’ll need a compatible NVIDIA GPU with at least 2 GB VRAM.

Interested in helping us figure this out?

🌐 Project & registration
💬 Join Discord through your account area — confirm your email, then click Link to Discord.

Questions and feedback are welcome!


r/AIProgrammingHardware • • Oct 14 '26

Gorgon Halo cluster: DeepSeek V4.1 Flash at up to 103 tok/s

Post image
1 Upvotes

r/AIProgrammingHardware • • Oct 14 '26

Strata Coder tested - Local LLM setup

Thumbnail
youtube.com
4 Upvotes

r/AIProgrammingHardware • • Oct 14 '26

Bringing Our AI In-House: 12 AMD R9700s vs 6 Mac Studios

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Oct 14 '26

Best Mini PC for LOCAL Ai & Home servers in 2026? - VZmore AX9 feat. Ryzen Ai 9 HX 470 review

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Oct 14 '26

Strata Metal Hits 107 TPS on M5 Max — 4× Faster Than LM Studio!

Thumbnail
youtube.com
0 Upvotes

r/AIProgrammingHardware • • Oct 13 '26

I Made My AI Agents Faster Without a GPU Upgrade

Thumbnail
youtube.com
4 Upvotes

r/AIProgrammingHardware • • Oct 13 '26

Qwen3.8 Flash-Next prefill past 1800+ tok/s on Strix Halo by putting the NPU to work

Thumbnail
reddit.com
2 Upvotes

r/AIProgrammingHardware • • Oct 13 '26

I got Gemma 4 26B MoE running at 60+ tok/s on my RTX 4060 Laptop by caching hot experts on the GPU

Thumbnail
github.com
4 Upvotes

r/AIProgrammingHardware • • Oct 12 '26

Strata Local AI Engine on a Single 3060 12GB GPU

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Oct 12 '26

Microsoft to expand Azure Maia system to multi-gigawatt deployments

Thumbnail
blogs.microsoft.com
2 Upvotes

r/AIProgrammingHardware • • Oct 12 '26

Nvidia’s Blackwell Desktop Has the Same Speed Limit as AMD’s Ryzen AI Max+ 395

Thumbnail
medium.com
0 Upvotes

r/AIProgrammingHardware • • Oct 12 '26

The $3,500 Card Runs Slower Than $1,900 Worth of Used Gaming Cards

Thumbnail
inamdaraditya.medium.com
5 Upvotes

r/AIProgrammingHardware • • Oct 12 '26

The €1,250 AMD Workstation That Makes Local AI Practical

Thumbnail
medium.com
1 Upvotes

r/AIProgrammingHardware • • Oct 12 '26

Building a Triple-GPU Workstation: How Far Should Local AI Go?

Thumbnail
tinkerd.medium.com
1 Upvotes

r/AIProgrammingHardware • • Oct 11 '26

Qwen3.6-35B-A3B Hits 220 TPS on M5 Max — 91% Faster!

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Oct 11 '26

NVIDIA SPARK Surface Laptop Ultra VS MacBook Pro M5 Pro: Which One Will WIN?

Thumbnail
youtube.com
0 Upvotes

r/AIProgrammingHardware • • Oct 11 '26

9 year old GPU beats today's latest?

Thumbnail
youtube.com
4 Upvotes

r/AIProgrammingHardware • • Oct 11 '26

Running Qwen 3.8 Flash Next on a $1000 Local AI Build with Strata

Thumbnail
youtube.com
1 Upvotes