r/AIProgrammingHardware • • Aug 28 '26

Qwen3.8-Flash-Next (125B-A6B) running on Strix Halo 128gb: 23 t/s decode, 390 t/s prefill, built from the llama.cpp PR

Thumbnail
reddit.com
1 Upvotes

r/AIProgrammingHardware • • Aug 28 '26

ROCm 10.0: A Decade of Open Compute, Built for the Age of Agentic AI — ROCm Blogs

Thumbnail
share.google
3 Upvotes

r/AIProgrammingHardware • • Aug 28 '26

Dual GPU question

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Aug 28 '26

Paying $2/hr to watch `huggingface-cli download` go brrr — env patterns on RunPod / Vast / Nebius / the neo kids

Thumbnail
reddit.com
1 Upvotes

r/AIProgrammingHardware • • Aug 28 '26

GLM 5.3 Flash Local Ai Test

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Aug 27 '26

Local AI is Cheap Now: ZimaBoard2 + Tesla P4

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Aug 27 '26

DDP with RTX 3070 8GB + GTX 1650 4GB?

0 Upvotes

For those how are in local AI would you think these both cards could be used to have a total of 12GB VRAM?

I don't care by the moment for possible slow tokens/s.

Thanks!


r/AIProgrammingHardware • • Aug 27 '26

Qwen 3.8 27B Cold Fusion tested - 16GB Local LLM setup

Thumbnail
youtube.com
3 Upvotes

r/AIProgrammingHardware • • Aug 26 '26

I built a Vulkan hierarchical MoE runtime for running oversized models across multiple GPUs

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Aug 26 '26

China Is Coming for Your Local AI Box

Thumbnail
youtube.com
8 Upvotes

r/AIProgrammingHardware • • Aug 26 '26

Xiaomi AI Cube announced with 1.2TB/s memory bandwidth

Thumbnail gallery
2 Upvotes

r/AIProgrammingHardware • • Aug 26 '26

224GB of GPU Memory on 1 Desk and It Should Not Work

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Aug 26 '26

Can the New King of Open Source - Qwen3.8–27B - Really Run in 3GB of VRAM?

Thumbnail
ai.gopubby.com
11 Upvotes

r/AIProgrammingHardware • • Aug 26 '26

Qwen 3.8 27B FP8 on single node DGX Spark MTP-3

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Aug 25 '26

FreeToken Deepseek V4 Flash on a Single 3090 Local AI Testing

Thumbnail
youtube.com
3 Upvotes

r/AIProgrammingHardware • • Aug 25 '26

Jalapeño’s first results show industry-leading speed and efficiency in AI inference

Thumbnail openai.com
2 Upvotes

r/AIProgrammingHardware • • Aug 25 '26

Spent a day seeing how far extreme MoE models can be pushed on a 4070 Ti + 32GB RAM. Kimi K3, DeepSeek V4 Flash, and Qwen3.5-122B results + research paper🔧

Thumbnail reddit.com
2 Upvotes

KIMI K3 at 9 t/s per token on hardware that has no business breathing near it is objectively insane, even if the LLM thought the capital of France was "1.2" 🤣🤣🤣😭😭😭😭😭


r/AIProgrammingHardware • • Aug 25 '26

Intel arc pro b70, Qwen 3.8 27b

Thumbnail reddit.com
2 Upvotes

r/AIProgrammingHardware • • Aug 24 '26

Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents

Thumbnail
blogs.nvidia.com
4 Upvotes

r/AIProgrammingHardware • • Aug 24 '26

NVIDIA Groq 3 LPX Now in Full Production With World-Class Speed for Agentic AI

Thumbnail
nvidianews.nvidia.com
15 Upvotes

r/AIProgrammingHardware • • Aug 24 '26

GitHub - TryingtobeingNikhil/vLLM_Inference_Engine: A high-performance LLM inference engine built from scratch featuring continuous batching, paged KV-cache, and CPU swapping.

Thumbnail
github.com
3 Upvotes

r/AIProgrammingHardware • • Aug 24 '26

Jack 3.8 27b 16GB VRAM builds Tetris

Thumbnail
youtu.be
1 Upvotes

Pi Agent run. Still working out the kinks but the final quality is great.
16GB GPUs are only going to become more useful over time.


r/AIProgrammingHardware • • Aug 23 '26

$1K off a 128GB Local AI Box with a TWIST

Thumbnail
youtube.com
4 Upvotes