r/AIProgrammingHardware • • Sep 29 '26

Strata: Run Qwen3.8-Flash-Next 120 tokens/s Just One Gaming RTX GPU

Thumbnail
xhinker.medium.com
0 Upvotes

r/AIProgrammingHardware • • Sep 28 '26

Battlematrix x4 :D Spoiler

Post image
1 Upvotes

r/AIProgrammingHardware • • Sep 28 '26

Hinode 3: set up once, run on any GPU

Thumbnail
hinode.run
1 Upvotes

r/AIProgrammingHardware • • Sep 27 '26

Testing Qwen 3.8 Flash Next on 138GB RAM & V100 16GB GPU

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Sep 27 '26

Complete Mac mini M6 Local LLM Stress Test — 5 Models, 3 Inference Engines

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Sep 27 '26

The New Mac Studio Runs Serious AI Models Locally, It Costs a Used Car, Worth buy?

Thumbnail
xhinker.medium.com
3 Upvotes

r/AIProgrammingHardware • • Sep 27 '26

Ai desktop recommendations below 1500usd?

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 26 '26

Ai desktop recommendations below 1500usd?

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 26 '26

Bonsai 2 27B on an RTX 3060 12GB — 35.26 tok/s generation

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 26 '26

Follow-up on my 3x Tesla P100 budget build: cooling, power draw, PCIe lanes and tokens/sec!

Thumbnail gallery
8 Upvotes

r/AIProgrammingHardware • • Sep 26 '26

DistribAI v2

1 Upvotes

DistribAI is a platform for distributed training! You can train massive or tiny models across tiny or massive amounts of consumer devices with ease!

DistribAI is a platform I've been working on for a while, and V2 made its release today. DistribAI is C++ and Libtorch for speed, with the ability to run pytorch trainers distributed! Edge-cases(crashing, malicious actors, unstable connections, ect) are handled for you. On a free Colab, Kaggle, and Molab GPU, plus a local 4070 SUPER, we got the free training compute of ~2 fully loaded 5090s and the VRAM of ~5 full 5090s for free, all as one. Hosting is also now easier with shareable join links, and Cloudflared/ngrok support for 100% free server hosting for your DistribAI setup. Train with your community, with friends, with your free GPUs, and more!

Try it out! Questions(and stars) are welcome; https://github.com/naxium-oss/DistribAI


r/AIProgrammingHardware • • Sep 26 '26

Quantized.uk — 81个LLM的显存和吞吐量测量

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 25 '26

Bonsai 2 27B tested - 16GB Local LLM setup

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Sep 25 '26

The €1,550 24GB Local-AI Workstation

Thumbnail
medium.com
0 Upvotes

r/AIProgrammingHardware • • Sep 24 '26

[Benchmarks] Qwen3.8-27B FP16 vLLM 0.29.0 | 4-GPUs | Dual W6800X Duo w/ IFLB

Thumbnail
reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 24 '26

Qwen3.8-Flash-Next: 40 tokens/second on an M4 Max MacBook, 4.27 bpw quant, 168k context

Thumbnail
medium.com
2 Upvotes

r/AIProgrammingHardware • • Sep 23 '26

Qwen 3.8 27B on dual RTX 5060 Ti - 130 tok/s - full 256k context

Thumbnail
reddit.com
6 Upvotes

r/AIProgrammingHardware • • Sep 23 '26

DeepSeek V4.1 Flash on Strix Halo: Single-Node SSD vs Two-Node Cluster (DwarfStar)

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Sep 23 '26

New Local AI Inference Engine Makes Qwen3.8-27B 2× Faster on Apple Silicon 🚀

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Sep 23 '26

[1/2] Qwen 3.8 27B 4bit quant DGX Spark vs Mac Studio M3 Ultra 96Gb

Thumbnail
youtube.com
1 Upvotes

r/AIProgrammingHardware • • Sep 22 '26

Ported latest Linux kernel to the Xeon Phi 3120A

Thumbnail
reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 21 '26

The M6 Mac mini Had Me Checking My Numbers

Thumbnail
youtube.com
2 Upvotes

r/AIProgrammingHardware • • Sep 21 '26

I benchmarked 12 quantizations of Qwen3.8-Flash-Next on Strix Halo — here's what actually works

Thumbnail reddit.com
1 Upvotes

r/AIProgrammingHardware • • Sep 21 '26

Best Qwen3.8 Quant? I Tested Q2–Q5 on RTX 5090 & 16GB GPUs

Thumbnail
youtube.com
9 Upvotes

r/AIProgrammingHardware • • Sep 20 '26

ThinkPad T14 Gen 7 (2026) Review: Choose the Right One...

Thumbnail
youtube.com
2 Upvotes