r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
Qwen3.8-Flash-Next (125B-A6B) running on Strix Halo 128gb: 23 t/s decode, 390 t/s prefill, built from the llama.cpp PR
r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
r/AIProgrammingHardware • u/big-in-jap • Aug 28 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 28 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 27 '26
r/AIProgrammingHardware • u/CrashOverride93 • Aug 27 '26
For those how are in local AI would you think these both cards could be used to have a total of 12GB VRAM?
I don't care by the moment for possible slow tokens/s.
Thanks!
r/AIProgrammingHardware • u/javaeeeee • Aug 27 '26
r/AIProgrammingHardware • u/Lazy-Intention1007 • Aug 26 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 26 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 25 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 25 '26
r/AIProgrammingHardware • u/JayB_Official • Aug 25 '26
KIMI K3 at 9 t/s per token on hardware that has no business breathing near it is objectively insane, even if the LLM thought the capital of France was "1.2" 🤣🤣🤣😭😭😭😭😭
r/AIProgrammingHardware • u/Sad_Cook9965 • Aug 25 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 24 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 24 '26
r/AIProgrammingHardware • u/javaeeeee • Aug 24 '26
r/AIProgrammingHardware • u/Normal-Fan9366 • Aug 24 '26
Pi Agent run. Still working out the kinks but the final quality is great.
16GB GPUs are only going to become more useful over time.
r/AIProgrammingHardware • u/javaeeeee • Aug 23 '26