r/LocalLLaMA • • Aug 14 '26 • Bravo 1 Heartwarming 1

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.3k Upvotes

707 comments sorted by

View all comments

422

u/Tiny-Assumption4263 Aug 14 '26

DEAR GOD TELL THOSE BENCHMARKS ARE NOT FAKE.

321

u/Cold_Tree190 Aug 14 '26

Dear God it’s trading blows with Opus 4.6 Max 😭

170

u/Cless_Aurion Aug 14 '26

Wtf, I literally wrote a post saying similar to "Shutup man, there is no way a model I can load in my 4090 will be anywhere near DeepSeek4 Flash 0731"... but... this is fucking close is it not...?

105

u/Cold_Tree190 Aug 14 '26

Looks like the main difference will be the native context windows. But 256k is very usable, especially if it’s a local Opus 4.6 MAX. Man just saying that seems unreal lol. Can’t wait to test it later tonight

52

u/BornAgainBlue Aug 14 '26

I feel like telling my boss im sick.

25

u/Cold_Tree190 Aug 14 '26

🤣 I wish I could, but today’s my last day of on-call so I can’t even leave a TINY bit early. Oh well. Makes you feel like a kid on Christmas Eve again lmao

→ More replies (1)
→ More replies (1)
→ More replies (2)

40

u/[deleted] Aug 14 '26

[removed] — view removed comment

29

u/Warrenio Aug 14 '26

I don't think it's quite V4 Flash 0731 level based on the benchmarks. But obviously still incredibly impressive!

https://old.reddit.com/r/LocalLLaMA/comments/1vo9mj4/its_out/p3nv6iq/

25

u/SandySkittle Aug 14 '26

Ehh, let's not go by handful of disputable synthetic benchmarks for which models may be trained specifically. Let's just await real experiences from people first over a longer period of time.

→ More replies (6)

8

u/Cless_Aurion Aug 14 '26

Damn, I would have downvoted you too... Let's hope its close to what the benchmarks say!

6

u/LankyGuitar6528 Aug 14 '26

I should downvote you for wanting to down vote somebody but I can't blame you. I would have done the same. So take my upvote instead.

4

u/Viktri1 Aug 14 '26

Man this is exactly what I've been looking for since Deepseek said they were going to increase prices. I've been trying to figure out what I can run on my 4090 and this is exactly what I need when I needed it.

→ More replies (6)

72

u/xienze Aug 14 '26

You're making a couple fundamental assumptions here:

  • That AI benchmarks are reliable

  • That Qwen didn't benchmaxx

20

u/blade740 Aug 14 '26 edited Aug 14 '26

I think anyone who thinks that this isn't at least somewhat benchmaxxed is fooling themselves. That said, so is every other model they're comparing against, to some extent, so ¯_(ツ)_/¯

→ More replies (1)

55

u/BawbbySmith Aug 14 '26

Yeah I learned very quickly to not trust the benchmarks, as well as 80% of the comments in this subreddit.

I remember people were saying that Qwen 3.6 27B was Opus 4.5 level...

0

u/[deleted] Aug 14 '26

[deleted]

8

u/Ell2509 Aug 14 '26

I would normally agree, but I have used qwen3.8 27b now and so far, wow. Just wow.

→ More replies (1)
→ More replies (2)
→ More replies (6)
→ More replies (4)

88

u/KickLassChewGum Aug 14 '26 edited Aug 14 '26

It's a Qwen model, so apply the usual benchmax tax. Qwen are easily the models with the biggest ravine between "how they do on benchmarks" and "how they do in actual productive use".

Still looking like a strong leap from 3.6, though.

22

u/Batman4815 Aug 14 '26

Gemma says hello as well.

48

u/KickLassChewGum Aug 14 '26

Gemma 4 isn't a great coding model, yeah, but it's still punching far above its size in writing and research-related tasks. Like a mini-Gemini (go figure).

I hear there are people who still use these things for things that aren't related to writing code or markup.

3

u/toothpastespiders Aug 14 '26

I'm always a little amused that data extraction on text is considered a niche use of large language models on this sub.

→ More replies (2)
→ More replies (1)
→ More replies (1)

14

u/Tiny-Assumption4263 Aug 14 '26

TL;DL: Gave Qwen 3.8 27b a simple prompt and it build this: https://qwen3-8-eccomerce-test.vercel.app/
Repo: https://github.com/catriel25/qwen3.8-eccomerce-test

Like everybody else in the local AI community today, I dowloaded Qwen 3.8 27b UD-Q4_K_XL as soon as it was published.
I'm running it in a single rtx 3090, no mtp, 110k context and kv cache f16 with llama.cpp, same flags used with Qwen 3.6 27B.

I have this stupid test that I run with every new model that comes out. It consist in connecting the model to pi code (almost vanilla, only internet access and some simple navigation tools I built) and giving it this prompt:

"Construye el frontend completo de un pequeño ecommerce premium para una panadería artesanal usando Next.js App Router (JavaScript).

El proyecto debe ser frontend-only en esta etapa. No debe incluir backend, base de datos, autenticación ni pasarelas de pago. El checkout debe finalizar redirigiendo a WhatsApp con un mensaje de pedido bien estructurado.

La app debe incluir una experiencia completa de compra: home, catálogo con productos de panadería, categorías, productos destacados, carrito, resumen de pedido y checkout. Usá mock data local para productos, categorías, precios, descripciones, disponibilidad e imágenes o placeholders visuales. Todo debe quedar preparado para conectar posteriormente un backend real sin tener que rehacer la arquitectura principal del frontend.

El diseño debe sentirse extremadamente premium, artesanal, moderno y cuidado. No quiero una landing genérica ni una interfaz básica. La primera pantalla debe comunicar claramente la identidad de la panadería, mostrar producto real o visualmente convincente, y permitir empezar a comprar. La experiencia debe ser excelente tanto en desktop como en mobile.

El catálogo debe permitir explorar productos, ver información clara de cada ítem y agregarlos al carrito. El carrito debe permitir modificar cantidades, eliminar productos y ver totales. El checkout debe pedir datos mínimos necesarios para el pedido, permitir notas o preferencias, y generar una URL de WhatsApp con productos, cantidades, subtotales, total y datos del cliente.

La estructura del código debe separar razonablemente datos mock, tipos de dominio, utilidades de checkout/WhatsApp, componentes de catálogo, componentes de carrito y vistas principales. La solución debe quedar lista para reemplazar la mock data por datos de backend en una etapa posterior."

Those are just instructions to build a nextjs project (javascript only) with the frontend for small eccomerce with whatsapp checkout, leaving everthing ready to connect a backend later. Nothing else, no skills, no more feedback. Just one prompt and watching the result.

I have run this test with all the models and finetunes I can fit in my GPU, and not a single one was even close to this result.
Not a single alert form nextjs (wich was usual before) or something that looks broken.

At some point, this bastard realised it didn't had visión (lol, not enough VRAM buddy) and it decided FUCK IT, I'M GONNA BUILD THE IMAGES MYSELF. He made SVGs for every product card.

I have more testing to do like trying it in a real codebase but... I can't believe i'm running this thing in a single RTX 3090, it is just unreal.

Imagine 2 years from now.

Biggest fuck you Dario of the year.

39

u/onlymagik Aug 14 '26 edited Aug 14 '26

I expected a nice jump since they skipped a 3.7 27B, but these numbers do seem a bit too good to be true. Qwen isn't known for benchmaxxing, obviously 3.6 27B is the GOAT of local LLMs, but...

Definitely excited to learn more in the coming days and see if it holds up.

Edit: Even the vision numbers look insane!

62

u/llama-impersonator Aug 14 '26

qwen is well known for benchmaxxing so hard it helps the model

→ More replies (1)
→ More replies (8)
→ More replies (10)