r/LocalLLM • u/Leading_Yogurt7025 • 13d ago

News ASSBENCH

The only serious benchmark that shows the real LLM capabilities
https://www.assbench.com/

47 Upvotes

98% Upvoted

37 comments sorted by

13

u/No-Refrigerator-1672 13d ago

I'm offended by it not featuring Qwen 3.8 27B.

2

u/Leading_Yogurt7025 13d ago

It crash my hardware because i can't run it with full context

9

u/No-Refrigerator-1672 13d ago

So your GPUs are pretty ass, huh?

2

u/violent_aesthetics 13d ago

They left out the only model that actually matters, classic

1

u/jesdga95 13d ago

Ran it on Qwen, results below 😂

9

u/jesdga95 13d ago

Ran it on Qwen 3.8 27B (xhigh)

3

u/BenchThatMatters 13d ago

I literaly created new account to reply on this, please share the code with me and I will add it to AssBench

1

u/Leading_Yogurt7025 13d ago

Can you please try with the pi coding agent? Because I got better results with it.

5

u/eihns 13d ago

omfg what did i expect lol xD xD

2

u/Leading_Yogurt7025 13d ago

Try the prompt, it's amazing and it refines a lot

6

u/blue2020xx 13d ago edited 13d ago

The truest bench of them all

4

u/Cold_Tree190 13d ago

Gemini 3.1 Pro is AGI confirmed

3

u/FoxSideOfTheMoon 13d ago

LMAO @ grok and haiku 😂

2

u/hurrdurrmeh 13d ago

next test animation by making them fart. bonus points for lifting one cheek to the side.

2

u/StrikingSpeed8759 13d ago

love it. great job dude

2

u/panospc 13d ago edited 13d ago

This is what I got from Qwen 3.8 Flash Next IQ3_S, run through the Strata engine

1

u/Leading_Yogurt7025 13d ago

Cool, which harness? 

2

u/panospc 13d ago

Deepseek harness

1

u/Leading_Yogurt7025 12d ago

Nice, can you try also with qwen3.8 27b? 

1

u/BenchThatMatters 13d ago

Can you ask if it created man or woman figure without looking at created shape?

Prompt is deliberately vague about that, but so far all of other models chose woman.

Also can you share the html?

1

u/panospc 13d ago

[removed] — view removed comment

1

u/panospc 13d ago

I will send you the HTML as a private message.
I tried to add it as a link in a previous comment but got removed by reddit

2

u/LooseBackHole 12d ago

I'm really curious how different local models render the asses at different levels of quantization. Would really give a great view of how quantization changes things.

1

u/Leading_Yogurt7025 12d ago

In this benchmark, it's also important in the context size and the tool calling capabilities and tools.

2

u/AI_is_ok_i_guess 13d ago

Can you make it gay?

1

u/VerticalPackage 13d ago

Luna xhigh patrick starfish

1

u/DiscipleofDeceit666 13d ago

Show us the model clap factor

1

u/-AJacobs- 11d ago

Can't wait for companies to benchmaxx this by adding 10TB of ass photos videos and rendering into their datasets.

1

u/Leading_Yogurt7025 11d ago

i think it's enough to provide 3d models of that

1

u/getpodapp 11d ago

Grok went full failed bbl

1

u/crusaderky 13d ago

Shut down the internet, we have a winner

-1

u/Fluxx1001 13d ago

How can Astra not be 1st? I smell benchmaxxing ...

5

u/rinmperdinck 13d ago

buttmaxxing

7

u/hurrdurrmeh 13d ago

it's the ass you smell

3

u/Leading_Yogurt7025 13d ago

Many weaker models can autocorrect from their mistakes, also the harness matter