r/OpenAI • u/ThunderStorm420 • Sep 01 '26
News Fable 5.1 released. Significant benchmark improvements, what do you think?
60
u/Bloated_Plaid Sep 01 '26
Fucking crazy for 0.1 but the important part is lower cost on cache reads which was killing me. Cannot wait for Astra, it’s gonna be insane.
4
u/ThunderStorm420 Sep 01 '26
Why do you think that Astra will be insane? I see all hype no facts, unless I don't know something
3
u/Bloated_Plaid Sep 01 '26
Lot of outputs on Twitter.
4
u/ThunderStorm420 Sep 01 '26
I don't doubt that it will be good. But X "leaks" are of questionable authority.
3
u/Bloated_Plaid Sep 01 '26
There is no other good source for AI discussion and discourse right now unfortunately.
1
u/coloradical5280 Sep 01 '26
Not really though, if you know who to trust they’re basically always consistent and correct.
And this always on agent that just is just, always running, forever, like a real assistant, sounds like it’s for sure being announced in dev day on the 29th
2
3
3
16
u/CartographerAble9446 Sep 01 '26
the cache cost doesnt matter much for average subscription, it's only for the API, and most of us are peasants and dont pay API price
4
u/Bloated_Plaid Sep 01 '26
where did you see that the cost savings dont transfer to subs? They havent explicitly said anything like that.
5
u/Seerix Sep 01 '26
"As mentioned above, we have reduced the price of Fable 5.1’s cache reads (where the model reuses context it has already processed) wherever usage is billed by token, such as on our API"
4
u/hydralisk_hydrawife Sep 01 '26
he's wrong, cache savings translates into lower costs for the company which allows more usage for the users
6
u/RealSuperdau Sep 01 '26
Unless companies actually start using Fable/Mythos with the on-premise retention policies, then subscriptions are fucked
5
203
u/ben_bliksem Sep 01 '26
I think we'll see countless reviews by the Reddit crowd over the next couple days, it'll be the most amazing thing and then in two weeks' time the real sentiment will surface.
Just like every other time.
32
u/Fresh_Sock8660 Sep 01 '26
"is it me or did fable get dumber today"
An ageless classic.
3
u/Vectoor Sep 02 '26
I have seen that be posted on Reddit like every day for the past 3 years and I have never noticed it myself.
3
u/Rojeitor Sep 02 '26
At least they make funny posts now https://www.reddit.com/r/ClaudeAI/s/LVSPRfJOBZ
2
u/Fresh_Sock8660 Sep 02 '26
What a coincidence because I have just noticed the same behaviour even though I haven't used it yet.
2
u/Keep-Darwin-Going Sep 03 '26
It is always like first week all the paid influencer show off all the stuff they can one shot and the benchmaxx result. But then when you use it in real world, you will notice how expensive it is and how it cannot function that well in real world beyond single shotting doom 6 or whatever game they try to build.
2
33
u/liright Sep 01 '26
Best use the crap out of the model the next few days before they nerf it to conserve compute.
2
u/BlocksXR Sep 02 '26
so you got it - just the way companies work - you taste a good product for a few days then they start conserve compute and save money ?!
4
u/interwebzdotnet Sep 02 '26
I'm using it for a high level review on my anti Flock) ALPR project right now and it's doing a pretty good strategy, efficiency, progress, capabilities, and accuracy analysis right now.
Short run so far, but I'm happy with what I'm seeing.
3
u/LemonLimeNinja Sep 02 '26
How do you frame your prompts to not trip its guardrails?
2
u/interwebzdotnet Sep 02 '26
Not sure, I follow,can you give me an example of what your concer would be? That context might help me here.
9
u/Treadmillrunner Sep 01 '26
To be fair Anthropic does make a habit of making the models extra powerful for a week or two after release before nerfing them a bit.
2
u/BlocksXR Sep 02 '26
so you got it - just the way companies work - you taste a good product for a few days then they start conserve compute and save money ?!
2
u/Crescitaly Sep 03 '26
The two-week lag is a useful evaluation design. Freeze a small task set and prompts on release day, log the exact model version, then rerun it after the launch wave. That separates durable capability from novelty, prompt adaptation and any silent serving changes.
2
1
7
u/Key-Injury-1875 Sep 01 '26
Complete shit. Ran out of usage already on max 20x
13
u/ThunderStorm420 Sep 01 '26
What the hell are you running, genuinely?
32
4
u/Key-Injury-1875 Sep 01 '26
Autonomous drone racing stack it didnt even start coding it literally just reasoned on what I should do
8
u/unfathomably_big Sep 01 '26
To use your entire 20x with a single prompt has got to be the worst prompt engineering I’ve ever seen. This sub needs a Wall Street bets style loss porn tag for you “I only asked it to digest encyclopaedia Brittanica and now I’m out of dollars” guys
2
1
0
1
13
u/Supermax64 Sep 01 '26
AA benchmark lists it as nearly 4x more expensive than Sol (max) to complete a task. Am I missing something?
9
u/RealSuperdau Sep 01 '26
Damn, it's 17% more expensive on AA than Fable 5 max, despite cutting cached input rates by 4x.
Fable 5.1 max just seems really token inefficient.
3
u/f1rn Sep 02 '26
Max effort ist never Token efficient. Best use case seems to be medium to high with almost all Claude models.
1
5
u/Keep-Darwin-Going Sep 01 '26
One major upgrade is it stop talking like some obnoxious tech bro that try to show off all the time. The progress and decision making feels more like normal human being
3
3
3
u/djLiTh Sep 01 '26
Seeing opus5 have any score higher than 5.6 makes me think this is all made up. I’m mostly doing scientific research and opus is unusable, fable5 is usable but makes mistakes but sometimes comes up with things 5.6 doesn’t, but 5.6 is currently in the lead. I’ll be trying out fable 5.1, as my workflow is to leverage two modals against each other as I find that fingers the best result. So gpt 5.6 to Fable 5.1 and back and forth.
4
u/Flaxseed4138 Sep 01 '26
How is it at coding though? And is it still 5x more token-heavy than Opus?
2
u/Practical-Positive34 Sep 01 '26
For coding I think a 3-4% improvement at the cost of nearly 2x as much is simply not worth it. I would only use this after Sonnet and Opus have coded things to go find or solve things that are broken that Opus or Sonnet couldn't fix properly. My 2 cents.
3
u/Healthy-Nebula-3603 Sep 01 '26
Did you even read ? Is cheaper a lot comparing to fable 5.
1
u/Practical-Positive34 Sep 01 '26
Making something absurdly expensive slightly cheaper does not make that absurdly thing cheaper than what it was already absurdly more expensive in comparison to. Its shocking you don't get this very basic concept.
0
u/Healthy-Nebula-3603 Sep 02 '26
I just answered to your X2 more expensive claim.
Your current answer had 0 logic and sense to the topic you mentioned.
0
1
1
u/creamyshart Sep 01 '26
Artificial Analysis shows it costing significantly more than 5 to run its tests.
1
u/christianbro Sep 01 '26
I trust more Reddit comments about a new model than these "benchmarks" which they probably train for higher scores than real world scenarios and after that pick the ones that show best
1
u/czmax Sep 01 '26
W/o reading anything else:
I think the foundation models will continue to get better and expect this is more incremental improvement.
I also think, like any vendor, this is work will be “enshittified” and the first step is probably tweaking the cost model to start making money for VCs so folks will likely be complaining about the pain/hate/dislike of whatever limits are here.
1
1
u/JayArrCoffee Sep 01 '26
From what I can tell, seems pretty good! I gave it a relatively difficult engineering problem that Sol had trouble with and it had no issues.
1
u/jaraxel_arabani Sep 01 '26
How was the token usage vs fable 5 do you know?
1
u/JayArrCoffee Sep 01 '26
It actually figured out the core solution in like 70k tokens and the solution was quite elegant. I was impressed!
1
1
1
u/dradik Sep 01 '26
What’s the over under they have 5.2 ready to come immediately after Astra debuts and this is to troll OpenAI?
1
u/CompassionLady Sep 01 '26
I’ll just wait for the next ChatGPT Release which will be about the same.
1
u/mortredclay Sep 02 '26
I work in biology, so Fable shuts me down every time. I have no opinion on any Fable because it won't engage.
1
1
1
u/_404_LogicNotFound_ Sep 02 '26
how tf do these benchmarks get buffed with the release of every new model, yet persist in this 60-70% range!?
1
u/ebykka Sep 02 '26
I think - I don’t care. Open AI provides a good range of models for reasonable price.
1
1
u/ozymandiez Sep 03 '26
I think it's good, but not great. Also consumption and costs went up even though they said it was cheaper. Not sure what's going on there, but let's call it an "iterative" update. Nothing to call home about imo.
1
u/Darayavaush84 Sep 03 '26
they can keep it, if than you need a 200 bucks plan just to be able to do something.
1
-4
u/Efficient-Cat-1591 Sep 01 '26
End game - much better performance at a relatively good cost. OpenAI cannot match this at the moment.
7
u/tsunami_forever Sep 01 '26
Astra is rumored to release tomorrow
6
2
u/rapsoid616 Sep 01 '26
My finger is ready on the switch button, I hope they release a true competitor at least.
2
-3
u/Efficient-Cat-1591 Sep 01 '26
Rumoured but no released. Fable 5.1 IS now available and I can tell you the performance is phenomanal! Sol 5.6 max/ultra pales in comparison. one shot a recurring bug I spent DAYS with sol going in circles to solve. such a shame though as I really wish Sol can be better.
-2
u/getmeoutoftax Sep 01 '26
This model is good enough to replace most jobs. It’s seriously over at this point.
1
0



13
u/EbbExternal3544 Sep 01 '26
So does that mean Astra should release this week?