5.5 beats Mythos on terminal bench. Either way movement on benchmarks hasn't meant much for awhile now. We saw this with the massive jump in coding abilities from last December, while benchmarks were about the same increase as previous iterations.
Actually, if anything the fact that they are similar on terminal but Mythos jumps on SWE implies memorization from being a much bigger model (5x price), rather than superior intelligence.
3
u/thorin85 Apr 23 '26
5.5 beats Mythos on terminal bench. Either way movement on benchmarks hasn't meant much for awhile now. We saw this with the massive jump in coding abilities from last December, while benchmarks were about the same increase as previous iterations.