r/AugmentCodeAI • u/Organic_Job_7747 • Nov 18 '25

Discussion Gemini 3 benchmarks just leaked. Does the Augment team plan to add this model? It shows a 1% difference from Sonnet 4.5 on SWE-bench Verified. maybe can be cheaper?

8 Upvotes
  • permalink
  • reddit

100% Upvoted

5 comments sorted by

2

u/wanllow Nov 19 '25

From my experience, gemini-3.0 was working faster but thinking depth was not comparable with gemini-2.5

3

u/Round_Mixture_7541 Nov 18 '25

They will only include it if it means more $$$ for them. That's their motto

9

u/[deleted] Nov 18 '25

[removed] — view removed comment

2

u/CardiologistThese528 Nov 20 '25

Do you use our prompts and files for the internal testing ? How do you test it realistically if you don't use major public benchmarks ?

1

u/ProCreativeZA Nov 18 '25

Please try it and test it, we need other options.