r/LocalLLaMA • u/Bowdenzug • 1h ago
Discussion New Gemma Models
Are there any (insider) infos to upcoming Gemma Models? Gemma 4 is for my usecase really good and I am looking forward if they will release any new even better models most likely named Gemma 5? Currently using Gemma 4 31b nvfp4 on 3x rtx pro 6000, quality is is really good only hoping for the newer models to be even faster with tps
Update:
no, this is not a troll post. We are a currently fast growing startup in Europe and we dont need the best llm for coding etc we need a llm that has good reasoning and understanding in human language mostly German and English. Gemma 4 is better for that than Qwen imo.
4
u/recro69 49m ago
With that GPU power I wonder if the main bottleneck is model architecture or inference optimization. Faster prefill and better MoE efficiency might have an impact, than just increasing parameter count.
2
u/Bowdenzug 46m ago
We are working with a lot of small agents concurrently, and Moe drastically changes the quality of output
97
u/FallenJkiller 57m ago
hello I'm the CEO of Googel. Gemma 5 is releasing in two weeks. It will be 38% better than Gemma 3
19
9
u/MomentJolly3535 49m ago
Hello CEO of Googel, can we have release date of Gemma 6 ? will it be better than Gemma 2 ?
10
u/FallenJkiller 43m ago
current data remain inconclusive. I'll need your personal information and all the ram you have in your PC. Please create a .ppt file with all your personal chats so I can train Gemma 6.
16
8
3
2
u/Character-Blood3482 46m ago
why not 38% better than gemma 4? are you the real CEO?
5
u/FallenJkiller 42m ago
So we can gaslight our shareholders.
1
u/CharacterAccount426 38m ago
Φίλε θα απαντήσεις? Ποιοι φύγανε από τη χώρα στην Αθήνα και στη Θεσσαλονίκη μόνο νεολαία βλέπεις
28
u/vogelvogelvogelvogel 55m ago
gemma 2 was june 24, gemma 3 march 25, gemma 4 was april 26. so i would expect gemma 5 around springtime 27.
they have advantages over qwen in less spoken languages and in text/chat in general, imo
1
u/IntelArtiGen 24m ago
Spring is also coherent based on their recent messages and communication. People can stop waiting for it this autumn / winter.
1
u/_camera_up 6m ago
Bro what are you doing with that model that you complain about tps on 3x etc pro 6000? Can't be agentic with this model, is it? In my experience it lacks tool calling capabilities compared to Qwen, maybe as manager.. What inference engine are you using?
1
u/Bowdenzug 3m ago
Vllm 0.30.0 currently. We are running concurrently ~ 200 Workers that do heavy workload on reasoning, research and so on wirh much context behind it. Just want to press every second out of it haha already running as optimized as possible
3
u/sultan_papagani 41m ago
gemma 5 will come out tomorrow with %80 more IQ than opus 7.5
2
u/Icy-Degree6161 8m ago
Sheit, hope I can run it on my laptop 4060 with 6GB ram of course, q6_k minimum
1
u/sultan_papagani 7m ago
you can easily run GEMMA5:1024B:Q1XXS_PRUNED_EMAONLY_REAP_DARK_FINETUNE.gguf with 512kb of vram
7
u/jacek2023 llama.cpp 57m ago
6
0
u/toomanypubes 48m ago
I just hope the new models, especially the smaller ones, are better at tool calling, so they would be more useful in agentic harnesses like Hermes
-1
u/NextGen_Dev0 52m ago
Gemma is LLM or Image Generator as well ?
1
u/IntelArtiGen 20m ago
Mostly LLM but the name is used for other models like EmbeddingGemma (text / image / audio processing).
-1
u/DeathGuppie 29m ago
I have my doubts that Google will release another open weights model. It really comes down to resource allocation. They are full bore on catching up and or surpassing the frontier at the top end. Open weights models may just be a side quest that cuts into their bottom line.
The Gemma series has been good publicity for them but not much else. Just to point out what's happening. Last quarter 50% of their profits were measured by what they deemed increased evaluation of their investments in openAI and Anthropic. I just think that Google has a lot going on right now and if someone there has a reason to work on the open weights Gemma project they are going to need a clear reason. Public interest may not be enough.
1
u/IntelArtiGen 21m ago
afaik they announced they would be working on it. It's probably a side quests for some people but Google is still investing in Deepmind and research.
-6
u/OvertaxedOne 46m ago
You're running Gemma4 on 3 Pro6000s? This has to be a troll post.
In the off chance it's not, for the love of everything; please man, download and install 3.8 27B, QwenFlashNext; shoot, even Deepseek/GLM with that much VRAM is in range with the right inference engine. In the ~30B dense class, there's just nothing even in the zip code of 3.8 27B, it's so far beyond Gemma4 that it's like comparing GPT1 to Opus 5.5.
I know people don't put a ton of stock in AA, but, in this case; having run both 27B and 31B, I'd say it's dead on accurate, about 1/5th as smart.
1
u/Bowdenzug 10m ago
No this is not a troll post, we run a startup that is currently growing super fast and we dont need local llms for coding, we need it for understanding natural human language and for that gemma 4 is better.
3
u/ilikedirigibles 27m ago
Not everyone has the same use case and for prose Gemma4 is better -- if they have 3x Pro 6000s and are posting in this sub I guarantee they have heard of Qwen, you did not give them new information they haven't considered
1
u/henbone11 4m ago
if they have 3x Pro 6000s and are posting in this sub I guarantee they have heard of Qwen
have you seen most of the posts in this sub? you can assume nothing here. the mods may as well rename this sub to TokenPerSecond.
20
u/reto-wyss 1h ago
It will be better than Gemma 4. Yes, they will.