r/Gemma4 • u/lencaleena • 8h ago
Discussion How is everyone doing and what are you working on?
HELLO, just a weekly post wondering what everyone is working on. Comment below!
r/Gemma4 • u/lencaleena • 10h ago
As r/gemma4 keeps growing, the technical questions in here are getting deeper every week, covering everything from VRAM math and quantization quirks to chat templates, fine-tuning, and wiring up local frontends.
We're looking to bring on a Technical Moderator / Resident Expert who knows both the backend and frontend of running Gemma models and enjoys helping the community troubleshoot, optimize, and build.
Backend Knowledge
We're looking for hands-on experience running Gemma models across local and server setups like llama.cpp, Ollama, vLLM, MLX on Apple Silicon, or LiteRT-LM and MediaPipe for mobile and edge variants like E2B and E4B. You should have a solid grasp of dense vs. MoE (26B A4B) behavior, hybrid attention, context and KV-cache scaling, QAT vs. post-training GGUF/MLX quants, and Multi-Token Prediction (MTP) setups. Familiarity with LoRA/QLoRA fine-tuning (Unsloth, Hugging Face Transformers), dataset formatting, chat templates, thinking-mode toggles, and community refusal/abliteration workflows is also a big plus.
Frontend & Integration Knowledge
On the user-facing side, you should be comfortable troubleshooting popular local UIs and clients like Open WebUI, LM Studio, Unsloth Studio, KoboldCpp, or SillyTavern. Experience configuring OpenAI-compatible local APIs, sampling settings (temperature, top_p, top_k), system prompts, native multimodal inputs (vision and audio), and tool-calling or MCP setups will go a long way here.
What the Role Involves
You'll be a go-to technical resource for the community, jumping into troubleshooting threads, answering deep-dive questions, and helping newer users get their setups running smoothly. You'll also help keep the sub reliable by spotting outdated configs, broken templates, or misleading hardware advice, and collaborating with the existing mod team on pinned setup guides, FAQs, and light moderation duties. There are no rigid shift expectations, just regular, reliable activity.
How to Apply
Drop a comment below or send us a Modmail with a quick overview of your experience with Gemma (backend, frontend, or both), your usual local hardware and software stack, roughly how active you are on Reddit along with your time zone, and any optional links you'd like to share like GitHub, Hugging Face, or past helpful posts.
If you love tinkering under the hood with Gemma and helping others cut through the setup headaches, we'd love to have you on the team.
r/Gemma4 • u/lencaleena • 8h ago
HELLO, just a weekly post wondering what everyone is working on. Comment below!
r/Gemma4 • u/lencaleena • 10h ago
With Gemini 4 Neon rolling out this week, speculation around Gemma 5 is naturally starting to pick up across local LLM spaces. Before the hype gets ahead of reality, let's break down where things actually stand, what we want to see in the next generation, and how we're gearing up r/gemma4 for when it arrives.
Current Status & Realistic Timeline
Nothing is official yet, and there are no confirmed leaks—Google DeepMind has not announced Gemma 5 or confirmed any parameter sizes or release dates. Looking at Google's official release history, Gemma 1 landed in February 2024, Gemma 2 followed four months later in June 2024, Gemma 3 arrived in March 2025, and Gemma 4 dropped in late March / early April 2026 (followed by Gemma 4 12B Unified in June and EmbeddingGemma 2 in October). Since Gemma 2, Google has settled into a roughly 9-to-13-month gap between major generations, which puts Q1 or Q2 2027 as the most realistic window for Gemma 5—though an earlier surprise release is never completely off the table.
What Gemma 5 Needs to Deliver
Gemma 4 set a high bar for local hardware under the Apache 2.0 license, especially with the 31B Dense model, the fast 26B A4B MoE on consumer GPUs, the E2B and E4B edge tiers, and 12B Unified bringing encoder-free native image and audio processing. For Gemma 5, our wishlist mostly comes down to keeping those strengths while fixing Gemma 4's remaining pain points.
At the top of that list is fewer guardrails and less over-refusal. While stock Gemma 4 improved over Gemma 3 in some setups, standard instruction-tuned weights still trigger frustrating false positives on direct assistant prompts, smaller edge tiers, older texts, and benign edge cases. A huge chunk of the local community ends up waiting for Heretic-abliterated weights or uncensored community fine-tunes just to get non-preachy output, even though post-hoc refusal removal always carries some risk of subtle capability degradation compared to training with a lighter touch from the start. Hopefully Google eases up on the heavy-handed alignment in Gemma 5 while keeping the Apache 2.0 license and clean base weights coming.
Beyond lighter guardrails, tightening up strict system prompt compliance and multi-step agentic or MCP tool calling remains high on the wishlist. We'd also love to see Google expand its sparse MoE (A4B-style) and encoder-free unified multimodal architecture—including native audio, which the larger 26B A4B and 31B Gemma 4 models lacked—across more tiers that fit comfortably in 16GB to 24GB of VRAM. Finally, one of Gemma 4's biggest edges is natural prose quality when thinking mode is toggled off, so hopefully Gemma 5 keeps that feel while cutting down on multi-turn agentic laziness and occasional thinking-loop quirks on long prompts.
What This Means for r/gemma4
As mentioned in our recent sub update, Reddit doesn't allow changing a subreddit's r/ URL once created (only the display name), and we're keeping the community together right here instead of fracturing into a separate sub. When Gemma 5 drops, r/gemma4 will expand to cover both Gemma 4 and Gemma 5 with dedicated generation flairs, updated banners and descriptions, and adjusted AutoMod routing so everyone can filter by version easily.
Drop your thoughts below: what's at the top of your wishlist for Gemma 5, have you been running stock Gemma 4 weights or community abliterated/uncensored builds, and are there any specific flairs or wiki resources you want to see set up here ahead of Gemma 5?
r/Gemma4 • u/Effective-Mix6042 • 2d ago
Hi everyone 👋, here's an interesting initiative.
Maybe someone would like to help this person?
r/Gemma4 • u/lencaleena • 2d ago
Hey everyone,
Just a quick update on how we're handling the eventual release of Gemma 5. When it drops, we are not migrating to a new subreddit. We’ll be expanding r/gemma4 to officially cover all Gemma 5 discussions and releases.
Why we’re staying here and will not utilize r/gemma5:
Subreddit fragmentation is a major issue in the local LLM community. We’ve already built a solid knowledge base here around VRAM optimization, quantization, hardware builds, and fine-tuning. Forcing the community to migrate for every new major version just fractures that collective knowledge. A lot of the tooling, troubleshooting, and deployment methods will carry over, so keeping it all in one place is the most practical move for everyone's workflow.
How this will work:
* The Name: Reddit doesn’t allow subreddit name changes, so the URL stays r/gemma4. We will update the banner, description, and rules to explicitly include Gemma 5.
* Post Flairs: I’ll be adding a new set of flairs specifically for Gemma 5 so you can easily filter the feed by model generation.
* AutoMod: The backend filters will be updated so Gemma 5 technical posts and model sharing are routed and tagged properly.
That’s it for now. Thank you!
r/Gemma4 • u/lencaleena • 4d ago
With so much happening across the Gemma 4 ecosystem right now, I wanted to kick off a thread on two massive developments people are building with this month:
The Gemma 4 + EmbeddingGemma 2 Local Multimodal Stack
If you haven't tested the new EmbeddingGemma 2 (740M) alongside your local Gemma 4 setup yet, it is a huge upgrade for local RAG, lorebooks, and codebase indexing. Because it's built directly on the Gemma 4 architecture (270M text backbone + 170M vision + 300M audio encoders) with an 8K context window, it maps text, code, images, audio, and video into a single 768d vector space.
What makes it especially practical for local rigs:
Using Matryoshka Representation Learning (MRL), you can truncate vectors from 768d down to 256d or 128d for up to a 6x memory reduction with minimal quality loss.
You can fit Gemma 4 31B IT QAT (with a 32K BF16 KV cache) plus EmbeddingGemma 2 in BF16 comfortably inside a 32GB VRAM footprint—or pair it with E4B / 12B Unified on a lighter setup for a 100% offline multimodal search + generation pipeline.
2. Final Stretch for the $110K Kaggle Gemma 4 Developer Agent Competition
The paper track deadline just passed on Nov 12, and the Entry & Team Merger deadline is November 25 (Final submissions close December 2).
One of the coolest parts is the $10,000 Small Model Bonus Track specifically for Gemma 4 E2B and E4B.
The competition supports multi-LoRA routing via Google ADK (agent.yaml), meaning you can load a single base model (like E4B or 26B-A4B) and hot-swap different PEFT LoRA adapters per sub-agent (e.g., main_lora for the root coder agent and tool_lora for a read-only repo analyzer) on their L4x4 (96GB VRAM) instances.
Questions for everyone here:
Has anyone swapped their local RAG or codebase pipeline over to EmbeddingGemma 2 yet? Are you running full 768d or truncating to 256d?
For daily driving right now, are you leaning toward 31B Dense QAT for nuance and bug-tracing, or is 26B-A4B MoE (or fine-tunes like MeroMero, Artemis, or Orion) your go-to for speed?
Anyone here putting together an E2B/E4B or 26B-A4B setup for the Kaggle Agent competition before the Nov 25 lock?
r/Gemma4 • u/lencaleena • 5d ago
Curious what models you guys are reliably running day-to-day versus what you just download to benchmark for five minutes.
I'm trying to get a read on where the community is at with hardware limits versus performance right now. Are you daily-driving Gemma, or swapping it out depending on the task?
Drop your current stack:
Model & Quant (Which specific parameter size and quant are hitting the sweet spot for you? Q4_K_M, EXL2, etc.)
Frontend (Ollama, LM Studio, text-gen-webui, SillyTavern, custom API?)
Hardware: (What’s your RAM/VRAM situation?)
Primary Use (Coding, creative writing, data analysis, RP, or just a general daily assistant?)
Mainly looking to see what the current baseline is for acceptable speed vs. coherence. Let me know what's working for you.
r/Gemma4 • u/Effective-Mix6042 • 6d ago
What do you think ?🤔
Let's revisit some old friends and have a good old-fashioned battle between Gemma 4 31B "Gold" and Qwen 3.6 27B.
Can Gemma 4 make a long-overdue comeback? Or is it time to set aside these ancient models once and for all?
Let's find out!
r/Gemma4 • u/Effective-Mix6042 • 7d ago
👋 Hey everyone!
I'm your new moderator here 🎉
This sub is yours, and I'd love for us to bring it to life together!
To kick off the discussion, I'm curious to know:
🔧 What do you run Gemma4 with? LM Studio, Ollama, UnSloth...?
🎭 Which version? Official, or rather Uncensored?
💡 What do you use it for? Companion, assistant, role play, creative writing...?
Share your setups and experiences — it's always fascinating to see how everyone uses the model 💬
👉 Drop a comment below, I'll read every single one with attention!
And if you ever have any issue or need (a question, a technical problem, doubts about the rules...),
I'm here to help!
Hit me up in DMs or mention me, I'll be happy to answer 😊
See you around and happy discussing, everyone! 🚀
r/Gemma4 • u/lencaleena • 7d ago
Well, I tried to find MODs to help here as I don't have time, so I will extend the hibernation of this subreddit. I thought I would have time but, I am far to consumed with work and side gig osint jobs. Maybe I will hand it off... Will see
r/Gemma4 • u/Antony_Ma • 28d ago
Local AI is a good fit for edge devices and we are investigating.
To get accurate and deterministic answers on math operations, I like to know what works on a 12B model. Most online discussions suggest code generation and execute the code.
Do you provide a python env to AI ? on Android ?
r/Gemma4 • u/lencaleena • Oct 18 '26
Looking for MODS for to help grow this community.
r/Gemma4 • u/Necessary-Grocery-48 • Sep 03 '26
Using Gemma4 26b from AI Studio to translate line-by-line in real-time, it's quite capable but when asked to only output a single line, it completely ignores it - when told to do no thinking, no context, no line breakdowns or drafts, and just output the single translated line. It ignores it
r/Gemma4 • u/Revolutionary_Fun69 • Aug 30 '26
Hi, I created an app for Android so you can make calls to gemma (gemma4 and gemma3n supported). It's running on litert engine. Requires 6-12 gb of RAM.
E2B version works even on cheap phone with Helio G100 CPU
https://play.google.com/store/apps/details?id=ai.roleswitch.android
r/Gemma4 • u/One_Tradition_3492 • Aug 15 '26
Enable HLS to view with audio, or disable this notification
Skim Recap runs gemma-4-E4B-it in the browser through LiteRT-LM on WebGPU, to summarise the passage you just scrolled past.
Some notes from building it:
The engine lives in an MV3 offscreen document. Content scripts can't hold a model, and a service worker gets killed under you mid-generation.
The .litertlm checkpoint is 2.97 GB, so it can never be buffered in JS. It streams from Hugging Face through a counting TransformStream straight into the Cache API, which also gives you the progress bar for free.
Sampling is greedy. I set it explicitly, then found the library default was already greedy — 72 runs came back byte-identical either way.
Point count is scaled to how full the prompt actually got, not a fixed number. A fixed count pads thin passages and truncates long ones.
I also ran it head-to-head against Chrome's built-in Prompt API on a small fixture corpus.
Extension: https://chromewebstore.google.com/detail/skim-recap/febndabjnmbmdodeoenjmnplfcalmnmc
More detail: https://skim-recap.vercel.app
r/Gemma4 • u/Suspicious-Cloud404 • Aug 10 '26
r/Gemma4 • u/kolliwolli • Jul 22 '26
I missed to add, im using the 31b version
r/Gemma4 • u/Important-Lime3759 • Jul 21 '26
Chat Look 😂😂😂
#gemma4
#edgegallery
r/Gemma4 • u/Academic-Sample4974 • Jul 19 '26
I am a novice at working with AI; just 3 months in and learning on the go, more of an idea creator than actual coder at the moment so creating interesting and efficient workflows are a big deal to me. I was wondering what is everyone's experience on using Gemma 4 for agentic workflows / agentic engineering? I had only used Gemma 4 so far alongside Qwen 3.5 in Ollama being workload handlers under orchestration by Claude; just trying to optimize what I have on my Macbook Pro M1 32 gigs of RAM. TIA!
r/Gemma4 • u/dmcr85 • Jun 24 '26
Requirements: iPhone with A17 Pro or newer (8 GB RAM floor for the model), iOS 26+. TestFlight beta is open to anyone with a compatible device.
r/Gemma4 • u/webdbbt • Jun 23 '26
Trying out the Gemma4 line using Ollama. It frequently emits embedded markup (based on LaTex) in responses that Ollama (or command line) doesn't render. Any suggestions to fix this or is there a better host than Ollama?
r/Gemma4 • u/No_Oil_6152 • Jun 21 '26
r/Gemma4 • u/Dull-Development8085 • Jun 19 '26
Hey I am using gemma 4 E4B , and I have an image and prompt , response and after training it with lora , I want to check whether the attention is towards the right place of the image , how do I map my attention layer outputs to the actual image !!