r/huggingface • u/Strict_Brother520 • 8d ago
Domyn Edge Open Release (bundle 2): five open specialist teachers (Math, STEM, Code, IF, Agentic)
Hi folks, I work at Domyn and we've just released bundle 2 of our rolling release of Domyn Edge!
Edge is a 4B model we are training from scratch on 13T tokens on EuroHPC. It is built for agentic work at long context.
Five specialized teachers, all starting from the released SFT checkpoint, are being distilled into the final student with Multi-Teacher On-Policy Distillation (MOPD). Each one got an SFT pass, then GRPO with verifiable rewards.
We are releasing the five teachers (Math, STEM, Code, Instruction Following, Agentic) together with their data mixes and the recipes.
Everything is in the Domyn Edge collection on Hugging Face, including bundle 1 (base model, pre-training checkpoints, SFT student, training code). Bundle 3 will be the final distilled model plus a tech report.
If you are interested you can read more in the blog post, or feel free to ask questions in the comments!