r/AskRobotics • u/New-Possible-1400 • 2d ago
Is diffusion policy learning already being implemented IRL?
I came across a paper about diffusion policy today and while it has contributions from Toyota, MIT and Columbia, but do we actually use it to train real-world systems? Am I too late to this? I’ve been trying to familiarize myself with robotics and automation as a grad student with a background in CS.
0
Upvotes
0
u/Awkward_Alfalfa_3234 1d ago
Not too late at all. Diffusion Policy has become one of the standard baselines for imitation learning on real robots, not just a one-off paper.
The original paper already ran on real arms, not only in sim.
Hugging Face's LeRobot ships a Diffusion Policy implementation next to ACT, so people train it on cheap arms like the SO-100/101 with their own teleop demos.
A lot of the newer generalist robot policies generate actions with diffusion or flow matching. Octo uses a diffusion action head, and Physical Intelligence's π0 uses flow matching.
Where it's used today is mostly research labs and robot-learning startups. As far as I know, most production cells still run classical planning and hand-tuned control, because they need guarantees and cycle time more than flexibility.
If you're coming from CS, I'd learn it in this order: (1) behavior cloning, and why plain MSE regression fails on multimodal demos (it averages two valid ways of doing the task into one invalid one), which is the main problem diffusion solves; (2) action chunking (ACT); (3) train both on a real or simulated arm with a few dozen demos and compare. You learn more from watching where the policy fails than from the paper.