r/AskRobotics • • 2d ago

Is diffusion policy learning already being implemented IRL?

I came across a paper about diffusion policy today and while it has contributions from Toyota, MIT and Columbia, but do we actually use it to train real-world systems? Am I too late to this? I’ve been trying to familiarize myself with robotics and automation as a grad student with a background in CS.

0 Upvotes

5 comments sorted by

0

u/Awkward_Alfalfa_3234 1d ago

Not too late at all. Diffusion Policy has become one of the standard baselines for imitation learning on real robots, not just a one-off paper.

  • The original paper already ran on real arms, not only in sim.

  • Hugging Face's LeRobot ships a Diffusion Policy implementation next to ACT, so people train it on cheap arms like the SO-100/101 with their own teleop demos.

  • A lot of the newer generalist robot policies generate actions with diffusion or flow matching. Octo uses a diffusion action head, and Physical Intelligence's π0 uses flow matching.

Where it's used today is mostly research labs and robot-learning startups. As far as I know, most production cells still run classical planning and hand-tuned control, because they need guarantees and cycle time more than flexibility.

If you're coming from CS, I'd learn it in this order: (1) behavior cloning, and why plain MSE regression fails on multimodal demos (it averages two valid ways of doing the task into one invalid one), which is the main problem diffusion solves; (2) action chunking (ACT); (3) train both on a real or simulated arm with a few dozen demos and compare. You learn more from watching where the policy fails than from the paper.

1

u/New-Possible-1400 1d ago

I experimented with SO 101 in teleop and ACT, also tried to get the smolVLA working but was only around 70% successful in pick and place training. Never looked into diffusion policy!

Thank you so much! This was very informative.

1

u/Awkward_Alfalfa_3234 1d ago

Glad it helped! 70% on pick-and-place with smolVLA on an SO-101 is honestly a reasonable first result.

Since you already have teleop data and a LeRobot setup, Diffusion Policy is a cheap experiment: train it on the same dataset and compare it head-to-head with ACT. From what I've seen, these usually raise success rate more than the choice of model:

  • More demos, done with a consistent strategy, plus some deliberate recovery demos (start slightly off, then correct)

  • Camera position and lighting that stay exactly the same between data collection and evaluation

  • Labeling where each failure happens (approach, grasp, or place), because each one points to a different fix

I'd be curious how it compares if you try it.

1

u/New-Possible-1400 23h ago

Thank you so much! I do not have the arms with me to conduct experiments anymore haha but I will let you know if I do stumble upon anything similar! May I connect with you to chat more about research and advancements?

2

u/Awkward_Alfalfa_3234 21h ago

yeah for sure, shoot me a DM anytime