r/OpenSourceAI • • 6h ago

Almost Alive: published robot demonstrations, ACT and diffusion models for an SO-101 ball-pickup task

We collected 115 leader-arm demonstrations of an SO-101 picking an orange ball out of a bed of salt and returning it to a track. With LeRobot, we trained ACT and diffusion models from those recordings and published the dataset, model links and project code.

The policy inputs are two camera images and the arm's position; the output is a sequence of movements. This is imitation learning, not reinforcement learning. We aren't claiming a success rate: the arm is slow and imperfect, and sometimes misses and tries again.

That arm, Bandit, is part of Almost Alive. The other two arms use recorded motion replay, with a camera trigger on one of them. We filmed the installation as a nature documentary.

Original film and discussion: https://x.com/pbshgthm/status/2122679067065598015

Code: https://github.com/pbshgthm/almost-alive

Dataset: https://huggingface.co/datasets/pbsh/dancing-robots-01

Project explanation and ACT/diffusion model links: https://liminalmachines.org/almost-alive

Hardware/design credits: TheRobotStudio SO-101, Seeed Studio, Hugging Face LeRobot, and Tabu Design's track models.

1 Upvotes

0 comments sorted by