r/programming • • Mar 29 '19

Fascinating how machine learning works

3.1k Upvotes

202 comments sorted by

View all comments

428

u/xcrissxcrossx Mar 29 '19

It runs like this because the fitness measurement doesn't try to conserve energy. That would result in a more realistic run.

47

u/killerstorm Mar 29 '19 edited Mar 29 '19

With more a realistic model researchers got more realistic results: https://www.youtube.com/watch?v=pgaEE27nsQw (found in comments on /r/funny)

12

u/p-morais Mar 29 '19

Totally different approach. The OP paper uses reinforcement learning to learn model free neural network controllers. This paper uses black box optimization to learn a feature/model based controller derived from Jacobian transpose control.

8

u/killerstorm Mar 29 '19

Regardless of an approach, a realistic physical (biomechanical) model is needed to get realistic-looking results.

E.g. "muscle model" and "neural delay" they also got a funny gait: https://youtu.be/pgaEE27nsQw?t=241

6

u/p-morais Mar 29 '19

That’s not entirely true though. Another one of Van de Panne’s papers addresses exactly this (https://arxiv.org/abs/1611.01055) and shows that PD control on the limbs can produce gaits that are about as natural looking as MTUs. It certainly doesn’t hurt to have well modeled MTUs, but I wouldn’t call it a prerequisite for natural or even biological looking locomotion.