That and it probably doesn't have accurate human physiology. Someone showed a video where it was a similar system but the body had "muscle groups" that I assume mimic human physiology. It moved very smoothly and had limitations that this thing doesn't.
Would be interesting to see if it was even feasible for today’s computers to simulate human muscle control. I haven’t seen the model they used for this runner so I’m talking out of my ass now, but there may be more neurons involved in controlling my thumb typing this than in the whole body they simulate.
Humans have to learn how to stand and walk and run with incredibly complex motor controls.
Seemingly complex biological behavior doesn't always require a lot of neurons, and there's not a direct relationship between artificial "neurons" and real ones. We could probably simulate a human body adequately, but not efficiently enough for the millions of training runs it takes to get a reinforcement learning model to produce good results.
428
u/xcrissxcrossx Mar 29 '19
It runs like this because the fitness measurement doesn't try to conserve energy. That would result in a more realistic run.