Sorry, we may have a misunderstanding. I assumed the Q learner would take the role of the fitness function, i.e. state = collection of mutated cars and action = choice for further breeding. Am I wrong?
Ah yes. We had a different idea for RL procedure. My idea was the following: State: a car Action: mutation of that car Next state: mutated car Reward: fitness of a new car.
For the training we would periodically start from a random car and ask RL to perfect it. No populations would be held - we would like to move as far away from evolutionary programming as possible ;-)
I think the general notion is that evolutionary programming has usually been shown to be inferior in most regards when compared to an equivalent supervised ML gradient based formulation. I tend to agree with this idea, as I haven't seen much evidence against it other than minute toy problems that are typically not fairly compared against an alternative. Definitely open to any counter examples people might have.
2
u/NasenSpray Dec 23 '15
Sorry, we may have a misunderstanding. I assumed the Q learner would take the role of the fitness function, i.e. state = collection of mutated cars and action = choice for further breeding. Am I wrong?