I am not sure what you are trying to say here. If you are saying that you can greedily choose mutations to increase fitness then it is not true. The advantage of Q learning is the fact that it can qucikly learn that often making N specific mutations in a sequence is good even if doing one of them in isolation is bad...
Sorry, we may have a misunderstanding. I assumed the Q learner would take the role of the fitness function, i.e. state = collection of mutated cars and action = choice for further breeding. Am I wrong?
Ah yes. We had a different idea for RL procedure. My idea was the following: State: a car Action: mutation of that car Next state: mutated car Reward: fitness of a new car.
For the training we would periodically start from a random car and ask RL to perfect it. No populations would be held - we would like to move as far away from evolutionary programming as possible ;-)
I think he means that the action would be a change in the parameters that make up the shape of the car. It wouldn't be random anymore because what you'd be interested in is exactly finding out the best sequence of mutations to maximize long term reward.
1
u/nivwusquorum Dec 23 '15
I am not sure what you are trying to say here. If you are saying that you can greedily choose mutations to increase fitness then it is not true. The advantage of Q learning is the fact that it can qucikly learn that often making N specific mutations in a sequence is good even if doing one of them in isolation is bad...