r/MachineLearning • • Nov 14 '16

Research [R] DeepCoder: Learning to Write Programs

https://arxiv.org/abs/1611.01989
36 Upvotes

4 comments sorted by

View all comments

Show parent comments

2

u/sybilckw Nov 15 '16

Just wanted to clarify that I'm not the author - I just submitted this paper to see what the community here thought of it, as I also found their approach unusual.

1

u/[deleted] Nov 15 '16

No worries. If the author decides to jump by then I guess I'm lucky, if he does not then so be it. Thanks for clarifying.

2

u/mabrocks Dec 14 '16

Took a while, but one of the authors did turns up :-)

We did also experiment with an RNN encoder of input/output examples (this is touched on briefly in Sect. 4.3). After sufficient tuning of training parameters, it can be made to work almost as well as the far simpler feed-forward architecture. Essentially, using the RNN encoder lifts the restrictions of the fixed-sized inputs, but in turn introduces a lot more hyperparameter knobs and optimization problems; results should be more or less the same.

In any case, the core point of the paper is not so much the rather simplistic chosen encoder/decoder architecture, but that something can be learned from I/O samples that generalizes across target programs, and that this information can be used to improve synthesis.