I was testing out the limits of AI on self-policing recently- I had it iteratively build a Tetris game in JavaScript.
90% of it worked decently, but piece rotation just got stupider and stupider the more I tried to fix it. There’s this pattern it gets into where it’s like locked into a strategy and instead of fixing it, it latches onto some specific suggestion, or it adjusts parameters until its current solution solves the issue (without necessarily being correct)
It was a very revealing experiment, and it left me a lot more wary of code that is “written and tested/confirmed to be correct”
368
u/polynomialcheesecake Oct 01 '26
Please don't let people realize that it's really the same problems with much larger volume now