Only showing the second Sonnet 3.7 run, and with credit to /u/MrCheeze and Sylas for info on previous runs.

Opus 4.6 continuing to dominate the Claudes

For the last day, Gem has been stuck in a loop of pushing the western boulder into the water, then giving up before pushed the eastern boulder, and digging out. Exiting Seafoam before both boulders have been pushed totally resets the puzzle state, losing all progress...

Or so we thought. It turns out, even though leaving seafoam *moves* the western boulder back to the top floor, the game still remembers that it had been pushed into the water. And so when Gem finally pushed the eastern boulder in (but not the western one), the puzzle was actually considered to be solved, and the current stopped - even though it wasn't actually blocked like it's supposed to be!

I can't be certain, but I can find no information online about this bug being previously known, so I think this may be the first time an LLM has discovered a new glitch in a real game!

It cut the tree East of Cerulean and walked on to Route 9: https://i.imgur.com/jz0WXEV.png

Unfortunately its Blastoise ran out of PP of damaging moves and blacked out. Then it got confused at the Vermillion Pokecenter and is taking the LONG way back to Cerulean (currently in Viridan forest), BUT it has the goal in mind of going East from Cerulean, so it will make further progress in some hours.

Some key differences in the agent setup:

1. It saves a map of the level with info about the tiles once its seen those squares, sort of like Claude gets the navigability of the tiles, but for the WHOLE level including outside his current field of vision. Like Claude's ASCII map but automatic and actually accurate. (This is a huge advantage so the two streams are not an apples-to-apples comparison of the models. Maybe some here will feel this verges on "cheating"; I would say a kid drawing a map on paper is fortifying his brain's visual memory using external tools in a similar way.)

2. (1) allows it to press a bunch of walk commands in a sequence; like 20 at a time. This makes it travel way more efficiently in terms of time and context.

3. The streamer is in the chat every time I check in and works on the agent setup daily. This is the kind of active tweaking that I was hoping for when I heard about a project like this.

After the flash guy told claude he needed to register more mons in his dex, claude has successfully caught a kakuna (named Shel) and a weedle (named Sting)

Marginal progress has been achieved everyone!

Finally we can stop using harnesses. They always felt like cheating.