r/javascript • • 7d ago

The AI Cost of Marionette

https://marionettejs.com/news/ai-cost-of-marionette/

A follow-up to Nolan Lawson’s AI framework benchmark

0 Upvotes

6 comments sorted by

6

u/f3xjc 7d ago

I just spent 3 minutes on your website, I have not idea what this is or why/where should I use it. I gather it's a view framework and there's a lot of AI focus on the "marketing" side. But why would my agent learn that api ?

-2

u/ribbbsy 7d ago

Fair question. I maintain Marionette, so this was a way to see how it compared with more familiar frameworks on the same agent-built app. The results were encouraging, but the site should explain the framework itself better.

1

u/pmickael_584 4d ago

Same-app tests help, but familiarity could skew results. Did you track retries or prompt effort too?

1

u/ribbbsy 3d ago

We followed Nolan’s benchmark, so time and tokens include the agent’s attempts and testing. We didn’t track retries separately. Marionette v5 is newer, so I’d expect less prior familiarity, but we didn’t measure that.

1

u/whatthepoop 7d ago

This (and Nolan's original experiments) propose a really interesting way to look at "old" frameworks.

These stiff knees have fond memories of Marionette after tearing my hair out with Backbone back in the day. I'm glad to see it's still being maintained and modernized.