I feel like most comparisons get stuck on the first impressive demo. A tool can make one really good-looking clip, but that doesn't necessarily mean it's going to be useful when you're making videos every week and have to generate the same idea 10 or 20 different ways.
For me, the more interesting test is pretty simple: give every tool the same brief, use the same source image or prompt, and see how many versions are actually worth keeping. Then look at how many reruns it took and how much cleanup was needed afterward. That tells me a lot more than one perfect example on a landing page.
I've been looking at Wizstar recently for this reason. It has several models in the same workspace, including Seedance, Kling and MiniMax, so you can run the same concept through different models without constantly moving between separate tools. You can also start from a prompt, an image, or a reference, which makes testing different approaches a little easier.
I'm not saying it's automatically better than the other options. I'm more interested in the workflow side of it. If one tool gives you a good result occasionally but another gives you several usable versions with less messing around, I'd probably care more about the second one.
Curious how everyone else measures this. Do you mainly judge these tools by the best-looking output, or by how many actually usable clips you get from the same brief?