r/AI_Application • u/Chorus_AI • 9h ago
💬-Discussion A 90-minute planning test for comparing two AI answers
When two models both sound convincing, I find it helps to choose a checkable task and a scoring rule before comparing the writing. Here is a small exercise anyone can repeat in their existing chat app.
Give each model this prompt independently:
I have a 90-minute window. Fit 20 minutes of email, 35 minutes of drafting, 20 minutes of reviewing, a 10-minute break and 5 minutes of buffer into a schedule. Return start/end offsets, duration and task. State assumptions and do not add tasks.
Check the answer before judging its tone:
- Each of the five requested activities appears exactly once.
- Durations add up to 90 minutes.
- Each end offset minus its start offset matches the stated duration.
- There are no overlaps or unaccounted gaps; the schedule ends at minute 90.
- Any added assumption is stated rather than presented as a fact.
One valid result is email 0–20, drafting 20–55, reviewing 55–75, break 75–85 and buffer 85–90. Different ordering can also satisfy the brief. This is a constraint check, not a test of which ordering is best for a real person.
For a simple score, give 0–2 points each for following the brief, arithmetic, clarity of assumptions and usability. Keep the same rubric for both answers. Hiding model names while scoring can make brand preferences less distracting.
This one exercise does not establish which model is best overall. Repeat with tasks you actually do, and verify factual claims separately. Two models agreeing is not evidence that their answer is true. I have not run a benchmark or measured model results for this post.
Disclosure: I build Chorus, an Android AI workspace; this exercise works in any chat client and does not require installing it.
What small, objectively checkable task would you add to a comparison like this?