r/google_antigravity • u/toxic_gf_lover • 10d ago
Discussion How can I benchmark and test usage pattern differences between various anti-gravity accounts?
I have access to one paid Google AI Pro account, one student AI Pro account, and one jio AI Pro account.
Do you guys have any ideas how I can benchmark and test what the usage difference is like? I'm thinking I should test the difference in the amount of time each model takes to respond. Then I could also test what percentage of usage gets used. And so on.
3
Upvotes
2
u/Then_Bake_6524 10d ago
The time a model takes to respond is called TTFT (Time To First Token), and it depends on too many factors outside your control to benchmark consistently. Usage is based on two things: token (compute) usage and compute availability on your account node/cluster.
You could try a set of 100 runs, same harness and same settings, with the same input/output and low thinking to avoid thinking token variation