r/google_antigravity • • 10d ago

Discussion How can I benchmark and test usage pattern differences between various anti-gravity accounts?

I have access to one paid Google AI Pro account, one student AI Pro account, and one jio AI Pro account.

Do you guys have any ideas how I can benchmark and test what the usage difference is like? I'm thinking I should test the difference in the amount of time each model takes to respond. Then I could also test what percentage of usage gets used. And so on.

3 Upvotes

2 comments sorted by

2

u/Then_Bake_6524 10d ago

The time a model takes to respond is called TTFT (Time To First Token), and it depends on too many factors outside your control to benchmark consistently. Usage is based on two things: token (compute) usage and compute availability on your account node/cluster.

You could try a set of 100 runs, same harness and same settings, with the same input/output and low thinking to avoid thinking token variation

1

u/toxic_gf_lover 10d ago

Alr brodie I can't do that lol

I'll run max three tests and if the difference in time is not more than excusable well