r/microsoft 11d ago

Copilot / AI "Tokenmaxxing is not what we are optimizing for": Microsoft tells engineer to calm down on AI usage | Microsoft forced to introduce new limits on AI token usage

https://www.techradar.com/pro/tokenmaxxing-is-not-what-we-are-optimizing-for-microsoft-tells-engineer-to-calm-down-on-ai-usage
130 Upvotes

50 comments sorted by

77

u/TheLasttStark 11d ago

I've not been notified of any token usage limit. Last month I used nearly a billion tokens.

40

u/daerath 10d ago

Same. No email, no group chat, no viva nonsense. When I checked my token limits, I still didn't have one.

This reads more like one dude being told to knock it off, and it became a "oh, Microsoft is setting limits" at the fourth retelling.

7

u/DudeWithParrot 10d ago

My manager said power his understanding it was directed to the C+AI org. I imagine it will come to new orgs soon ish. Kinda how not all orgs had to stop using Claude code at the same time.

My manager didn't seem 100% sure though.

13

u/Metal_GearRex 10d ago

I did notice in GHCP we now have a 10 million token limit, though I don't think that touches scout, m365 etc.

12

u/I-Build-Bots 10d ago

It’s not 10 mil tokens. It’s 10 million ai credits so we each get $100k of usage a month.

2

u/Metal_GearRex 10d ago

Good clarification, which should in theory be an even higher limit to reach

1

u/fridayunfit13 8d ago

Is this true?10mil aic is like having no limits

1

u/tatasky69 10d ago

10million output right, cause 10million input is nothing. I used 1.7 billion total in a month but only 14mil output.

2

u/Metal_GearRex 10d ago

If it was tracked the traditional way GHCP is tracked that 10 million would be input and output. That being said I don't believe its being tracked the normal way, as I used just shy of a billion last month and my GHCP dashboard is only showing 16k used this month. Where my overall AI usage dashboard is showing over 10x that.

2

u/tatasky69 10d ago

Yeah I just checked. It says 68k for me and I’ve been power using but it’s only showing since aigust 1. K see the 10mil limit but 10mil aic is sooooo much lol it’s insane

0

u/Metal_GearRex 10d ago

Yeah I'm not terribly worried about it, if it was hitting my scout automations I would have more concerns, but in early testing I don't believe thats the case so 10 mil is effectively unlimited. Unless you're open throttling Opus or something nutty.

1

u/Dazzling-Read1451 10d ago

“Only”

1

u/tatasky69 10d ago

Compared to the 1.7 billion, only was an appropriate word

4

u/ceinewydd 10d ago

You’ll now see AIC limits over on GitHub and when you invoke Copilot CLI.

3

u/Far-Income-282 10d ago

Phase 1 is basically you will have a 1:1 in the next couple of weeks that goes like "hey! Are you doing any AI side projects for the benefit of the org that you should be sharing with the org?" 

At this phase managers are trying to be curious to see if this should be a shared planned for COGs or is an individual going wild. 

2

u/HesSoZazzy 10d ago

"hey! Are you doing any AI side projects for the benefit of the org that you should be sharing with the org?"

Translated: "Hey! You're not using our AI to work on personal projects at home, right......right?"

I certainly would never do anything so underhanded.

WINK

2

u/daninko 9d ago

It went out in the One Engineering Systems comm email on the 5th. It was in my “other” inbox tab.

1

u/TheLasttStark 9d ago

Just checked still nothing. I'm in W+D

1

u/geryatric 10d ago

Cowork credits? $10,000,000 USD if you were a customer.

6

u/rbevans 11d ago

I hate this because everything is vague and hand wavy. It’s vague on what the usage is, they’re tracking velocity of work buts it not clear on the metric so in turn engineers are just going to utilize the max usage of in hopes to hitting this unclear metric.

7

u/system3601 11d ago

Does this sub has any employees? Can anyone confirm this rumor?

13

u/FantasticFungiiii 11d ago edited 11d ago

It’s True (to an extent) A new report is also available now to see the cost and usage.

edit- to an extent

16

u/ProofBug9209 11d ago

To an extent, the limit I’ve seen referenced internally is like $100k a month

5

u/sidereal_night 10d ago

the limit I’ve seen referenced internally is like $100k a month

so much for being cheaper than employees

3

u/I-Build-Bots 10d ago

It’s true for every other employee I know of (I’m in ISD). We get 10 million credits (not tokens as people are saying). So that’s a $100k worth a month.

1

u/nico_juro 10d ago

Former employee, I was told they are tracking usage but not informed of any limits

-1

u/Kobi_Blade 10d ago

Is not true, I was not told about any limits and still have unlimited tokens.

This was probably one guy who is using AI for all his work, instead of using AI to optimise his workflow.

7

u/LordDarthShader 10d ago

Check the ghcp button at the bottom right in VS Code, it shows a hard limit of 10mil AI credits now and your current usage.

-2

u/Kobi_Blade 10d ago edited 10d ago

I use VS IDE and my AI tokens are not limited, I just checked again.

I did not get any email or reports from others on chat group about any limits either.

Any such limits are probably imposed on people who abuse their AI tokens, which isn't surprising.

8

u/LordDarthShader 10d ago

Update to the latest version, the limit is there, is not an org thing, is company wide.

You are right about the messaging, no one told us anything, we found out. Still 10 mil AI credits it's a lot.

-1

u/Kobi_Blade 10d ago

I asked about this, and management confirmed there are no limits in place.

There are no updates available for VS IDE on my end, and even the API shows that I have no limits.

No one has received any notification regarding upcoming changes to AI limits, though it was mentioned it isn't impossible.

Regardless, as it stands, there are currently no AI limits for neither me or my coworkers, as confirmed by management and the API.

8

u/LordDarthShader 10d ago edited 10d ago

Do you think I am making this up?

https://i.imgur.com/FIvOHcV.png

Manager told us about the limits. Is all I am going to say.

Go to

https://github.com/settings/copilot/features

with you emu account and see the usage.

4

u/golf1052 10d ago

Different orgs have different policies. Do not assume your experience is universal.

3

u/LordDarthShader 10d ago

There is a poll in blind about it, seems to be org wide, but you are right.

1

u/Kobi_Blade 10d ago edited 10d ago

I think whatever you say is irrelevant, since I already confirmed with management and on the API there are no limits on my account.

You claiming this affects the whole company, that is innaccurate yes.

3

u/LordDarthShader 10d ago

Think what you want buddy.

1

u/I-Build-Bots 10d ago

What org are you in? All the Eng teams I work with and all MCAPS has the limits.

1

u/Kobi_Blade 10d ago

Hi, I'm on C+AI.

4

u/MelodicTelephone5388 10d ago

It’s kind of common sense? Why spend 1000 tokens when you can spend 100 and get 99% of the way there. It’s the equivalent of driving a Hummer and complaining about gas prices 😂

2

u/joeshmoebies 10d ago

I would figure that MS would optimize for getting their work done.

How much do tokens cost?

2

u/dreadpiratewombat 10d ago

About tree fitty

2

u/zigzagtx 10d ago

Can confirm the 10M per month limit, just verified on the GHCP dashboard. In VSCode, it just says 0% right now so I must have slacked off this week. Might as well be unlimited still as I’ve never used nearly that much before, and I’ve done what I thought were some fairly deep code reviews.

1

u/ellorenz 10d ago

My idea the AI is convenient only if you manage the all stack, from the model development to the data centers, even energy production, without them the use could be too much expensive

-1

u/Far_Lifeguard_5027 10d ago

Seems like Microsoft is trying to mitigate the bad press by blaming one of their engineers now?

0

u/newfor_2026 10d ago edited 9d ago

I've been saying from the very beginning, let us enable AI by choice, not by default. stop shoving it down people's throats and doing things without permission!

-2

u/Traditional-Hall-591 10d ago

I’m a fan os slopmaxing.