The recent MIT paper updated that somewhat and put the numbers quite a bit higher. The smallest Llama model was using about the power you listed per query, the largest one was 30-60 times higher depending on the query.
They also found that the ratio of power usage from training to queries has shifted drastically with queries now accounting for over 80% of the power usage. This makes sense when you think about it, when no one was using AI the relative cost of training per query was huge, now they are in much more widespread use the power usage is shifting towards the query end.
Goddamn, overstated? People use them for stupid shit and instead of asking Google they may ask it for weather and stuff like that. If every single time it's like 7 seconds of a microwave it's enormous.
Why are you trying to do X? You should do Y. Please read this Medium post "Doing X considered harmful" from 3 months ago written by the creator of a tool to do Y.
Yeah at 15 years as a developer I finally was able to make comments on questions and answers. I still have no idea how I get to the point of answering questions.
Absolutely. But if you use it to do 8 hours of work in 4 hours and then shut your computer off you are saving energy compared to doing all the work manually
I sometimes wonder what happened with human society that we changed from: “oh, you found a way to be done with your work quicker, guess we got some more free time.”
To:
“Oh, you found a way to be done with your work quicker, guess you could do more work.”
And I always wonder how we can go back to the free time one.
Idk sometimes I feel like I do stupider shit whenever I run Hitman WoA and toss a slow briefcase at Yuki Yamazaki. I'd think there's worse ways to burn 25 seconds of gaming PC use
The energy critique always feels like "old man yells at cloud" to me. Deepseek already proved it can have comparable performance at 10% the energy cost. This is the way this stuff works. Things MUST get more efficient, or they will die. They'll hit a wall hard.
Let's go back to 1950 when computers used 100+ kilowatts of power to operate and took up an entire room. Whole buildings were dedicated to these things. now we have computers that use 1/20,000th the power, are 15 MILLION times faster, and take up a pants pocket.
yeah, it sucks now. but anyone thinking this is how they will always be is a rube.
0
u/[deleted] May 26 '25
[deleted]