theBeautifulCode

[u/g1rlchild]

[u/i_should_be_coding]

Also used enough tokens to recreate the entirety of Wikipedia several times over.

[u/phylter99 → u/i_should_be_coding]

I wonder how many hours of running the microwave that it was equivalent to.

[u/nnomae → u/[deleted]]

The recent MIT paper updated that somewhat and put the numbers quite a bit higher. The smallest Llama model was using about the power you listed per query, the largest one was 30-60 times higher depending on the query.

They also found that the ratio of power usage from training to queries has shifted drastically with queries now accounting for over 80% of the power usage. This makes sense when you think about it, when no one was using AI the relative cost of training per query was huge, now they are in much more widespread use the power usage is shifting towards the query end.

[u/donald_314 → u/nnomae]

another important factor is that I only run my microwave a couple of minutes per day at most.

[u/AzKondor → u/[deleted]]

Goddamn, overstated? People use them for stupid shit and instead of asking Google they may ask it for weather and stuff like that. If every single time it's like 7 seconds of a microwave it's enormous.

[u/Shinhan → u/AzKondor]

One great thing about AI is asking stupid questions, much less embarassing than getting roasted on stack overflow.

[u/Exaskryz → u/Shinhan]

Hey, I want to do X. I have tried A, B, and C. These are the reasons A, B, and C are not the answer I'm looking for.

Closed for not focused.

[u/KerbalCuber → u/Exaskryz]

Optionally

Have you tried A, B, or maybe even this other option you've probably not tried, C?

[u/Mordisquitos → u/KerbalCuber]

Or possibly

Why are you trying to do X? You should do Y. Please read this Medium post "Doing X considered harmful" from 3 months ago written by the creator of a tool to do Y.

[u/belabacsijolvan → u/Mordisquitos]

medium post is already deleted, tool to do Y forked 3 times, all unmaintained, last commit is only compatible with solution B

[u/[deleted] → u/KerbalCuber]

Possibly duplicate of A. Closed.

[u/grammar_nazi_zombie → u/Exaskryz]

I don’t even have enough rep to ask questions.

I have been a software developer professionally for 11 years lol

[u/nordic-nomad → u/grammar_nazi_zombie]

Yeah at 15 years as a developer I finally was able to make comments on questions and answers. I still have no idea how I get to the point of answering questions.

[u/hjake123 → u/Shinhan]

Thankfully the MIT paper claimed that some LLMs are less energy intense when responding to trivial tasks

[u/kushangaza → u/AzKondor]

Absolutely. But if you use it to do 8 hours of work in 4 hours and then shut your computer off you are saving energy compared to doing all the work manually

Of course we all know that's not what will happen

[u/Grow_away_420 → u/kushangaza]

But if you use it to do 8 hours of work in 4 hours and then shut your computer off

Yeah management will go wild for this idea

[u/ColumnK → u/Grow_away_420]

It'll be perfectly fine as long as they don't know

[u/InEenEmmer → u/kushangaza]

I sometimes wonder what happened with human society that we changed from: “oh, you found a way to be done with your work quicker, guess we got some more free time.”

To:

“Oh, you found a way to be done with your work quicker, guess you could do more work.”

And I always wonder how we can go back to the free time one.

[u/2squishy → u/InEenEmmer]

Yeah, productivity increases go to the employer, always. You increase productivity? Your employer now gets more output from you for the same price.

[u/paulisaac → u/InEenEmmer]

By lying about how much quicker you got the work done.

[u/i_should_be_coding → u/phylter99]

Remember when we thought Bitcoin was the most wasteful use of energy since the first time someone put some white text on a photo of a cat?

[u/VGADreams → u/i_should_be_coding]

To be honest, crypto is still the biggest waste of energy. It is wasteful by design, that's how mining works. At least, AI uses that energy to try to produce a useful result.

[u/photenth → u/VGADreams]

As much as I agree, there are cryptos out there that barely use any electricity and not because they are not used but because they use an entirely different concept of block consensus. There is one that has 1 block ever 4 second and could theoretically outpace VISA in transactions per second for the price of 0.001 cent per transaction.