AI Has a Dirty Little Secret...

It's really easy to be impressed with AI progress, and lose sight of a bigger picture. Yes the tech is amazing, and its growing at an unimaginable pace, but can our grids keep up? We already have more EVs, and with a scorching summer, AC. So just how much electricity does AI use, and is it growing too fast? Let's figure this out together!

》》》SUPPORT THE SHOW!《《《

》》》OUR PARTNERS《《《

》》》GOING SOLAR?《《《

》》》COMPANY OUTREACH 《《《

》》》CONNECT WITH US 《《《

Chapters
0:00 - Intro
1:19 - How much Energy?
5:50 - AI Disruption
8:10 - The Dirty Part
9:00 - Expertise vs Generalist
9:40 - The Good News

what we'll cover
two bit da vinci,ai,ai power use,ai electricity consumption,rise of ai data centers,how much energy does ai take,how much energy does ai training use,ai training electricity requirements,why AI is killing the power grid,ai generation,ai nvidia,ai grid demand,electricity usage of ai,ai model training,data centers straining the grid,data center electricity usage,Why AI is KILLING The Power Grid,how AI is killing the power grid, AI Has a Dirty Little Secret...

[ICDeadPeeps]

Knowing how much power A.I. consumes makes you truly appreciate how efficiently the human brain operates.

[xlntnrg]

Me: ChatGPT, can you tell me how much electricity you're actually using?
ChatGPT: Eh, can't we talk about something else?

[MaximGhost]

All of us who were using NVIDIA GPUs to mine Ethereum could have told you this.
In my case, I was mining using rooftop solar electricity.

[gene]

In Denmark Facebook is already using heat from their serverpark to heat homes. It's already happening.

[leroybecker]

Happy to hear that analog computation is finding new life. Sixty years ago I had the pleasure of programming the Electronic Associated PACE Model 231R, the last of the large analog computers. It regularly calculated results faster than our department's digital computers. Then we installed a Philco 2000 with 10k core memory! Analog still won the timed races, but lost out on precision with "only" four-digit resolution.

[dshoopy]

Has anyone else noticed the sound quality tank a few months ago? it sounds like he is talking through a wet sponge.

[RobertHopkinsArt]

Yes! Make a video on heat redistribution (at least at the data-center level) and how we are not taking full use of this topic. Recycled electricity at the time of use!!!

[MrKhankab]

If we built more nuclear power plants instead of shutting them down. That would help with energy needs.

[cokechang]

The dirtier secret is all that energy are probably not well spent in terms of the outcome it generates.

[IowaKim]

I live in the area where the Cedar Rapids data center is to be built. The local nuclear power plant has reached its end of life and is now being replaced by 3, 500 acres of solar panels on prime farmland. This video just put the pieces together for me as to why. I can see a lot more expansion of these panels to more prime farmland. Looks like this would have been better served in a location where less productive land is abundant.

[KastorFlux]

Do the dive! An alternative to matrix math could be useful in a lot more than just LLM.

[babelfishdude]

Well... In Alberta Canada we have flared excess natural gas beyond what the government has set as a limit. For zero usage, not even as heat.

It is of course to maximize sales of oil to the USA.

[turboprintd]

Every time this stuff comes up the lore of rainworld rings in my mind.

[revolution_is_the_key]

simple solution: Make the big data companies pay for the construction of nuclear power plants, to even out the energy it progressively takes out the regular grid from people.

Clearly they got the money for it

[grkuntzmd]

I would like to see a deep dive into the techniques for implementing neural networks without matrix multiplication. I did some published research on NNs in the early 1990's but haven't really been involved with them since.

[andyfeimsternfei]

I manage a SCADA system for one of the greenest utilities in the country. Data centers have moved in, and now their baseload is 4x their previous all-time peak. The data centers are eating up all their green energy, and the remaining is coming from firing up old coal plants. AI and Cryptomining are totally negating and alternative energy benefits. Ironic Tesla started all of this. Kind of contrary to their mission statement. Utilities I work with are planning on a 3x increase in electrical demand for upcoming data farms.

[greggrant]

Please DO produce a video on analog computing! Thank you!!

[keith]

AMD is ready to start shipping their A.I. Chips. They have huge orders coming in now. What a time to be alive !

[evilspacemonkeyman]

I just spent 1.21 Gigawatts of energy!
Did you use your flux capacitor at 88mph?
No! Better! I have a PowerPoint slide of cats!

[IntenseGrid]

Off peak ai training sounds good until you think about how fast the hardware depreciates, not just in expense, but also in efficiency.