How The Massive Power Draw Of Generative AI Is Overtaxing Our Grid

There’s more than 8,000 data centers globally, but it’s not nearly enough to keep up with the power needs of generative AI. One ChatGPT query takes about 10 times as much energy as a typical Google search. Training one large language model can produce as much CO2 as the entire lifetime of five gas-powered cars and use as much water as a small country. Even if we generate enough power, our aging grid is increasingly unable to handle transmitting it to where it’s needed. That’s why data center companies like Vantage are building closer to where power is generated, while the industry invests in alternate energy source and creative ways to harden the grid.

Chapters:
1:58 Chasing Power
6:06 Hardening the Grid
8:45 Keeping it cool
11:56 More work per watt

Produced and Shot by: Katie Tarasov
Edited by: Evan Lee Miller
Supervising Producer: Jeniece Pettitt
Animation: Christina Locopo, Jason Reginato, Emily Rabbideau
Additional Camera: Andrew Evers
Production Support: Lisa Setyon
Additional Footage: Apple, Arm, Getty Images, Google, Helion, Meta, Microsoft, Nvidia, OpenAI, UC Riverside

About CNBC: From 'Wall Street' to 'Main Street' to award winning original documentaries and Reality TV series, CNBC has you covered. Experience special sneak peeks of your favorite shows, exclusive video and more.

Connect with CNBC News Online

#CNBC

How The Massive Power Draw Of Generative AI Is Overtaxing Our Grid

[parthjangid]

It shouldn't be "Why AI is facing a power crisis" rather it should "Why we might face a power crisis due to AI".

[skunkjulio]

Guess when they said AI is going to fundamentally change our lives, we didn't expect that meant we'd have to give up electricity and fresh water to data companies.

[MrTigerStarX]

Between bitcoin, EVs, and AI data centers: we absolutely do not have enough power for the future.

[Jun-pegz]

Yeah let's interview a guy that builds datacenters about the risk of AI power usage. Surely he'll be honest and unbiased in what he says. Most of this video felt like an ad for Vantage and other companies.

[metamorphic]

I am glad that along with mentioning the high power requirements of these data centers they also focused on the major issue of the excessive water used by these data centers.

[lym]

Cost is passed down to residents so the utility can reap future profits from the data centers. Shareholders win, and residents lose.

[volgg]

"Look son, we may have burned up our planet, but at least we got these sick sloppy ass AI generated image memes"

[danfromnorth]

In Paris, the data centre located downtown provides heat to the Olympic pool and hundreds of homes and a greenhouse.

[saiedanam]

Honestly this sounds like a more reasonable origin story for The Matrix than "We burned the atmosphere to block the sun"

[augustuscaeser]

dont tax consumers to give it to Microsoft
if Microsoft needs power for AI, they need to pay for it themselves, they have the money

[BXmax]

When u have the revelation that advancing in tech means the end of humanity. The irony about it

[jasonosunkoya]

Talking about watercooling like gamers havent been watercooling their PCs for decades 😅

[pnketia]

This is why so many people are investing in home solar and battery backup systems and using the grid as a backup! Every year my energy bill goes up yet I use less energy, buy energy star rated appliances an run my home ac less despite record temperatures every year. Now that I have solar on my roof and multiple storage batteries in my garage I no longer rely on the grid and only use it as a backup.

[waynemurray]

That man said 'loadshedding' and South Africans got PTSD.

[MuhammadIrfan-yezf]

I feel like have seen these before. Entire business sector flocking for single commodity and then the demand suddenly vanish into thin air.

Remember the time we used to fight over ventilator?

[Rstos]

No way one ChatGPT query takes 5Wh energy. Training must have been factored into this equation, and that's misleading.

[ScrapKing]

I don’t understand why any energy hungry building with a large unobstructed roof isn’t covered in solar.

[sutats]

They reported a similar issue back in the day of Bitcoin mining. Oh wait, that's an existing issue.

[zxtek]

Improve the power infrastructure: ❌
Make more electric vehicles/charging stations and AI: ✅💲

[wsxngfk]

you have one of the brilliant strategy out there, I've watched this video more than twice