Energy, not compute, will be the #1 bottleneck to AI progress – Mark Zuckerberg

[siskavard]

Zuck is so much better at talking about nerdy shit than he is as a public-facing marketing guy lol

[mikerowave]

Zucc got his latest patch 1.8342
- improved facial animations
- improved vocal features
- improved body language
- custom hair
- integrated eye moisturizer (no more eye licking)


Still under development:
- show emotions on face, voice, body language
-

[jeroenbauwens]

Dwarkesh cut it out of this clip but he mentioned to Mark that Amazon just purchased a 960 MW (=close to 1 GW) data center from Talen energy next to a Talen nuclear power plant in Penssylvania... around the same time they invested 1 billion dollars in Anthropic, the company that made llm Claude. So I have a feeling we WILL actually see that major leap in capabilities next year, unlike what Mark believes, or seems to believe.

[elginbeloy]

I never realized how much power was going into making these foundation models.

[edwalker]

energy always has been the determining factor of the advancement of society

[JedRichards]

You need to unlock the fusion energy tech tree, before you can build your super AI. Everyone knows that

[bonbon_ann]

Zuck looks more human than usual. That's sus. XD

[santiagocarreno]

Mark Zuckerberg looks so normal and human here, that it feels weird af; we want our lizard robot boy back

[pkundr]

The efforts we put into replacing ourselves are remarkable

[MrSchweppes]

When the most powerful companies in the US (Microsoft, Google, etc.) need to solve a bottleneck in order to make progress, regulatory and other constraints will be quickly resolved. There is too much at stake when we talk about AI progress. So, expect a 1 gigawatt data center next year.

[franktfrisby]

Dude you grew like 20k subs in a span of a few days. awesome!

[ICodeForALiving]

"1.21 Gigawatts!!! Great Scott!!"
- Mark EmmetBerg

[xaxfixho]

Remember when a computer filled up a huge room 🤔

[christianross]

Who ever is doing his human training is killing it.

[zerokelvin]

I work for a transmission system operator at the highest voltage level in the grid, and the number of connection requests for new data centers we're getting is just insane!

[chefpollo]

Build a gas fueled power plant in East Texas and you’re gucci Zuck. Plug it into your zillion gigawatt datacenter and let Jerry Jones take you to the promised land.

[erikkovacs]

AWS has 1GW in the Columbia river basin in dozens of sites and buildings.

[matt.loupe.]

“How long can the exponential curve going for?” There’s going to be a Nyquist-Shannon equivalent limit to the max data and compute you can throw at a model before you can’t improve it anymore.

For example, if you trained an ai model on flipping a coin, it doesn’t matter if you use a 1-gigawatt cluster and 100 trillion coin flips as your dataset, the model is still going to be 50% chance. The question is how do you theoretically find that limit without throwing 10s of billions of dollars at training clusters.

[playwithmycrud]

Energy is the #1 bottleneck of everything my guy

[andresprieto]

It's not just energy production, its infrastructure as well. Even if we have the technology, it would take at least five years to build the necessary infrastructure to deliver the energy and thats being optimistic.

So essentially they would have to place it next to a plant dedicated for it.