Nvidia CEO Jensen Huang full keynote at GTC 2024

On Monday, Nvidia (NVDA) CEO Jensen Huang took the wraps off of the company’s highly anticipated Blackwell graphics processing unit (GPU) at the company’s annual GTC conference in San Jose, Calif.

The Blackwell is the successor to Nvidia’s already highly coveted H100 and H200 GPUs, and according to the company, it is the world’s most powerful chip. The H100 and H200 chips have become the go-to GPUs for AI applications, helping to rocket Nvidia’s data center revenue over the last few quarters.

In its latest quarter alone, the company reported data center revenue of $18.4 billion. To put the segment’s growth into perspective, Nvidia reported annual revenue of $27 billion for all of 2022.

“For three decades we’ve pursued accelerated computing with the goal of enabling transformative breakthroughs like deep learning and AI,” Huang said in a statement.

“Generative AI is the defining technology of our time. Blackwell GPUs are the engine to power this new industrial revolution. Working with the most dynamic companies in the world, we will realize the promise of AI for every industry.”

Like its prior Hopper GPUs, the Blackwell GPU will be available as a standalone GPU, or two Blackwell GPUs can be combined and paired with Nvidia’s Grace central processing unit to create what it calls its GB200 Superchip.

That setup, the company says, will offer up to a 30x performance increase compared to the Nvidia H100 GPU for large language model inference workloads while using up to 25x less energy. That energy savings is an important part of the story.

Nvidia customers, including Microsoft (MSFT), Amazon (AMZN), Google (GOOG, GOOGL), Meta (META), and Tesla (TSLA), are currently using or actively developing their own in-house AI chips as alternatives to Nvidia’s offerings. Part of the reason for that is so that they don’t have to pay the tens of thousands of dollars Nvidia’s chips are estimated to cost. But the other reason is that Nvidia’s chips are especially power-hungry.

By talking up its energy savings with the Grace Blackwell Superchip, Nvidia is speaking directly to its customers’ concerns.

Nvidia says Amazon, Google, Microsoft, and Oracle (ORCL) will be among the first companies to start offering access to Blackwell chips through their cloud platforms.

In addition to the Blackwell and Grace Blackwell chips, Nvidia also debuted its DGX SuperPOD supercomputer system. The DGX SuperPOD is made up of eight or more DGX Grace Blackwell 200 (GB200) systems, which include 36 Grace Blackwell 200 Superchips paired to run as a single computer. Nvidia says customers can scale up the SuperPOD to support tens of thousands of GB200 Superchips depending on their needs.

The DGX SuperPOD also gets a new liquid-cooled rack-scale architecture, which means the system is cooled off using fluid circulating through a series of pipes and radiators rather than straight-up fan-based air cooling, which can be less efficient and more energy intensive.

The Blackwell GPU and GB200 Superchip will be Nvidia’s new top-of-the-line leaders when it comes to AI training and inferencing, which means they’ll be in high demand the moment they hit the market.

But competitors AMD (AMD) and Intel (INTC) aren’t sitting idly by; they are almost certainly working on their own chips with the hopes of eventually catching Nvidia.
#youtube #AI #Nvidia

About Yahoo Finance:

Yahoo Finance provides free stock ticker data, up-to-date news, portfolio management resources, comprehensive market data, advanced tools, and more information to help you manage your financial life.

- Follow Yahoo Finance on social:

[Dantursi]

Been beating myself up a bit that I sold my 53 shares of NIVIDA at $303 each back in May 2023. Now thinking of liquidating a few other investments to rebuy but afraid to do so. I also currently have 500k in savings making me next to nothing.

[faisalsahmed]

The level of respect for employees he has is amazing....the way he introduced Janine is so much respectful

[ifrit]

CRAZY!!!! This is going to revolutionize the tech industry!

[siegfriedbarfuss]

Super smart and best sense of humor ! Very likable!

[shion-]

Timestamped Highlights
00:00
-3:00 🎵 Jensen Huang opens the keynote, highlighting Nvidia's impact in various industries.
07:30
-9:30 🖥 Introduces Nvidia's journey and the importance of accelerated computing.
13:45
-18:00 🧠 Discusses the significance of large language models and the need for bigger GPUs like Blackwell.
27:20
-30:10 🌐 Showcases the power of Nvidia's Omniverse for digital twin simulations.
32:40
-36:00 💥 Reveals Blackwell, an advanced GPU for generative AI, with impressive performance improvements.
41:10
-45:20 🌍 Demonstrates the use of generative AI in climate and extreme weather prediction with Cordi.
50:30
-53:40 ⚕ Highlights Nvidia's contributions in healthcare, including AlphaFold and understanding the language of life.

Summarized by @NoteGPT

[davidscott]

Next conference they need to hire someone from a game show that informs the audience when to applaud....too often he has to stop and wait for the audience to realize the importance of what he had just conveyed

[mabdoh]

empowering all of these companies, it should worth more than anyone of them....

[morbiusspectralghost]

NVDA is the genesis of much complex AI

[qentrepreneurship]

NV is an amazing company so I hope stock will rise upper $1000 as soon as posible

Cheers from lake Titicaca Peru

[foresthill]

Wow 2 hour speech! I don't know how he did it - had to watch it in 3 instalments 😂

[officialspaceefrain]

This is amazing technology. We don’t even know how it works.

[AdvantestInc]

The intersection of AI and graphics technology as highlighted in the keynote, particularly in weather forecasting and healthcare, showcases a transformative shift in how we approach critical global challenges. How can we further leverage these advancements for societal benefits?

[Bareego]

I like how he's not presenting some vaporware but stuff that works already today. That said, how much power will all the AI "factories" and data centers in the future use ? A whole lot.

[MinhNguyen-yteq]

The female voice over kind of sounds like the voice over from The Animatrix movie from 20 years ago. Soothing and almost apocalyptic 🙀

[randymulder]

I will be owned and given universal income.
I am ready to do nothing.

[PatrickLloyd-vjtj]

With markets tumbling, inflation soaring, the Fed imposing large interest-rate hike, while treasury yields are rising rapidly, which means more red ink for portfolios this coming second quarter of the year. How can one profit from the current volatile market, I'm still at a crossroads deciding if to liquidate my stock portfolio...

[asvindesai]

Thank you for explaining what I did not understand in Jensen Huang's address.

[_colquhoun]

The packages asking really was profound 😊❤

[victorflores]

72, 000 views on mar 29, today's version of the 49 people who came out to greet Cristopher Columbus when he came back from 'the indies', at the port of Palos, Spain.

[davidfitcher]

Hey Jensen, Bravo! But tell your toy not to destroy us!