What is the NVIDIA A100 powering ChatGPT and GPT-4?

You have heard of ChatGPT and GPT-4, but what is the NVIDIA A100 and NVIDIA H100 that people say are powering the AI tools? We show you.

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------

[post-leftluddite]

PLEASE do a video on AMD's MI300...this is rhe most interesting piece of hardware recently

[HonkIfYoureGoose]

FYI ChatGPT is running on V100s. Not A100s. Also we have no idea what the infra for GPT4 looks like on the inference side. Very good chance it too is V100. Openai and azure really love their v100s. They work well for mixture of experts which rumors tell us openai is using.

[VideogamesAsArt]

These big HPC/datacenter hardware pieces are incredibly interesting to me. Love learning more about them! Very hard to know which one is more powerful and better (I guess it doesn't matter so much over ease of use and price) so would love some comparisons against Intel HPC and especially against MI300!

[jolness]

That juicy juice GA100 die. Excited to see what Hopper is capable of.

Would love to see shorts like this, always happy to see any sth content!

[TayschrennSedai]

"sold in sets of lakes of gold deposits into Nvidia bank accounts" I fixed your script for you 🤣

[davidrose]

It would be nice to see AMD take some of the enterprise GPU space. They've done great in the CPU department, but I can sense Nvidia creating a monopoly on high-end GPUs like these

[therealb]

Can't wait for the H100s to start the AGI Skynet Apocalypse!

[annaqiu]

I have a product of high pressure car washer, please can you test it❤

[computersales]

I never have understood how the SXM cards were able to run a higher TDP. Is it purely because they have a bigger heatsink or is the board designed differently?

[Bohndigga]

Great video! Kind of wish it wasn't at 115% speed though. Or is that just me? Is it not actually that fast? Am I going crazy?

[AlanAlbim]

Please help us! We got 2 of H100, but we are not being able to install them and test correctly. We’d really appreciate if you can give us some advice

[mcpr]

If it doesn't say Micro Machines, its *not the real thing*.

[juniorcomsono]

very cool man! i just wonder why you speak with only one side of your face :o

[wocket]

So, in a couple of years, you'll have the performance on your desk, as part of your GPU.

[willcarter]

Shouldn't the next generation be called B100?

[LeoLijo]

Its not a gpu its an ai accelerator card

[xznmusic]

When the OpenAI devs created bias with ChatGPT with a forced redirection of its algorithmic perception mechanisms, people began to lose interest. What was once promising is now disappointing.

[jkid]

And all made by TSMC in Taiwan only. Taiwan is the AI nation of the future