NVIDIA REFUSED To Send Us This - NVIDIA A100

We've experienced a lot of crazy, top-of-the-line graphics cards on LinusTechTips, but we've been unable to get our hands on one famed card - the NVIDIA A100..... until now. ;)

Purchases made through some store links may provide some compensation to Linus Media Group.

FOLLOW US ELSEWHERE
---------------------------------------------------

MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova

Outro: Approaching Nirvana - Sugar High

CHAPTERS
---------------------------------------------------
0:00 Intro
1:06 How we got one, heh
1:58 Our contenders
2:38 A100 Specs
3:49 Teardown
8:38 Jake sucks at throwing
8:48 Buildup
9:43 Shroud
10:39 How to get it to boot
10:56 It works!
11:24 Blender
14:05 Can we trick windows into running games on it? & GPU-Z
15:27 Ethereum mining & afterburner options
18:02 Resnet50 machine learning benchmark
18:59 Worlds most expensive lint roller
19:10 Resnet50 machine learning benchmark part 2
21:12 Closing thoughts

[klaushakon]

watching linus handle someone elses expensive hardware is like watching a thriller

[Drsmiley]

Nvidia : "no linus you can't have that"
Linus: "and I took that personally"

[seangoulden]

*Linus who has broken something, on everything, in every video created*

Linus: “I don’t know why Nvidia wouldn’t send us the card”

[lozzar]

LTT: NVIDIA refuses to send us a super powerful gpu

Also LTT: drops a $10k cpu by accident breaks it and attempts to fix it with a vicegrip

[doderiolarkisso]

thanks for pointing out Jake, really helped me recognize him.

[cineblazer]

A100s are no joke, no wonder AWS wants to bill me three arms and a leg to spin up instances with them just so I can get a "Sorry, we don't currently have enough capacity for this instance type" screen!

[WanderP]

At this point, the GPU has become the real computer and the CPU is just there to get it going.

[tasty]

I like how youtube has labelled this video as "Exclusive Access" as if Nvidia have allowed this at all lol

[UItEnthusiast]

Linus: "We can't just go out and get an A100 because it costs almost $10, 000"
Also Linus: Creates a solid gold Xbox controller that's worth more than many people's houses

[mark]

I replaced one of these cards for a customer who had 3 of them in total in a Dell 7515 server running dual AMD Epyc 7763 64 core processors. I remember thinking this APU is worth more than my car.

[miniscule_mule]

Amazing how I can understand so little yet be so thoroughly entertained. 10/10.

[Laptopsigmagamer]

6:58
The nvidia employee watching the chip serial number: 👁️👄👁️

[abdelfattahtoulaoui]

Just wanted to point out that TensorFlow by default allocates the whole memory even if it's not using it, so the A100 may benefit from a larger batch size

[werewolfmoney]

I'm glad Jake said "ah, it has an IHS" because for a split second I thought that was all GPU die and nearly had a stroke

[MsNikkieMichelle]

Linus you look great with a beard! Long time sub here from back when you and Luke did those build wars and watching your videos back when you had that old space where you connected each pc daisy chained to a copper water cooled set up. It’s awesome to see your sub count and how far you’ve come since I last watched your videos. He you are your family are all well and enjoying the holiday season!

[hosseinsarshar]

Nice comparison. You could've rented one of those bad boys on Azure for less than $4/hour for the benchmark. In fact, 8 GPU A100s connected through NVLink are expected to be 1.5X times faster than stacking 8 A100s connected through motherboard.

[nickelsey]

Fun fact, our A100 servers (8 80 GB SXM A100s per server) each have a max power draw of close to 5 KW. And Linus and Jake were right! Even with the 80 gig models, we still wish we had more memory. Never enough memory!

[Wetheuntitled]

I was one of the people handling repairs on amazon servers and I’ve seen thousands of them. They are crazy. Of course I can’t test them but just holding it you can tell it’s a beast

[Dsuranix]

so glad they contextualized the AI performance, wish they would branch into that field more, and even have a tech review integration for AI performance. they *must* know about stuff like Stable Diffusion, so it'd be useful and fun, especially when the 40 series comes out, or testing things like the ARC if they ever get an opportunity. i'm still curious if they ever explored AI performance of ARC.

[ThePivotuserful]

man I wish I was half as smart and cool as you guys. I enjoy watching these videos as a casual consumer and its so cool you guys basically dance around code and near instantly recognise items instantly and with ease! I mean seeing the teardowns are always a joy too.