$200000 NVIDIA H100 80GB 4Way GPU Server

#nvidia #gpu #h100 #workstations #server #yangcom

CPU: Intel Xeon Scalable Gold 6336Y (2EA)
M/B: SUPERMICRO MBD-X12PI-NT
RAM: SAMSUNG DDR4-3200 ECC/REG 768GB(64Gx12)
SSD: SAMSUNG 980 PRO M.2 NVMe 2TB
VGA: NVIDIA H100 80GB PCIE (4EA)
CASE: 4U RACK Type Rail KIT
POWER: 2000W PLATINIM + 1000W GOLD
Water Cooling Parts: 1U LGA 4189(2EA), NVIDIA H100 Block(4EA),
30T Radiator (2EA), All in one Pump, EPDM Clamp, EPDM, Quick Disconnect

Yangcom Home Page
Yangcom Instagram
Yangcom Facebook
Yangcom Blog

[johnkost]

Where is the NVLink bridge?

You will need it for sharding the largest models and getting the best performance. PCIe 5.0 is not gonna cut it ..

[alimejia]

Awesome It would be fantastic to see how it behaves with its installed operating system.

[cclark]

Why loop the second CPU into the output of the first when you had space on the block? Is there a reason to do this?

[designpqp]

Now we can play Minecraft on steroids!

[dankmemes]

Could you or anyone provide a link to that 4U case? Ive been looking for a case that can support supermicro boards since I dont want to use their proprietary chassies.

[GhostWriter]

Now build a mini nuclear reactor for it

[timwong]

Don't find it necessary to watercool, the passive cooled H100 is capped at 300w and you won't be able to go over. Plus, using lesser capable fans (T30 is ok for normal PC, not really for servers) yields much higher component temp such as ram, on-board vrm.
Also, using custom case means you lost the drive slots on the front panel often seem on oem solutions. And not using server grade power supply is also a huge downside. (seriously, not even dual titanium redundant PSU???)
For 200k, you can get better complete solutions better than this, and with much better reliability.

[suou]

the amount of VRM on those GPU is insane...

[savva.]

1:06 equidistributed method of unscrewing nervously smokes on the side

[WingGT]

It would be good to have one that shows NIC installation too

[StarGuardian]

I have a qustion, I have a Skylake Xeon do you need eight sticks per CPU to get Quaf Channel, I have four per CPU and its only giving me Interleaving of 2 in Linux

[fftrre]

Mainframe. 10/10
Cpu. 10/10
Gpu. 10/10
Motherboard. 10/10
Water cooled 10/10
Power supply 9/10
Cable management 10/10
Heat transfer. 10/10
Hose & connetor. 5/10

[babalee]

Will the GPU be burned out if the water cooling system stops abnormally?

[JohnMark-nk]

Can't someone use the gpus as they are straight from the box?

[DominikSchafflik]

Nice Setup ❤
But first mistake is that you connect second cpu behind first cpu altough you have enough space on your block
And second mistake is how you applied thermal paste on cpu and gpu, with this method you have too much air inclusions between heatspreader and cooling block, best way is to applying only paste in the middle and place the cooling block smooth and straight on the cpu/gpu, this makes many degrees difference in our servers 😊

[radioactiverain]

For the double psu need a specific motherboard?

[SfsultamateGamer]

My Rtx 6000 finally has a worthy opponent

[SiriasisOFFICIAL]

Nah, bro really got the SpaceX computer 💀

[tamzidtaeef]

What’s the usage of this device? Can anyone explain

[gabrielgagnon]

Crazy, 200k on a rig and no RGB? This is madness.