High Bandwidth Memory (HBM) As Fast As Possible

High Bandwidth Memory (HBM) is very different than the types of VRAM we've seen before. How does it work, and will it actually improve your gaming experience?

[DrSQUIRRELBOY]

0:10 He isnt even playing. He is watching a Youtube Video. YOU CANT FOOL ME LINUS!!!

[pppshr]

So I'm also subscribed to Gordon Ramsey. I saw thumbnail of this video in my subscriptions and I thought Gordon uploaded a new recipe for a sandwich. I checked out its title, "High Bandwidth Memory ..." I thought what kind of sandwich is this? so I clicked to check it out, and I came here.

[internetmom]

My girlfriend thought I was watching a cartoon because of Linus's voice

GG

[jack]

"while you cant eat hbm" dont tell me how to live my life linus

[toastedphantom]

As of 2020, this video aged like a fine egg.

[nocturnmusings]

Love that the B-roll for the wider interface at 2:50 is actually one of the more bottlenecked portions of the 401 during rush hour...

[jpHasABadHandle]

Because of the picture, i first read it as "High Sandwich Memory"

[magiclegend]

For those interested, I've made a transcript:

0:00 Whenever there's a big new graphics card released, there's always like a feeding
0:04 frenzy as gamers try to get their hands on it so that they can to blow away dudes
0:09 in crisper detail and at higher resolutions than ever before, but while
0:14 the performance of the graphics processor or GPU itself is often the
0:19 most talked-about aspect of the new card the amount of video memory or VRAM
0:24 on a card can have a big effect on just how high you can crank up your settings.
0:30 But while GPU's, or graphics processors have been updated and re-updated
0:35 pretty regularly over the last few years, not much has happened with VRAM
0:40 recently. We've had this same old GDDR5 memory hanging out on our card for over
0:46 seven years. But the next big thing in VRAM is finally here. I'm talking of
0:52 course about high bandwidth memory or HBM. So what exactly is it? How is it
0:58 better than older VRAM technology, and most importantly is actually going
1:02 to make a difference in your games?
1:05 Well, just like any other type of VRAM, HBM performs functions like keeping
1:10 rendered frames in storage in a frame buffer, no, not that kind, holding textures to
1:15 make everything on screen look realistic and storing crucial information for
1:19 lighting and other effects. In short: it holds the information that your GPU
1:24 needs to act upon to push an image to your monitor. But although HBM serves the
1:29 same basic function as other types of VRAM, the way that it's actually
1:33 implemented on your graphics card is very different. For starters, GDDR5 and
1:39 its predecessors required DRAM chips attached to the PCB, spread out around
1:46 the processor. And the more memory you want, and the higher speeds you want, the
1:51 more chips you need to plunk on there. Which combined with the traces, for data
1:56 and power, to all those chips take up a lot of space on the card,
2:00 and increase manufacturing complexity and therefore cost. HBM solves these
2:05 problems two ways:
2:07 Number one the VRAM and is now directly attached to the GPU package, meaning that
2:12 HBM requires no more space than what's already normally taken up by the GPU.
2:18 Two: HBM uses 3D RAM Dies, that are stacked on top of each other and that
2:24 communicate using tiny interconnects called through silicon vias, or TSV, which are called
2:30 that since they physically go through all the stacked layers at once.
2:34 Kinda like a toothpick drug giant club sandwich. And while you can't eat HBM
2:39 like you would a Monte Cristo, these changes have the potential to give
2:42 you some positively delicious results while gaming. So the chips themselves
2:47 have a much wider data interface, that combined with stacking the chips gives
2:52 you these little, well, stacks, that can move up to 256 gigabytes of data per
2:57 second, which means that a graphics card with just four stacks of HBM could
3:02 have memory throughput of a full terabyte of data per second, which will
3:07 become increasingly important in the future, as more and more non gaming
3:11 applications, like Adobe Premiere for example, start leveraging the graphics
3:15 card for computer and as the resolutions that typical gamers want to run at
3:19 increases. Not to mention that there's things like multi 4k monitor setups
3:24 are becoming cheaper and more popular all of which will be easier with more
3:29 memory bandwidth. Ok then Linus, so how do I hop on board this hypetrain?
3:35 Well, it's being easily currently available on AMD's top-end Radeon R9 Fury
3:40 series, but, the rumor mill figures that Nvidia's upcoming Pascal
3:45 graphics cards will feature the technology, and as we all know: the high
3:48 end today is the mainstream of tomorrow, so that in a couple of years we should
3:52 all be able to have enough memory bandwidth to choke a horse. Speaking of
3:57 choking horses! Nope, not related to that at all... [Insert sponsor spot here]

[shirkedance]

When you Search for Intel HBM memory on CPU die in 2022 and you find Linus 7 years old videos

Linus really did time travelling

[GarretSlarrity]

This video really should have included a mention of HBM gen 2.

[thesomething]

Fucking thumbnail, I read the title as High Sandwich Memory

[santiagocastro]

we are at the future and this aged like fine milk

[foguandme]

CONFIRMED: Dollar Shave Club chokes horses

[Zephyruxs]

i really wish hbm hit the mainstream like linus predicted but sadly this isnt the reality, we just have gddr6x

[shivenpandya]

I am working on HBM IP at Intel. Very well explained !

[RWoody]

Kinda wish you would've addressed the fact that HBM gets more performance without as much clock speed because even people like JayzTwoCents seem to be confused; mentioning lower memory clockrate as a disadvantage when the fact is the only important performance metric of the memory for graphcs card applications is its data rate per second which is determined by clock speed * bus width so it doesn't matter that one is a lot lower when the other is a lot higher (something i know you did mention but didn't elaborate on). Good video otherwise, thanks LTT :D

[kakaoen]

Came for the sandwich left because the sandwich disappeared faster than expected.

[pepethebee]

"Peppermint scented butt wipes for men"

WTF?

[sebastianmonterroso]

3:18 i was listeninng to the video in the backround and this scared the shit out of me

[Movement]

Linus, da tech tip gawdfather. Running da tech tip youtube mafia. How many channels features this guy holy shit. lol