Nvidia GPU Architecture

This video is about Nvidia GPU architecture. This is my final project for my computer architecture class at community college.

[kartikn]

I have come to this video 7 years since it's made, but the only source that's explained the GPU architecture so well. We need more people like you Brandon. Thanks for this!

[Engrbilal]

8 years and still its the best video available that explains gpu architecture

[pubgplayer]

This is a nice high level view of architecture without going into too much detail.

[billoddy]

As you can probably see, Streaming Multiprocessors are the GPU’s equivalent of a CPU core.

Furthermore, these CUDA "cores" Nvidia refers to are actually execution units. Floating-point FMAs to be precise. They make up the bulk of the SM’s execution units.

In reality, the number of SMs doesn’t really matter: Nvidia tends to change the size of an SM between microarchitectures, so comparison isn’t really useful. I would say comparing the number of CUDA cores as well as the clock speed is probably a more reliable comparison.

[shreyabhandare]

only video that explains this topic well, please consider making more on newer stuff, thank you 🙏

[anphiano]

Thank you Brandon, when you explained where's the number of cuda cores comes from, I felt it's so interesting, and I calculated it right away of how many SMMs in my GTX 960 with 1024 cuda cores

[antonidaweber]

Thank you very much for your work, Brandon! This video contains a lot of useful information. Explanations are simple and concise. And I also find your approach of researching information very inspiring. Step by step you dive into this topic, and although it's hard, in the end you have well-stuctured presentation, that you kindly share with other people.

[aravinds]

Thanks a lot for this explanation! This is the best video that I could find on this topic!!

[petergibson]

I like this level....down to the hardware.
Easy -Peezy software like Facebook and Microsoft Office are sitting on top of hardware.
The cleverness is in the hardware....billions of transistors.

[jayashreebhargava]

Very nice 👍 overview of Nivdia GPU arch

[zhikangdeng]

really nice explanation. Thanks for you sharing!

[MrPkmonster]

Great tutorial. Very clear explanation. Thank you Bradon

[vladislavdracula]

Very well explained. However, cores are not the same as ALUs.

[kartikpodugu]

Hierarchy
1. GPU
2. GPC
3. SMM
4. CUDA core.

[zhangbo]

very helpful for learning Graphics thanks

[evabasis]

thaink you for the nice video. Can a core runs more than onr thread in the same time? Or a cuca core is to execute only one thread in the same time?

[JJJohnson]

Thanks for this simple, but informative tutorial.

[FreakinLobstah]

Wow, very well done! It was very helpful for me.

[stizandelasage]

this can accelerate my Unix os I really like it

[himanshupatra]

very nice explained. Can I get the link to all sequential videos after or before this..? I couldn't find the prev one. I wanna watch all of those. @Bradon Fredrickson