Nvidia CUDA in 100 Seconds

What is CUDA? And how does parallel computing on the GPU enable developers to unlock the full potential of AI? Learn the basics of Nvidia CUDA programming in this quick tutorial.

Sponsor Disclaimer: I was not paid to make this video, but Nvidia did hook me up with an RTX4090

#programming #gpu #100secondsofcode

💬 Chat with Me on Discord

🔗 Resources

🔖 Topics Covered

- How does CUDA work?
- CUDA basics tutorial in C++
- Who invented CUDA?
- Difference between CPU and GPU
- CUDA quickstart
- How deep neural networks compute in parallel
- AI programming concepts
- How does a GPU work?

[tigerseye]

Little know fact, CUDA is actually so fast, that it can bend spacetime and make 100 seconds last 3 minutes and 12 seconds, truly revolutionary.

[mrgalaxy]

I've done a bit of CUDA in uni for a class in parallelism. Let me tell you, writting truly parallel code is a pain in the ass. Ain't no way all those scientists are writing CUDA code, probably some Python abstraction that uses C++ and CUDA underneath.

[mjiii]

The #1 computing platform for vendor lock-in

[mehlp]

0:36 this just taught me matrix multiplication, thanks

[seele]

Seeing "Hi Mom!" continue to be in your videos is such a beautiful thing. Hope you're holding up well

[WolfPhoenix]

I did some CUDA programming assignments for my college Parallel Computing class.

That course was the second hardest CS course I've ever taken (The hardest one is Compilers but that's in its own league). Human brains really weren't designed to think in parallel.

[r.y.z.]

ngl, I'm really loving how often these videos are being uploaded. It's often, but not so often that I feel overwhelmed and just spaced out enough that I feel a little excited when a new one comes out!

[imWaytooRad]

Thanks! I was having this discussing with my coworkers the other day about what separates a gpu from a cpu and this was an excellent explanation!

[ucantSQ]

Whoa, my universes are operating in parallel. I just learned about CUDA this morning for the first time, and here's a new fireship video about it.

[johnfrusciantefan]

Wrote Cuda at university .. getting the indices, blocks etc right ... that was fun (also since thread count depends on the actual GPU model). For the final project, we were allowed to use libraries such as thrust which made my life a ton easier by abstracting away most of the fun stuff.

[munto]

Bruh, are you my FBI agent? I just looked CUDA up a few hours ago.

[Rohinthas]

Not using or planning to use CUDA but man did this just help me make sense of some terms I see being thrown around! Awesome!

[scapegoat]

Yo I just wanted to say thank you for making this kind of stuff so interesting and digestible. You make these extremely complex, time intensive languages, apis, tools, etc., and make them incredibly approachable.

Love your content. Cheers.

[neuronscale]

Great presentation of the topic of CUDA architecture and Nvidia GPUs in such a compact and fast form. As always, brilliant video!

[bartlx]

Nice to see a video touching C++'s ecosystem for a change. Now make one about SYCL, so even people who don't find free RTX 4090 cards in their mailbox can get into high performance parallel computing using modern ISO C++ instead of custom CUDA syntax.

[Officialjadenwilliams]

Surprised that it took this long to get a CUDA in 100 seconds. 😆

[gagd]

As a programmer I absolutely love your series on programming languages and tools ! Cannot be more clear, and full of knowledge. Thank you. This also refresh common knowledge such as the C video!

[Julzaa]

1:09 still day zero of not mentioning AI

[MaxoticsTV]

Funny, I had to install NVIDIA CUDA for a thing I'm doing and forgot what CUDA does, searched it, and found this video that was just posted an hour ago! WHAT TIMING!!!

[BattlewarPenguin]

Awesome video! Thank you for the heads up in the conference!