Tutorial: CUDA programming in Python with numba and cupy

/Using the GPU can substantially speed up all kinds of numerical problems. Conventional wisdom dictates that for fast numerics you need to be a C/C++ wizz. It turns out that you can get quite far with only python. In this video, I explain how you can use cupy together with numba to perform calculations on NVIDIA GPU's. Production quality is not the best, but I hope you may find it useful.

00:00 Introduction: GPU programming in python, why?
06:52 Cupy intro
08:39 Cupy demonstration in Google colab
19:54 Cupy summary
25:07 Grids, blocks and threads
27:12 Matrix multiplication kernel
29:20 Tiled matrix multiplication kernel and shared memory
44:25 Final remarks

Edit 9/9/2021: at 23:56 one of the grid elements should be labeled 1,3 instead of 1,2. Thanks to _______ for pointing this out.

[ErolErten]

I have been looking into gpu programming using numba and python for a while, this seems to be the best tutorial I was able to find so far.. . thank you

[Omgtired]

Thank you so much. Probably the best introdution to CUDA with Python. The example you use, while very basic, touches on usage of blocks, which is usually omitted in other introduction-level tutorials. Great stuff! Hope you return with some more videos. I have subscribed!

[taj-ulislam]

Definitely a lot of new material not seen else where - not a run-of-the-mill video. Great job on originality.

[kineticraft]

This reminds me a lot of the mindset you need to program in assembly.

[andrjo]

wanted to comment that the information in this presentation is very well structured and the flow is excellent.

[vallurirajesh]

Thank you so very much. This is the exact kind of material I was looking for on this very specific subject. Kudos.

[______]

wait i tought that this made by some popular channel, done pretty well and then saw, 29 subscribers

[ouaililydia]

thank you so much, it is the best explaination i found. Please keep going and give us more information and examples on that

[shaheeng]

Thanks a lot! Still the best guide I could find.

[plumberski]

Great intro for me. Waiting for my new GPU (likely 4060 Ti) for me to dig deeper into Python, CUDA, deep learning ...

[prietjepruck]

Really great introduction to GPU programming. I hope you make a new one soon.

[LoneXeaglE]

Thank you so much sir, you are an amazing human being !

[ArijitBhattacharya]

wold love to see a video on what are a few CUDA programming challenges

[PhoenixReflex]

Thank you so much. Keep up the hard work. Just hoping that more and more libraries in python will support GPU computations soon.

[sciencewolf]

Excellent explanation, keep going with this content man ;)

[dfrank]

This is really helpful for my computing. Thank you.

[thousandTabs]

this was such an excellent video, thank you so much!

[jakob]

Really nice video, thank you for sharing!

[terriplays]

Thanks for the video, I found the first half and the wrap up really excellent.

[localhost_mds]

thank you. good video!!! it was very helpful