Step-by-Step Guide: Install NVIDIA GPU Driver, CUDA Toolkit, cuDNN, and TensorRT on Windows 11

🚀 Welcome to our comprehensive tutorial on installing and configuring NVIDIA graphics card drivers, CUDA Toolkit, cuDNN, and TensorRT on Windows 11! If you’re looking to boost your machine learning and AI capabilities, this video is for you. Follow along as we break down each step, ensuring you get your system up and running smoothly.

In This Video, You’ll Learn:

NVIDIA Graphics Card Driver Installation: How to download and install the latest drivers for your NVIDIA GPU.
CUDA Toolkit Installation: Step-by-step instructions to install CUDA Toolkit, enabling GPU acceleration for your projects.
cuDNN Installation: How to integrate NVIDIA's deep neural network library for high-performance neural network training.
TensorRT Installation: Optimize and deploy your AI models efficiently with NVIDIA TensorRT.

Chapters:
0:00 Introduction
0:43 Installing NVIDIA Graphics Card Driver
3:11 Prerequisites
3:46 Visual Studio Community Edition
4:55 Nvidia Nsight Visual Studio
5:57 Installing Mini conda
8:45 Cuda Toolkit 12.4.1
12:12 cuDNN Configuration
14:55 TensorRT installation
20:35 Pytorch with CUDA
23:05 Conclusion

Useful Links:

Join The Community:
Subscribe to our channel for more tutorials on AI, machine learning, and tech tips. Hit the notification bell so you never miss an update!

Hashtags:
#NVIDIA #CUDA #cuDNN #TensorRT #Windows11 #MachineLearning #AIGuide #TechTutorial

[keanureecvers]

awesome video, i followed you step by step and it installed successfully.Lmao after 2 months of struggling your video helped alot🙏

[nandyaladineshmurali]

Hello there, I have the CUDA 12.5 installed on my system(Windows 11). And trying to install the TensorRT - 10.2.0.19 which match my cuda version. Everything is fine until 20:00 . But there is no onnx_graphsurgeon folder in my directory. I tried reinstalling the tensorRT multiple times but no use. Please help me out.

[michaeldang]

Thank you so much, this is the exact video i've been searching for. Your video moves at the perfect pace and everything is easy to follow. will definitley be watching your other videos after this one. great work!

[AdityalikeThe]

Best cuda installation guide out there.

[TEXASMOFO]

Very informational video... clear and concise. 👍

[KarmaRayshar]

cuda binary kernel for this graphics card compute capability (8.9) not found, I can't render animation in blender. Any Idea? Thanks

[LikquidDutch]

I dont have graphsurgeon in my tensor zip file im using cuda 11.8 is it required ?

[mohamadelsawi]

hello my friend i did everything you said, and thank you alot for your effort, i have question when i reached to the part you will install pytorch, i found that i have it on my pc, should i do the same as you did, and why to do that :)

another question ^^
will i open conda to be in env everytime i restart my pc or it will be permanent work, as i will use stable diffusion with TensorRt extension

[nihar]

Does this work with jupyterlab? In powershell it showed True but in jupyterlab it shows false? I am using same environment, but Cuda 12.5 with pytorch installation link for 12.4 is this the reason cud.is_available() is returning False in jupyterlab?

[yuval_kahan]

why you didn't install pytorch 2.3.0 ?