PyTorch Lightning #5 - Data Module

❤️ Support the channel ❤️

Paid Courses I recommend for learning (affiliate links, no extra cost for you):

✨ Free Resources that are great:

💻 My Deep Learning Setup and Recording Setup:

GitHub Repository:

✅ One-Time Donations:

▶️ You Can Connect with me on:

[changmatta]

excellent turtorial. However, would be really helpful if you can make video on custom dataset in lightning module

[junpyohong]

It feels like we've wrapped up the data preparation part of the pytorch process one more time. Personally, I think that's because pytorch's data handling is already good enough.
Anyway, it's a really great lecture. Thanks.

[kaspertoftbraun]

Again, awesome video. However, I would still love to see a tutorial on a customDataset. I know you partly explained what to do, but I think many people need tutorials on how to implement code with custom datasets, and not MNIST-preloaded datasets. At least that's the case for me.

[Steven-gygx]

Thanks for your sharing! It is really comfortable typing these codes following your video! But I found lightning seems to change very quickly, here the training_epoch_end in the video does not work anymore and I should use on_training_epoch_end instead.

[changmatta]

At around 3.45, you said we have to create separate CustomDataSet class that will be passed to set up. My question: Instead of creating CustomDataSet, we can do those steps inside the method "prepare"? Or is it compulsory to create a seperate class for CustomDataSet?

[markaragnos]

would be great if you had a colab notebook for us to see and try your code ourselves. to basically learn by doing

[taheralipatrawala]

Can we use this Datamodule for custom datasets? If yes how do we prepare and format the data?

[pradeepbansal]

Can we use PEFT or LORA with Pytorch Lightning ?

[devnull]

Great content, thank you and please make more :)

[LongLeNgoc-qqqn]

I got this error when fit: 'MyMnistDataModule' object has no attribute 'prepare_data_per_node'. I searched on stackeroverflow but couldn't fix it. Could you give me a link or hint to fix that error? Thank sir!

[nayyukiina]

does anybody know what plugin or something he uses to get those code recommendations?

[PhantomKenTen]

There is nothing I hate more than examples on the MNIST dataset, because that datasets is just calling APIs. I was having a tough time to understand how data flows between prepare_dataset and setup.