221 - Easy way to split data on your disk into train, test, and validation?

Code generated in the video can be downloaded from here:

pip install split-folders

import splitfolders # or import split_folders

input_folder = 'cell_images/'

# Split with a ratio.
# To only split into training and validation set, set a tuple to `ratio`, i.e, `(.8, .2)`.
#Train, val, test
seed=42, ratio=(.7, .2, .1),
group_prefix=None) # default values

# Split val/test with a fixed number of items e.g. 100 for each set.
# To only split into training and validation set, use a single number to `fixed`, i.e., `10`.
# enable oversampling of imbalanced datasets, works only with fixed
seed=42, fixed=(35, 20),
oversample=False, group_prefix=None)

[SabbirAhmed-nchh]

good demo, was looking for something like this. was facing bugs in splitfolders, but didn't found intuitive solve like this elsewhere. Thanks !

[faaalsh]

Since I started dealing with machine learning with images, you are my teacher. Thank you for the awesome tutorials you are doing. Have you posted a video about splitting data for semantic segmentation?

[rameshwarsingh]

Excellent Post for Sreeni sir..👌 helps me to distribute data sets easily, , thank U

[jacobusstrydom]

O man this could have saved me so mush time. Thanks!!

[kev-dm]

thank you so much, you save my life for my college mid exam

[paulntalo]

Thank you for sharing. Please make another video showing how to split a large dataset of images with metadata in the train CSV file. And how to sort the train image folder into subfolders for each label category.
Thank you

[osiris]

You made may day bro! Ty so much <3

[zakirshah]

Teacher, can you make a video regarding image cropping. For example, we have many images in a folder in which the area of focus is in different locations, so how to remove the unwanted black background.

[supriyasumanidrpshc]

It was really very helpful, thanks for sharing it.

[lando]

thank you for the help, you are much appreciated!

[moussarais]

Thank you very much.. I have a question: I have according to each jpg a json file (their labels).. how can I also split these to the right folder? Thank you

[limzisin]

Good day Sir, I have an urgent question. After I splitting the dataset into train, val and test, how I can write them in the model.fit() function, because I saw the model.fit() function from others, they have x_train, y_train and so on...Thanks..

[kibetwalter]

This guy is a Lifesaver. Always. Thank you.

[nvxydxb]

sir, I downloaded a dataset from kaggle(flower recognition) and tried to work this way, but the following message (found 0 image belonging to 5 classes) shows that it is reading the folders but not reading the image knowing that it is inside the folder

[shivamwalia]

Hi sreeni, How to do Instance segmentation using Mask R-CNN for malaria cell segmentation.

[mihretdesta]

You are such a fantastic man!! but I have one question for you, I can't understand imbalanced datasets for multi-class image classification with code and before or after splitting the data into train val and testing for oversample?

[shankarmahadevan]

Hi sir! I'm using the Apeer platform for annotating my images, but I'm unable to export all my annotations at once... How can I do it, Sir? I couldn't find any resources on that...

[questless]

how do you divide timeseries image data set like I have 800 images of plant from week 0 to week 12. How do I divide them to test, train and val ?

[burakemregundes]

I split my dataset, but the image in the test folder is also in the validation folder, is this true?

[frieda]

after run, no new folders were created.
but theres no signs for errors