How to Create Efficient Training Pipelines with TensorFlow data.Dataset (Tensorflow Datasets)

Don't forget to subscribe if you enjoyed the video :D

[wryltxw]

the way I understood it, is that on the first epoch, the processed data gets cached. and therefore, subsequent epochs, we don't need to preprocess, since we can now use the cached data instead. since they are the same anyway. no need to repeat it for each epoch.

[ShoaibKhanZ]

F!!! its a functional lazy eval. Argh, was clear as mud before, now crystal clear. Thanks!

[vasudevraghav]

What an awesome tutorial man! Keep up the great work, really learned a lot!

[hussainsalih]

very well document, I hope you make a video on best practice neural network when it faced overfitting

[inakitodc]

OMG this was so fcking useful, really good and deep material. Thanks!

[Amir-gifn]

9:41 Oh so it turns data from uint8 to float32 only when needed and this actually saves a lot of memory I've already preprocessed my data but can now do resizing in Pipeline

[freya]

Hello, and thank you for this great content.
What may happen if you have multi-input models and large datasets? Would you use the for loop to separate the input features and the labels?

[wryltxw]

what would be also cool is to see a video on vision transformer?

[harshitjami]

In the video when your doing the first 'for' loop after the mapping the example_dataset, the loop broke after the first iteration so it must have only cached the first sample in the example_dataset and then when you shuffled the samples and then iterated through the first sample (in the newly shuffled dataset) it must have mapped and then cached that first time iterated sample in the examples_dataset because it was not previously iterated through.
Did i understand it correctly?

[elafakceramicmagasin]

hi greg we need a road map for sql or at least some course suggestions, or a tutorial from you will be great

[pratugames]

Please make a video on how to train voice model stem by step in pycharm, please sir make video on this

[anwerhassan]

thank you very much, but how can I print the result from the model and visualization the actual data and prediction data

[wryltxw]

Is there a way to see what you have already included in the pipeline?

[koji]

Could you make a review on HyperSkill Python course. I’ve heard it’s very good but not sure.

[wryltxw]

may be PyTorch also has something like this? is it very different?

[wryltxw]

doesn't cache simply mean, take that data and put it in local memory for reuse again? not sure what point I am missing.

[wryltxw]

it seems like a really unintuitive way to create a pipeline. wouldn't it be better to create a list of first class functions, where each function within the list does a step in the pipeline.