Module 7- Python1- Unlock the Power of Custom Transformers (IMDB Text Classification in TensorFlow)!

Relevant playlists:

Instructor: Pedram Jahangiry

All of the slides and notebooks used in this series are available on my GitHub page, so you can follow along and experiment with the code on your own.

Lecture Outline:
0:00 Roadmap and recap, where to find the materials
1:43 Custom Transformer approach vs Hugging face
5:22 Building Transformers with TensorFlow subclassing
8:51 Positional embedding class
14:14 Multi-head attention class
31:26 Transformer block class
36:10 Defining the model
40:35 Applying our custom make transformer encoder to the IMDB review data set

[malakbayoumy]

Thank you so much for your effort. Can you please tell me if the videos for module 7 & 8 are coming anytime soon? 🙏

[fayezalhussein]

thank you so much professor, could you do vision transformer in the same way, please?