LLM Chronicles #5.3: Fine-tuning DistilBERT for Sentiment Analysis (Lab)

In this lab we'll see how to fine-tune DistilBERT for analyzing the sentiment of restaurant reviews. We'll look at how to do this from scratch, adding the specific layers for classification by hand. We'll conclude by looking at how to use the HuggingFace Transformers library for this.

🕤 Timestamps:
- 00:50 - Knowledge Distillation
- 02:15 - Restaurant Review Dataset
- 04:44 - PyTorch Dataset and Dataloader
- 09:40 - Fine-tuning DistilBERT for Classification Tasks
- 14:29 - Evaluation
- 18:30 - Freezing Weights of Base Model
- 20:00 - Using Hugging Face Transformers for Fine-Tuning (Trainer class)

References:

[MUHAMMADIFTIKHAR-xj]

A huge Love and big Thank You ! from Pakistan. I like your name Donato Capitella.

[sameersayyad]

One day you'll get your flowers sir!