Transfer Learning for Text Classification Using Hugging Face Transformers Trainer | Deep Learning

Показать описание

Hugging Face provides three ways to fine-tune a pretrained text classification model: Tensorflow Keras, PyTorch, and transformer trainer. Transformer trainer is an API for feature-complete training in PyTorch without writing all the loops. This tutorial will use the transformer trainer to fine-tune a text classification model. We will talk about the following:

👉 How does transfer learning work?
👉 How to convert a pandas dataframe into a Hugging Face Dataset?
👉 How to tokenize text, load a pretrained model, set training arguments, and train a transfer learning model?
👉 How to make predictions and evaluate the model performance of a fine-tuned transfer learning model for text classification?
👉 How to save the model and re-load the model?

⏰ Timecodes ⏰
0:00 - Intro
00:52 - Step 0: Transfer Learning Algorithms
1:52 - Step 1: Install and Import Libraries
2:17 - Step 2: Download And Read Data
3:57 - Step 3: Train Test Split
4:25 - Step 4: Convert Pandas Dataframe to Hugging Face Dataset
5:41 - Step 5: Tokenize Text
9:13 - Step 6: Load Pretrained Model
9:45 - Step 7: Set Training Argument
11:42 - Step 8: Set Evaluation Metrics
12:10 - Step 9: Train Model Using Transformer Trainer
13:04 - Step 10: Make Predictions for Text Classification
14:40 - Step 11: Model Performance Evaluation
15:06 - Step 12: Save and Load Model

You will get full access to posts on Medium for $5 per month, and I will receive a portion of it. Thank you for your support!

📺 Videos mentioned in the video

🔥 Check out more machine learning tutorials on my website!

#transferlearning #finetuning #transformers #huggingface #grabngoinfo

Рекомендации по теме

Комментарии

You will get full access to posts on Medium for $5 per month, and I will receive a portion of it. Thank you for your support!

📺 Videos mentioned in the video

grabngoinfo

What does feature-complete training mean?

AnonymousIguana

Great work! Btw interested to know which text-to-speech software do you use?

sassydesi

Transfer Learning for Text Classification Using Hugging Face Transformers Trainer | Deep Learning

Transfer Learning for Text Classification Using Hugging Face Transformers Trainer | Deep Learning

Transfer Learning for Text Classification Using PyTorch | NLP | Machine Learning | Deep Learning

Transfer Learning - Transformer models code for Sequence (Text) classification

BERT: transfer learning for NLP

The Secret to 90%+ Accuracy in Text Classification

Jayeeta Putatunda, Transfer Learning With BERT: Building a Text Classification Model

Transfer Learning in NLP | Universal Language Models

Transfer Learning in Natural Language Processing (NLP) - PyCon SG 2019

NLP 2024 Lectures 10 (Transfer Learning)

Fine Tuning DistilBERT for Multiclass Text Classification | TensorFlow | NLP | Machine Learning

From Accuracy to Versatility: Analysing Text Classification Models regarding Transfer Learning

Transfer learning and Transformer models (ML Tech Talks)

Lecture 17: Text Classification

What is Transfer Learning? [Explained in 3 minutes]

BERT Text Classification for Everyone

TARS: Task-Aware Representation of Sentences for Generic Text Classification (NLP Paper Summary)

Tensorflow 2.0 Transfer Learning for NLP Task

Tutorial 2- Fine Tuning Pretrained Model On Custom Dataset Using 🤗 Transformer

Active Learning Based on Transfer Learning Techniques for Text Classification

Active Learning for Text Classification

Introduction to BERT: Text Classification

Tutorial 1-Transformer And Bert Implementation With Huggingface

TensorFlow London: Text classification with transformers in TensorFlow 2 by David Mráz

8. Text Classification Using Convolutional Neural Networks