Automatic Summarization using Deep Learning | Abstractive Summarization with Pegasus

So you're tired of reading Emma too?

Pegasus is here to help. The Pegasus model is built using a Transformer Encoder-Decoder architecture and is ridiculously powerful when it comes to summarizing big blocks of text.

You can get started with it super quickly using the Transformers library from Hugging Face and Python. This Python tutorial will walk you through how to do it all from start to finish.

In this video, you'll learn how to:
1. Install Dependencies for Transformers in Python
2. Import and Configure the Pegasus X-Sum Model
3. Perform Abstractive Summarization on Wikipedia, News and Scientific Journals

Links:

Chapters:
0:00 - Start
2:56 - What you'll learn
4:09 - Tutorial Kickoff
4:42 - Install Dependencies
7:40 - Load Model and Tokenizer
11:53 - Perform Abstractive Summarization on Wikipedia Articles
17:36 - Results of Summarization
21:12 - Summarizing News Articles
22:52 - Summarizing Scientific Research

Oh, and don't forget to connect with me!

Happy coding!
Nick

P.s. Let me know how you go and drop a comment if you need a hand!

[priyamkakati]

Amazng content as usual! <3 Please continue sharing such content.

[TKollaKid]

I learned so much from this video. Liked and subscribed. Thank you, Nicholas!

[VladimirSkultetyOfficial]

Very good channel and videos. Thank you Nicholas!

[alexandregagne]

Like always, thank you. This channel is soooo good

[naitikshah]

Whoever is getting an error while creating the tokenizer in step 1, run this command on your terminal:
pip install sentencepiece

Great video Nicholas, thanks mate!

[Brian]

Really dope! I was looking for the turtorial to guide me through the summarization model and your video has extremely high quality and super practical!
I have a question that is abstractive summarization need to be fine-tuned? If so, how can we do it? :D

[ahmedalameldien]

hi nicholas, i really appreciate your video. thank you for this very informative video.
could you make another one of how to fine tuning a custom text dataset ?

[henkhbit]

Samenvattend, wederom een mooie introductie in NLP met de "vliegende paard" 👍

[arshdeepsingh]

love you sir must say your brain is awesome.

[trinitaroy]

Can you also show how do you fine tune the Pegasus model with a custom dataset for text summarization?

[pradhansomu]

Bro please make a video on creating custom dataset for pose estimation and which architecture will be best to train

[utkar]

Hey thanks man! I'm wondering is there is way we can create book summaries as well with one of these transformers?

[BS-obhp]

Hi Nicholas, thank you for your content here on youtube :)! I was just wondering if I can also use Preview or Stable, since LTS is not supported on a mac. Thanks!

[erfansthought]

How to make more than 1 sentence summary? It is possible to configure it to generate a summary of specified sentences like 10 sentence summary?

[swishrsplitr]

great video, thanks - are there any summarization models that accept more than 1k tokens as input?

[detour]

Just found you today...absolutely love your content and wide range of projects. I'm not a programmer but I'm looking to complete some projects very similar to what you've showcased in your videos. Are you available to hire?

[Manideep.]

when i import the model i am getting AttributeError: 'Version' object has no attribute 'major'

[soumyadeepnag]

Thanks for explaining the video nicely. But, does the pegasus model always generate one line of summary? Is there any way we can increase the number of summary lines?

[ryanw]

When companies build text summarization models like this one, do they create their own model and launch it for their app or do they generally use pre-existing models?

[mdrahatislamkhan]

cant install the torch. searched a lot but can't find the solution tried lots of things but got this error "No matching distribution found for torch" Please help me fix this problem.