Long Document Summarization using Hugging Face Transformers | BERT, BART, DistilBART, T5, Pegasus

Link to the GitHub Gist:

Please subscribe my channel:

You can also follow me at my public social media accounts:

I am using the following gears for producing the contents:
#iPhone
#MacBook Pro
#Boya BYM1 Microphone

[yasminesmida]

If one chunk exceeds the maximum token length supported by the model, how can I solve it?

[yasminesmida]

Which model slm do you recommend for French and English summarization

[shyama]

Good content. Pls zoom your screen to full screen and see if you can upload high res videos. Its tough to read at times. Thanks.

[vinitkulal]

As input did u put a document or text?

[kbharathreddykancharla]

Hi sir please suggest me bench mark datasets for legal document summarization

[arpitsharma]

'utf-8' codec can't decode byte 0x92 in position 463: invalid start byte

I am getting this error while reading the text file

[suravighosal]

Can we find the accuracy of this transformer? Using a dataset?

[abhishekprakash]

i want to build a question and answering model, tranfor that work only factiod question, i want to generate long answering, how we do that

[PritManvar-bcvl]

TypeError Traceback (most recent call last)
in <module>
1 for input in inputs:
2 output = model.generate(**input)
----> 3 print(tokenizer.decode(*output, skip_special_tokens=False))

TypeError: decode() got multiple values for argument 'skip_special_tokens'


Getting this error while print(tokenizer.decode(*output, skip_special_tokens=True)), Can anyone help me?

[suryaeaty]

Hi, how to loop the filecontent lets say i have a df with column name as text where all the values of text column are input paragraphs to my model and i need summarizered output of all these

[ranjithkumarkarthic]

Hi, Do we use masked language modeling technique / NSP to retrain any pretrained model and do domain specific summarization on that?
If yes, please make one video on that or share any references here.

[aradinac]

Do you know how we can mention the length of the summarised document

[zqejhhb]

can u make video of multi document summarization using
bert model

[BinySD]

It is very interesting video. But how can train the model for other languages except English, Arabic or less resourced ones? Pls! let me know it...thank you!

[vipanpatial]

Can you make or share a video that how we can copy tables and words from pdf and make a model on that.

[dheerajr]

Is this extractive text summarisation or abstractive text summarisation

[dangeroussarcasm]

Can we summarise pdf files of books of like 100+ pages, eg. : Rich dad poor dad

[harshalparatwar]

It says len(sentences) = 1 how to solve this ?