Building a Text Summarizer with AI and Recursive Summarization | Unscripted Coding

preview_player
Показать описание
Token limits are really difficult to get around in this age of AI. They limit how much you can feed the models and as a result, it makes it really difficult to summarize longer texts that go over the limit. Last time we encountered this issue with GPT-3, we did a recursive summary, this time around, we try again with all the refinements expected from some experience.

Unscripted Coding is entirely unscripted and organic. If you're looking for a tutorial, you're in the wrong place! What we do here is try and build something from scratch, filled with all the mistakes and lessons learned along the way!

Total Time: 33 minutes
  1. Unscripted Coding
  2. open-ai
  3. openai
  4. gpt3
  5. gpt-3
  6. codex
Рекомендации по теме
How to Make 0:09:06

How to Make a Text Summarizer - Intro to Deep Learning #10

Build a Document 0:41:23

Build a Document Summarization App using LLM on CPU: No OpenAI ❌

Text Summarization by 1:07:16

Text Summarization by Fine Tuning Transformer Model | NLP | Hugging Face🤗

Building a Text 0:14:32

Building a Text Summarizer with AI and Recursive Summarization | Unscripted Coding

End To End 3:38:04

End To End NLP Project Implementation With Deployment Github Action- Text Summarization- Krish Naik

Building a Text 0:35:45

Building a Text Summarizer Flask App with SpaCy,NLTK,Gensim & Sumy

Create Text Summarizer 0:39:00

Create Text Summarizer with OpenAI GPT & React

Build an AI 0:08:01

Build an AI Text Summarizer using OpenAI GPT-3 with Mantium | No-Code

AI Text Summarization 0:09:44

AI Text Summarization with Hugging Face Transformers in 4 Lines of Python

How to summarize 0:05:46

How to summarize text using ChatGPT

Build a Text 0:11:21

Build a Text Summarizer in Java

Streamlit and txtai: 0:35:46

Streamlit and txtai: Building an Abstractive Summarization App in Python

Build a Summary 1:06:35

Build a Summary Generation Web App | NLP Project

NLP Tutorial 12 0:23:01

NLP Tutorial 12 - Text Summarization using NLP

Let's Build a 0:23:52

Let's Build a Text Summarizer from Scratch | Language Models | Transformer Networks | Joel Buny...

Automatic Text Summarization 0:11:48

Automatic Text Summarization with Gensim & Python

End to End 0:34:39

End to End Text Summarization Project using Flask and HuggingFace Pegasus Transformer

How to build 0:05:02

How to build a Text Summarizer in Python | Source Code included | kandi tutorial

NLP Projects | 0:03:11

NLP Projects | Text Summarization Using NLP | Auto Text Summary

Text Summarizer Using 0:19:36

Text Summarizer Using Python | NLTK Library in Python | Auto Text Summary Generator Using Python

How to Summarize 0:22:25

How to Summarize Text Using Python and Machine Learning

Text Summarization Using 0:04:04

Text Summarization Using AI (Jasper.ai Text Summarizer Tool)

AI text summarizer 0:20:21

AI text summarizer using Python Spacy | NLP Project with Python | Machine Learning

Summarize News Articles 0:25:47

Summarize News Articles with Machine Learning in Python

Комментарии
Автор

Thank you! Just as I was looking for a solution for that problem. Do you know if there is a AI Builder that lets you summarize page by page but has a UI so non coders can easily use it? I want to chunk a long pdf into pages and let it summarize each page to get a compaction factor of maybe 4 pages into 1.

I just saw your code. This works for relatively short articles. For long content like a pdf file or a book with hundreds of chunks, your code will lead to a token explosion and run up quite the API costs. Not recommended. Instead it is more recommended to send an overlapping content. So chunk 2 contains the last 20% of chunk 1, in order to give the AI more context. This way your overall costs is only +20% higher than having no overlap, and not exponentially growing like using your method.

HideBuz