Natural Language Processing|Lemmatization

In this video we will understand the detailed explanation of Lemmatization and understand how it can be used in Natural Language Processing. We will also see the basic difference between Lemmatization and stemming.

[suryakantkashyap]

For a minute, I was reading the awesome speech by Kalam sir.

[harish]

Really love the way you explain these concepts with small practical exercises. I have just started your NLP playlist. I don't think I have seen anyone explain these concepts better than you have. A big 👍 to you Krish for such wonderful tutorials.

[m.sivaramtej]

00:05 Lemmatization is a technique used in Natural Language Processing
01:25 Lemmatization is similar to stemming but the intermediate representation or the root form has a meaning.
02:54 Importing NLTK library for text pre-processing in NLP
04:21 Performing Lemmatization using WordNetLemmatizer
05:46 Lemmatization is similar to stemming but with a small difference
07:09 The process involves removing stop words and performing lemmatization on the remaining words.
08:42 Lemmatization converts words into meaningful representations, while stemming does not.
10:03 The main difference between lemmatization and stemming is that lemmatization considers the meaning of the word.

[FernandoFlores-bvux]

Truly amanzed by the way you explain these concepts 🤗🤗

[rahuldey]

6:05 Index - 5, why 'We grabbed land' wasn't converted to 'We grab land'? The lemmatizer is supposed to lemmatize the words in their root form right?

[sumantadas]

Awesome tutorials.. keep up Your good work .. 😍

[GwinnettRaj]

Simply love the way you explain concepts. Can you please make a video tutorial on building a chatbot using NLP or Deep Learning! I couldn't find one in your playlist.

[laxminarasimhaduggaraju]

Sir,
We r very thankful to u for the way u explains and can u do some more on text preprocessing like ALD, removing special characters, white spaces, named entity's all others stuff related to preprocessing

[kavibharathi]

Really super explaination...hat off you

[TheRohan]

The tutorials are really good and well explained.
Could you by any chance add the Stanford article link in the description. Thank you.

[billyerickson]

🎯 Key Takeaways for quick navigation:

00:00 🚀 *Introduction to Stemming in NLP*
- Stemming process using the Porter Stemmer and NLTK library.
- Importing libraries for stemming and stop words.
- Explanation of the need for stop words in text processing.
02:56 🛑 *Stop Words and their Removal*
- Identification of common stop words like "the, " "and, " "of" in the paragraph.
- Importance of removing stop words for sentiment analysis.
- Application of NLTK's stop words library to filter out irrelevant words.
05:53 🔄 *Stemming Implementation*
- Initialization of Porter Stemmer object for stemming.
- Iterative process of tokenizing, removing stop words, and stemming for each sentence.
- Demonstration of stemming on words like "history" and "people."
08:22 ⚠️ *Issues with Stemming*
- Discussion on the problem of stemming creating words with no clear meaning.
- Examples of words losing meaningful representation after stemming.
- Introduction to an alternative stemming technique, "Lemmatization."

Made with HARPA AI

[louismefor]

Thanks alot for this, i now understand NLP better, can you make a tutorial on creating a chat bot with this?, i will try my best to spread the word on this channel, you are indeed a great guru

[siddalingeshwaram.v]

Awesome video.... thank you Krish Naik

[bhushanekbote]

Krish here you have not lemmatized the stemmed words but you have lemmatized the original paragraph.
You basically just removed the stopwords from paragraph. You should have done lemmatization on stemmed paragraph... But very nice explanation gratefull thankyou

[MultiAllin]

Does Lemmatization actually converts the meaningful word? Or keep them as it is? For e.g. history is as history only after Lemmatization

[NavnilDas-on]

Sir, no change is observed before and after lemmatization. What to do? I have tried with smaller passages as well but no change.

[shaikhshoeb]

On the thumbnail the length od video is larger but when I play videos its length is small
For this video thumbail shows 11:18 but when I play it show 6:23

[sanjaykulkarni]

Thank you very much for such tutorials, it has been really a great start for learning....one QQ: How do we avoid lemmatization of some words (some are key words, which we don't want to lemmatize, in stemming we can use regular expression to avoid/skip, but how can we do in lemmatization).

[nama]

Good channel. It is very helpful. I've subscribed your channel.

[facundofontana]

Krish one question, it wouldn't be recommended to lowercase the words, so stopwords like "I", "In", "It", "The" get removed too ?