What does it mean for computers to understand language? | LM1

An introduction to language modeling, followed by an explanation of the N-Gram language model!

The source code for the animations can be found here:

These animation in this video was made using 3blue1brown's library, manim:

Chapters
0:00 Introduction
1:39 What is NLP?
2:45 What is a Language Model?
4:38 N-Gram Language Model
7:20 Inference
9:18 Outro

Music (In Order):
GameChops - National Park
Helynt - Bo-omb Battlefield
Helynt - Undewater
Helynt - Route 10
Helynt - Twinleaf Town

Follow me!

[vcubingx]

If you enjoyed the video, please consider subscribing :)

I'm excited to be starting this new series! NLP is the topic I feel like I have the most to say about, but I'll avoid throwing in my personal opinions into these videos :p Stay tuned for the next chapter which I'll be posting next Monday!! (And the third chapter next to next week). Also, let me know what other kinds of topics you'd be interested in seeing!!!

[Randomstiontastic]

You uploaded this a minute after 3b1b’s video, how?

[artahir]

brother never stop making these videos
these are very interesting

[averagemilffan]

Great video!! I'm hoping you discuss some of the history in the next episodes too though

[johndewey]

Just came from 3B1B, subbed this is excellent. Thanks!

[dattatreyadas]

10:14 Brought to you by... 3Blue1Brown!!

[PiercingSight]

What timing for this video~

Looking forward to more!

[davidespinosa]

Just for general interest, here are a few examples of syntax vs semantics. Consider "The tree ate a banana". It's syntactically valid, but it doesn't mean anything. Or, "Is a dog conscious ?". It's also syntactically valid, but it doesn't mean anything until we decide what "conscious" means. Or, "Does the past still exist ?". It doesn't mean anything until we decide what "exist" means.

[chineduezeofor]

Found this by watching 3Blue1Brown

Awesome channel!

[cyanurecyanures]

Thanks a lot for the video ! Now I understood that Trigrams model just take into acount the last three words.

[Mayaaahhhh]

This is wonderful, excited for the next video!

Also nice choice of music :)

[stellastaraj]

Hi, love the video - just one thing, the C in the Probability equation throws me off. I keep reading it in my mind as "complement" - as in the complement of a set. I'm probably missing the right context for it. I can grasp from what you're saying that it probably signifies occurrences of the event, but uncertain why it's "c". Is it c for condition ?

[amirjutt]

You'll go up boi. Just put in the effort. Make the quality content. People are looking for quality content related to ML.

[tomoki-vo]

Still waiting for part 3 on neural networks

[AnmolSharma-ijut]

Dame bro it was too good i don't know about g gram

[skifast_takechances]

bro is basically alan turing at this point

[XxDoubleshotxX]

you should make a video on how to get girls

[MrWater]

Good one! I'll be waiting for the next one

[YoussefMohamed-erzy]

you know what chatgpt is unfortunately, the manifestation of the Chinese room paradox, and it is SO humorous that we are taking that much time to realize

[OBGynKenobi]

Computers "understand" languages in as far as they can compute statistics. But they don't really understand like humans do. For example can they understand the levels of meaning of poetry, or sarcasm, or cynicism?