What Are Word and Sentence Embeddings?

This video is part of LLM University

Sentence and word embeddings are the bread and butter of language models. Here is a very simple introduction to what they are by Luis Serrano.

Bio:
Luis Serrano is the lead of developer relations at Co:here. Previously he has been a research scientist and an educator in machine learning and quantum computing. Luis did his PhD in mathematics at the University of Michigan, before embarking to Silicon Valley to work at several companies like Google and Apple. Luis is the author of the Amazon best-seller "Grokking Machine Learning", where he explains machine learning in a clear and concise way, and he is the creator of the educational YouTube channel "Serrano.Academy", with over 100K subscribers and 5M views.

===
Resources:

[carlosperezcpe]

Hey thanks for the video, im looking to do this exercise with around 13k to 15k news articles. Is there an efficient way of doing it with cohere?

[nguyenvinh]

I can understand word embedding as the process of passing the digital form of the word through the embedding network to get the word embedding. But is sentence embedding a combination of word embedding?

[wryltxw]

If one is given embeddings, can one go ahead and use those embeddings for any NLP model?

[RaviShamihoke]

Does this mean, we can start the process in say, Swahili and then convert to English, so as not to lose the particular characteristics of Swahili which happens when one starts with English?

[wryltxw]

curious, how are the embeddings actually calculated?

[bastabey]

i assumed if world cup is in qatar, it makes sense to add arabic translation unless there are issues in arabic support