filmov
tv
Inside GPT – Large Language Models Demystified • Alan Smith • GOTO 2024
Показать описание
This presentation was recorded at GOTO Amsterdam 2024. #GOTOcon #GOTOams
Alan Smith - AI Developer, Trainer, Mentor & Evangelist at Active Solution @CloudCastsAlanSmith
RESOURCES
ABSTRACT
Natural language processing using generative pre-trained transformers (GPT) algorithms is a rapidly evolving field that offers many opportunities and challenges for application developers. But what is a generative pre-trained transformer, and how does it work? How can you leverage the latest advances in GPT algorithms to create engaging and useful applications? Can my business benefit from creating a GPT powered chat bot?
In this demo intensive session Alan will take a deep dive into the architecture of GPT algorithms and the inner workings of ChatGPT. The journey will begin by looking at the fundamental concepts of natural language processing, such as word embedding, vectorization and tokenization. He will then demonstrate how you can apply these techniques to train a GPT2 model that can generate song lyrics, showing the internals of how word sequences are predicted.
Alan will then shift the focus to larger language models, such as ChatGPT and GPT4, demonstrating their power, capabilities, and limitations. The use of hyperparameters such as temperature and frequency penalty will be explained and their effect on the generated output demonstrated.
Join me for this session if you want to learn how to harness the power of GPT algorithms in your own solutions. [...]
TIMECODES
00:00 Intro
01:59 GPT sequence prediction
03:48 Prompt engineering
04:45 Demo: ChatGPT2
10:45 Processing text
19:27 Demo: Word2Vec dimensionality reduction
21:07 Transformer architecture
23:58 Demo: GPT2 input embedding
27:00 Self attention
31:08 Demo: GPT2 multi-head attention
32:52 Attention example
33:49 Demo: GPT2 next token prediction
44:06 Parameters
46:21 Thanks for explanations & inspiration
46:57 Outro
Read the full abstract here:
RECOMMENDED BOOKS
#LLM #LargeLanguageModel #LimitationsOfLLMs #InsideGPT #GPT #GPT4 #GPT2 #GenAI #AI #GenerativeAI #CUDA #CommonCrawl #LSTMs #AlanSmith
Looking for a unique learning experience?
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
Alan Smith - AI Developer, Trainer, Mentor & Evangelist at Active Solution @CloudCastsAlanSmith
RESOURCES
ABSTRACT
Natural language processing using generative pre-trained transformers (GPT) algorithms is a rapidly evolving field that offers many opportunities and challenges for application developers. But what is a generative pre-trained transformer, and how does it work? How can you leverage the latest advances in GPT algorithms to create engaging and useful applications? Can my business benefit from creating a GPT powered chat bot?
In this demo intensive session Alan will take a deep dive into the architecture of GPT algorithms and the inner workings of ChatGPT. The journey will begin by looking at the fundamental concepts of natural language processing, such as word embedding, vectorization and tokenization. He will then demonstrate how you can apply these techniques to train a GPT2 model that can generate song lyrics, showing the internals of how word sequences are predicted.
Alan will then shift the focus to larger language models, such as ChatGPT and GPT4, demonstrating their power, capabilities, and limitations. The use of hyperparameters such as temperature and frequency penalty will be explained and their effect on the generated output demonstrated.
Join me for this session if you want to learn how to harness the power of GPT algorithms in your own solutions. [...]
TIMECODES
00:00 Intro
01:59 GPT sequence prediction
03:48 Prompt engineering
04:45 Demo: ChatGPT2
10:45 Processing text
19:27 Demo: Word2Vec dimensionality reduction
21:07 Transformer architecture
23:58 Demo: GPT2 input embedding
27:00 Self attention
31:08 Demo: GPT2 multi-head attention
32:52 Attention example
33:49 Demo: GPT2 next token prediction
44:06 Parameters
46:21 Thanks for explanations & inspiration
46:57 Outro
Read the full abstract here:
RECOMMENDED BOOKS
#LLM #LargeLanguageModel #LimitationsOfLLMs #InsideGPT #GPT #GPT4 #GPT2 #GenAI #AI #GenerativeAI #CUDA #CommonCrawl #LSTMs #AlanSmith
Looking for a unique learning experience?
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
0:47:21
Inside GPT – Large Language Models Demystified • Alan Smith • GOTO 2024
1:00:22
Inside GPT – Large Language Models Demystified - Alan Smith - NDC Oslo 2024
0:27:14
How large language models work, a visual intro to transformers | Chapter 5, Deep Learning
1:02:52
Inside GPT – Large Language Models Demystified
0:53:08
Inside GPT – Large Language Models Demystified
0:07:54
How ChatGPT Works Technically | ChatGPT Architecture
0:08:25
Large Language Models from scratch
0:09:11
Transformers, explained: Understand the model behind GPT, BERT, and T5
0:53:11
Alan Smith - Inside GPT: Large Language Models Demystified
1:56:20
Let's build GPT: from scratch, in code, spelled out.
0:53:52
GPT-4 - How does it work, and how do I build apps with it? - CS50 Tech Talk
0:23:45
Microsoft Promises a 'Whale' for GPT-5, Anthropic Delves Inside a Model’s Mind and Altman ...
0:26:44
GPT-o1 - How Good Is It? (New Research Paper Tests Its Limits)
0:00:49
GPT-4o talking to GPT-4o
1:09:14
Mapping GPT revealed something strange...
0:05:50
What are Transformers (Machine Learning Model)?
0:11:17
Unlocking the Power of GPT-4: Exploring Large Language Models
0:15:48
AI achievements unlocked: Emergent abilities in large language models (GPT-3, GPT-4, PaLM, Gemini)
0:17:54
How Nvidia Grew From Gaming To A.I. Giant, Now Powering ChatGPT
0:24:02
Inside OpenAI, the Architect of ChatGPT, featuring Mira Murati | The Circuit with Emily Chang
0:08:55
How AIs, like ChatGPT, Learn
0:00:40
What GPT-4 Can Really Do
0:52:59
Using ChatGPT, GPT-4, & Large Language Models In the Enterprise
0:11:31
BREAKING: What's Inside GPT-5? New Report!
Комментарии