Introduction to nanoGPT

Welcome, in this video we will learn about nanoGPT comprehensively.

### What we cover 1

- What is nanoGPT?
- Installation
- Training a Character-level GPT on Shakespeare
- Step 1. Prepare the Shakespeare dataset:
- Step 2. Train the GPT model:
- Step 3. Sample from the trained model:

### What we cover 2

- Reproducing GPT-2 124M
- Step 1. Prepare the OpenWebText dataset:
- Step 2. Train the GPT-2 124M model:
- Step 3. Sample from the trained model:

### What we cover 3
- Finetuning Pre-trained Models
- Step 1. Prepare the Shakespeare dataset:
- Step 2. Run the finetuning script:
- Step 3. Sample from the finetuned model:
- Sampling and Inference
- Efficiency and Troubleshooting