Intro to AI Day 5: Learning Rate Schedulers and Optimizers in Neural Networks

In this main session of "Introduction to AI: Neural Nets, LLMs, and Gen AI" course, we cover the following:
- Learning rate schedulers and,
- Optimizers that help neural networks learn efficiently.