CS-421 Machine Learning Lecture# 5 (System of Linear Equations)

This lecture describes the system of linear equations: cases where the system is underdetermined, overdetermined and exact. What are the least-squares and minimum least-squares cases for the underdetermined and the overdetermined cases? The course will eventually explain the fundamentals of deep learning. In doing so, we will be going through the topics of multivariable calculus, probability, and optimization.
Learning Outcomes:
By the end of this lecture, students should be able to:
1) Define the system of linear equations with their geometric representation.
2) Differentiate between underdetermined, overdetermined and the exact system of linear equations.
3) Describe the Least Squares solution with its geometric interpretation.