MA203, Lecture no 37, Stochastic Processes-5.0 ( Markov Chain) by Tapas Chatterjee, IIT Ropar

This is a lecture note for the course MA203 (Probability theory and stochastic processes) which got cancel due to COVID-19. This is the 13th online lecture note for the above course. In this lecture, we will continue our study on the Poisson Process. We will discuss the fundamental stochastic process called a simple random walk. Then we will define the discrete time Markov Chain, transition probabilities and the matrix associated with these probabilities.