Intro to Markov Chains & Transition Diagrams

Markov Chains or Markov Processes are an extremely powerful tool from probability and statistics. They represent a statistical process that happens over and over again, where we try to predict the future state of a system. A markov process is one where the probability of the future ONLY depends on the present state, and ignores the past entirely. This might seem like a big restriction, but what we gain is a lot of power in our computations. We will see how to come up with transition diagram to describe the probabilities of shifting between different states, and then do an example where we use a tree diagram to compute the probabilities two stages into the future. We finish with an example looking at bull and bear weeks in the stock market.

Coming Soon: The follow up video covers using a Transition Matrix to easily compute probabilities multiple states in the future.

0:00 Markov Example
2:04 Definition
3:02 Non-Markov Example
4:06 Transition Diagram
5:27 Stock Market Example

COURSE PLAYLISTS:

OTHER PLAYLISTS:
► Learning Math Series
►Cool Math Series:

BECOME A MEMBER:
Special thanks to Imaginary Fan members Frank Dearr & Cameron Lowes for supporting this video.

MATH BOOKS & MERCH I LOVE:

SOCIALS:

[Darkev]

The most thorough and clear explanation ever. Can't wait for the next video!

[SAAARC]

A subscription to your channel is the gift that keeps on giving.

[MrChinook]

Very well explained mate. Videos like these are a great into to a statistical topic and is a great foundation to dive deeper into the math behind it

[paulkaranja]

You just made my life better all the way in a small country found in Africa called Kenya. Thank you.

[bijanghofranian]

I was searching for "Wiener-Lévy process which is also a Markov process" but luckily I ended up here, a wonderful serendipity! Thanks for the simple and concise explanation Dr. Trefor.

[PrpleHatMan]

A very well presented and insightful lesson.
Thank you for the 2 part explanation!

[MrBitviper]

amazing explanation. you have a knack for making these difficult topics understandable
thank you so much for this

[imdadood]

Very clear explanation with easy examples. Thank you!

[mapmap]

one of the best explanations about Markov chains on youtube. thank you

[kaniki_the_problem]

You a natural. Thanks , preparing for Risk Modeling and Survival analysis actuarial exam

[thedigitalphysicist]

A simple explanation of something that could be very complexly understood. Thank you, Dr. Bazett

[joevanderstelt]

Subscribed to this channel after about 30 seconds.... amazing

[thepresistence]

Please don't go to MIT, Standford at all, be here. We need you.

[aqeelzeid]

I watched around 5 videos, this explained it the best !! thanks alot

[freedmoresidume]

Crystal clear explanation, thank you Dr.

[ipshitaghosh]

Rare moments.. when you understand in the first go.

[genuinebombayite]

This was such a wonderfully clear explanation. Thank you so much!

[byronwilliams]

Love your videos man, keep up the great work. You and Presh Talwalker are the best.

[catcen]

incredible video with a super clear explanation!

[camsasuncion]

I really appreciate the clarity of the explanation. I am now a subscriber and a fan! Thank you.