Reinforcement Learning: Machine Learning Meets Control Theory

preview_player
Показать описание
Reinforcement learning is a powerful technique at the intersection of machine learning and control theory, and it is inspired by how biological systems learn to interact with their environment. In this video, we provide a high level overview of reinforcement learning, along with leading algorithms and impressive applications.

@eigensteve on Twitter

This video was produced at the University of Washington

%%% CHAPTERS %%%
0:00 Introduction
3:34 Reinforcement Learning Overview
7:30 Mathematics of Reinforcement Learning
12:32 Markov Decision Process
13:33 Credit Assignment Problem
15:38 Optimization Techniques for RL
18:54 Examples of Reinforcement Learning
21:50 Q-Learning
23:53 Hindsight Replay
Рекомендации по теме
Комментарии
Автор

Steve is a phenomenal lecturer, isn't he?

ronniec
Автор

This is THE BEST explanation on reinforcement learning over all the articles, books, or youtube videos, that I've seen so far. Period.

spin
Автор

Just wanted to comment about how much I love these videos. Last year while applying for PhDs I was searching for passions. In a discussion with my friend (a computer scientist), I accidentally outlined genetic programming without knowing it. My friend told me so and I went researching. Found these videos and became enthralled. Now I have a PhD studentship in soft robotics and plan to use SINDy to help with modelling and control and honestly think that giving machines brains may be my future work too. Thanks Brunton, my passion was helped by your own.

Globbo_The_Glob
Автор

I just cannot express how grateful I am to prof Steve Brunton for posting these videos. Waking up at 6am to watch him explain is the most satisfying thing ever. Thank you! We all are grateful.

baseljamal
Автор

Viewing reinforcement learning as time delayed supervised learning is a really good way of looking at it.

ethanspastlivestreams
Автор

Every time he said "good", i felt appreciated for not giving up on a lecture whose subject is far, far away from mine and im pushing myself to try and learn the concept. thank you, steve.. much love.!

subhikshaniyer
Автор

I wish i knew this channel at the start of quarantine

steven-btud
Автор

Would love for a full series on how can we use RL to control real world dynamical systems!

sankalp
Автор

As a CS grad student who took RL in the last semester ... this is truly the best refresher I have seen until now. Thanks a lot for uploading.

teegnas
Автор

I still have no idea as to who could possibly dislike these videos

christiankraghjespersen
Автор

Is there something you dont know dude? You seem to be an expert on everything. You are such an inspiration.

elultimopujilense
Автор

I love how you emphasize the intersection between machine learning and control (theory). That's exactely what sparks my interest about reinforcement learning!

Spiegeldondi
Автор

Mr.Brunton saves me from my final review. His lectures made crystal clear those seemingly unfathomable terms. Just watched him videos for days and I already like him!

spencerhong
Автор

This is an excellent lecture. It seems to me that each time an agent makes an observation(s), it computes the best action(a) to take, executes the action and the recieves the next state (s') . It is the agent that decides if this next state or configuration of the environment is a reward (r) or not. Take the example of a scientist in contact or interacting with the environment. It is the scientist/observer who decides if s' is a reward or not.

mbengiepeter
Автор

I've been seriously considering starting a degree in A.I./Machine learning but with videos of this quality available for free, it is hard to justify the cost. Subscribed and liked!

thelazygardener
Автор

I am binge watching this chanel from past 3 hours

souravjha
Автор

This sweet spot between control theory and machine learning definitely interests me, especially applied to astrodynamical systems. Please, continue making these videos, Professor Brunton!

thiagocesarlousadamarsola
Автор

Wow! I would love to see Prof take on RL topics!

wizardOfRobots
Автор

Great channel! Please record more videos on the edge of reinforcement learning and control theory. Congrats on your work.

sistemasecontroles
Автор

Dear Steve,

Im very, very grateful that I get to watch such extraordinary instructive videos for free!!! Thinking that elsewhere in the world people are killing others atm (as in Kabul), it gives me a lot of hope seeing how people like you just make the world a little better and allmost brings tears into my eyes. You have such great talent in teaching, thank you!

carlphilip