RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning

Показать описание

#Reinforcement Learning Course by David Silver# Lecture 1: Introduction to Reinforcement Learning

Google DeepMind

Рекомендации по теме

Комментарии

Just finished lecture 10 and I've come back to write a review for anyone starting. *Excellent course*. Well paced, enough examples to provide a good intuition, and taught by someone who's leading the field in applying RL to games. Thank you David and Karolina for sharing these online.

jordanburgess

0:01 Outline
Admin 1:10
About Reinforcement Learning 6:13
The Reinforcement Learning problem 22:00
Inside an RL angent 57:00
Problems within Reinforcement Learning

zingg

1:10 Admin

6:13 About Reinforcement Learning
6:22 Sits in the intersection of many fields of science: solving decision making problem in these fields.
9:10 Branches of machine learning.
9:37 Characteristics of RL: no correct answer, delayed feedback, sequence matters, agent influences environment.
12:30 Example of RL

21:57 The Reinforcement Learning Problem
22:57 Reward
27:53 Sequential Decision Making. Action
29:36 Agent & Environment. Observation
33:52 History & State: stream of actions, observations & rewards.
37:13 Environment state
40:35 Agent State
42:00 Information State (Markov State). Contains all useful information from history.

51:13 Fully observable environment
52:26 Partially observable environment

57:04 Inside an RL Agent
58:42 Policy
59:51 Value Function: prediction of the expected future reward.
1:06:29 Model: transition model, reward model.
1:08:02 Maze example to explain these 3 key components.
1:10:53 Taxonomy of RL agents based on these 3 key components:
policy-based, value-based, actor critic (which combines both policy & values function), model-free, model-based

1:15:52 Problems within Reinforcement Learning.
1:16:14 Learning vs. Planning. partial known environment vs. fully known environment.
1:20:38 Exploration vs. Exploitation.
1:24:25 Prediction vs. Control.

1:26:42 Course Overview

zhongchuxiong

how lucky we are to have access to this kind of knowledge only with a button ! Thank you all in DeepMind public this course

nguyenduy-sbue

I love that David is one of the foremost minds in Reinforcement Learning, but he can explain it in ways that even a novice can understand.

tylersnard

what a wonderful time to be alive!!
thank god we have the opportunity to study a full module from one of the best unis in the world. taught by one of the leaders of its field

passerby

I am a simple man. I see a great course, I press like

socat

1:10 Admin
6:13 About Reinforcement Learning
21:57 The Reinforcement Learning Problem
57:04 Inside an RL Agent
1:15:52 Problems within Reinforcement Learning

NganVu

The complete set of 10 lectures is brilliant. David's an excellent teacher. Highly recommended!

tanmaygangwani

Just finished lecture 1 and can already tell this is going to be one of the absolute best courses 👌

eyeofhorus

Right now I am sitting in my pajamas in the comfort of my home, eating a peanut butter and jelly sandwich and I have the ability to watch an entire course about an advanced topic online for free. What a time to be alive

Dynamyalo

Wow, this is incredible. I'm currently going through Udacity and this lecture series blows their material from GT out of the water. Excellent examples, great explanation of theory, just wow. This actually helped me understand RL. THANK

ethanlyon

Mr. Silver covers in 90 minutes what most books do not in 99 pages. Cheers and thanks!

ShalabhBhatnagar-vnhe

Thank you so much for repeating the questions each time.

guupser

I am taking a Deep Learning course rn but seriously the comments here are motivating me to get into this one right away.

vipulsharma

This is a superb course on so many levels. Thank you

dbdg

I just finished the course, and the people in this comment section are not exaggerating. This is one of the best courses on Reinforcement learning. Thank you very much DeepMind, for making this free and available to everyone!

Abhi-wlyt

David is awesome at explaining a complex topic!. Great lecture. The examples really helped in understanding the concepts..

hbwcsxh

This is one of the clearest and most illuminating introductions I've watched on RL and its practical applications. Really looking forward to the following instalments.

tristanlouthrobins

For Me : David Silver is God ❤️ What a Man ! What an Explanation. One of the Greatest Minds who changed the Dynamics of RL in the past few years.Thanks Deep mind for uploading this Valuable course for free 🤍

rohitsaka

RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning

RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning

RL Course by David Silver - Lecture 3: Planning by Dynamic Programming

RL Course by David Silver - Lecture 2: Markov Decision Process

RL Course by David Silver - Lecture 4: Model-Free Prediction

RL Course by David Silver - Lecture 5: Model Free Control

RL Course by David Silver - Lecture 6: Value Function Approximation

RL Course by David Silver - Lecture 9: Exploration and Exploitation

RL Course by David Silver - Lecture 8: Integrating Learning and Planning

RL Course by David Silver - Lecture 7: Policy Gradient Methods

RL Course by David Silver - Lecture 10: Classic Games

RL Course by David Silver Lecture 1 Introduction to Reinforcement Learning

RL Course by David Silver Lecture 7 Policy Gradient Methods

RL Course by David Silver Lecture 4 Model Free Prediction

RL Course by David Silver Lecture 9 Exploration and Exploitation

RL Course by David Silver Lecture 1 Introduction to Reinforcement Learning

RL Course by David Silver Lecture 2 Markov Decision Process

RL Course by David Silver Lecture 2 Markov Decision Process

RL Course by David Silver Lecture 1 Introduction to Reinforcement Learning

RL Course by David Silver - Lecture 10: Classic Games [w/visible slides]

RL Course by David Silver Lecture 5 Model Free Control

RL Course by David Silver Lecture 5 Model Free Control 1

RL Course by David Silver Lecture 1 Introduction to Reinforcement Learning

RL Course by David Silver Lecture 4 Model Free Prediction

【Outline of RL】RL Course by David Silver Lecture 1 Introduction to Reinforcement Learning