filmov
tv
Stanford Seminar - Towards Safe and Efficient Learning in the Physical World
Показать описание
April 5, 2024
Andreas Krause of ETH Zurich
How can we enable agents to efficiently and safely learn online, from interaction with the real world? I will first present safe Bayesian optimization, where we quantify uncertainty in the unknown objective and constraints, and, under some regularity conditions, can guarantee both safety and convergence to a natural notion of reachable optimum. I will then consider Bayesian model-based deep reinforcement learning, where we use the epistemic uncertainty in the world model to guide exploration while ensuring safety. Lastly I will discuss how we can meta-learn flexible probabilistic models from related tasks and simulations, and demonstrate our approaches on real-world applications, such as robotics tasks and tuning the SwissFEL Free Electron Laser.
Andreas Krause of ETH Zurich
How can we enable agents to efficiently and safely learn online, from interaction with the real world? I will first present safe Bayesian optimization, where we quantify uncertainty in the unknown objective and constraints, and, under some regularity conditions, can guarantee both safety and convergence to a natural notion of reachable optimum. I will then consider Bayesian model-based deep reinforcement learning, where we use the epistemic uncertainty in the world model to guide exploration while ensuring safety. Lastly I will discuss how we can meta-learn flexible probabilistic models from related tasks and simulations, and demonstrate our approaches on real-world applications, such as robotics tasks and tuning the SwissFEL Free Electron Laser.
0:45:33
0:48:35
0:48:38
0:57:54
0:25:51
1:05:52
1:14:27
0:26:26
0:55:25
0:58:05
0:58:25
0:51:00
0:28:07
0:45:08
0:46:12
0:57:23
0:02:52
0:52:49
0:59:12
0:48:36
1:26:37
0:58:24
0:53:46
0:02:52