#86 – David Silver: AlphaGo, AlphaZero, and Deep Reinforcement Learning

David Silver leads the reinforcement learning research group at
DeepMind and was lead researcher on AlphaGo, AlphaZero and co-lead
on AlphaStar, and MuZero and lot of important work in reinforcement
learning. Support this podcast by signing up with these sponsors: -
MasterClass: https://masterclass.com/lex - Cash App - use code
"LexPodcast" and download: - Cash App (App Store):
https://apple.co/2sPrUHe - Cash App (Google Play):
https://bit.ly/2MlvP5w EPISODE LINKS: Reinforcement learning
(book): https://amzn.to/2Jwp5zG This conversation is part of the
Artificial Intelligence podcast. If you would like to get more
information about this podcast go to https://lexfridman.com/ai or
connect with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or
YouTube where you can watch the video versions of these
conversations. If you enjoy the podcast, please rate it 5 stars on
Apple Podcasts, follow on Spotify, or support it on Patreon. Here's
the outline of the episode. On some podcast players you should be
able to click the timestamp to jump to that time. OUTLINE: 00:00 -
Introduction 04:09 - First program 11:11 - AlphaGo 21:42 - Rule of
the game of Go 25:37 - Reinforcement learning: personal journey
30:15 - What is reinforcement learning? 43:51 - AlphaGo (continued)
53:40 - Supervised learning and self play in AlphaGo 1:06:12 - Lee
Sedol retirement from Go play 1:08:57 - Garry Kasparov 1:14:10 -
Alpha Zero and self play 1:31:29 - Creativity in AlphaZero 1:35:21
- AlphaZero applications 1:37:59 - Reward functions 1:40:51 -
Meaning of life