#86 – David Silver: AlphaGo, AlphaZero, and Deep Reinforcement Learning

David Silver leads the reinforcement learning research group at
DeepMind and was lead researcher on AlphaGo, AlphaZero and
co-lead on AlphaStar, and MuZero and lot of important work in
reinforcement learning.


Support this podcast by signing up with these sponsors:
– MasterClass: https://masterclass.com/lex
– Cash App – use code “LexPodcast” and download:
– Cash App (App Store): https://apple.co/2sPrUHe
– Cash App (Google Play): https://bit.ly/2MlvP5w


EPISODE LINKS:
Reinforcement learning (book): https://amzn.to/2Jwp5zG


This conversation is part of the Artificial Intelligence
podcast. If you would like to get more information
about this podcast go to https://lexfridman.com/ai or connect
with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or
YouTube where you can watch the video versions of these
conversations. If you enjoy the podcast, please rate it 5 stars
on Apple Podcasts, follow on Spotify, or support it on Patreon.


Here’s the outline of the episode. On some podcast players you
should be able to click the timestamp to jump to that time.


OUTLINE:
00:00 – Introduction
04:09 – First program
11:11 – AlphaGo
21:42 – Rule of the game of Go
25:37 – Reinforcement learning: personal journey
30:15 – What is reinforcement learning?
43:51 – AlphaGo (continued)
53:40 – Supervised learning and self play in AlphaGo
1:06:12 – Lee Sedol retirement from Go play
1:08:57 – Garry Kasparov
1:14:10 – Alpha Zero and self play
1:31:29 – Creativity in AlphaZero
1:35:21 – AlphaZero applications
1:37:59 – Reward functions
1:40:51 – Meaning of life