RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning
Google DeepMind9 HN recommenders · recommended in 9 months, 2017-2026
1.9M views · 11 years ago · course · evergreen
The first lecture of David Silver's reinforcement learning course, introducing the field and its basic concepts. The course follows the Sutton and Barto textbook.
Frequently recommended as an excellent, clear introductory RL course from the lead of AlphaGo, pairing well with Sutton and Barto.
1:08:40Lecture 1 | Machine Learning (Stanford)
Stanford
2.7M views • 18 years ago
1:21:28Lecture 01 - The Learning Problem
caltech
1.5M views • 14 years ago
17:52Training AI Without Writing A Reward Function, with Reward Modelling
Robert Miles AI Safety
259K views • 6 years ago
2:25:52The spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
4.4M views • 4 years ago
1:03:32John Schulman - Reinforcement Learning from Human Feedback: Progress and Challenges
UC Berkeley EECS
88K views • 3 years ago
1:19:08CS231n Winter 2016: Lecture1: Introduction and Historical Context
Andrej Karpathy
462K views • 10 years ago
1:11:41Lecture 1 | Natural Language Processing with Deep Learning
Stanford University School of Engineering
820K views • 9 years ago
57:57Lecture 1 | Introduction to Convolutional Neural Networks for Visual Recognition
Stanford University School of Engineering
2.9M views • 9 years ago
1:22:56Practical Deep Learning for Coders: Lesson 1
Jeremy Howard
610K views • 4 years ago
1:01:51Lecture 1: Introduction to Information Theory
Jakob Foerster
411K views • 12 years ago
10:18Backpropagation calculus | Deep Learning Chapter 4
3Blue1Brown
4M views • 9 years ago
12:47Backpropagation, intuitively | Deep Learning Chapter 3
3Blue1Brown
6.4M views • 9 years ago
1:05:18Recent Developments in Deep Learning
Google TechTalks
85K views • 16 years ago
20:33Gradient descent, how neural networks learn | Deep Learning Chapter 2
3Blue1Brown
9.7M views • 9 years ago
3:07Neural Networks Demystified [Part 1: Data and Architecture]
Welch Labs
838K views • 12 years ago
1:20:33Lecture 1 | Convex Optimization I (Stanford)
Stanford
753K views • 18 years ago
1:22:38CS480/680 Lecture 19: Attention and Transformer Networks
Pascal Poupart
374K views • 7 years ago
20:41Training an unbeatable AI in Trackmania
Yosh
17.7M views • 3 years ago
59:48[1hr Talk] Intro to Large Language Models
Andrej Karpathy
4.3M views • 2 years ago
1:07:09Richard Sutton – Father of RL thinks LLMs are a dead end
Dwarkesh Patel
804K views • 1 year ago
11 comments from Hacker News
Not "A Man Behind AlphaGo..." but rather "The Man Behind AlphaGo..." On David Silver's Ineffable Intelligence startup and their $1 Billion (!) seed round (!!) His RL lectures [1] are quite popular [2] [1] link [2] ▶ this video
This papers assumes that you know quite a bit about RL already. If you really want to dig into RL, this intro course from David Silver (Deep Mind) is excellent: ▶ this video
I would start with David Silvers (DeepMind) youtube series to get an idea of what's possible or not. Running an already trained reinforcement learning agent is relatively cheap (unless your model is massive). I suspect the reason people aren't using it yet is because it's a) really difficult to get right in training, even basic convergence is not guaranteed without careful tuning b) really difficult to guarantee reasonable behavior outside of the scenarios you're able to reach in QA. edit: Link to lecture series ▶ this video
I almost knew exactly who it was going to be when they mentioned AlphaGo Developer. For those who aren't that well versed in RL, I recommend watching his lectures at UCL ( ▶ this video ). Really clear explanations that went hand in hand when I was reading Sutton and Barto's introductory book.
I also recommend interested people to watch David Silver's RL lectures at UCL on YouTube. He covers material from the book. ▶ this video
I came across this a few days ago: For Reinforcement Learning specifically, the standard text is Reinforcement Learning: An Introduction[1]. Dave's UCL Course on RL[2] is great too (playlist of all lectures)[3]. Source: Julian Schrittwieser works on Deepmind at Google link [1] link [2] link [3] ▶ this video
The notions of agent, environment and reward are encountered in Reinforcement Learning which is a sub-field of ML but also relevant to biological agents. There is a great RL course on YouTube by David Silver (one of the creators of AlphaGo, which is probably the most famous application of RL so far). ▶ this video The course can properly set the perspective of RL and shed new light on the philosophy of mind, if you take what it says and then extrapolate to humans and other agents. What I find fascinating about RL is that it can be defined concretely. Consciousness can only be defined by reference to other words, in a less exact and concrete way. RL can also explain how meaning appears, based on future reward prediction. The rich sensations we have can be explained by an encoding-decoding architecture based on reconstruction error. Many difficulties in RL map back to difficulties humans have in choosing how to act - the exploration-exploitation tradeoff, instinct vs reason (two different ways to perform RL, one based purely on rewards and the other based on an internal model of the world and rewards). Some of the problems related to multi-agent RL are also covered in Game Theory, such as the prisoner's dilemma. Regarding philosophy of language: we have today numerical representations of meaning in words and phrases. They are usually represented as vectors in high dimensional space or sets of vectors. For example it is customary to use 300-1000 dimensions for representing words. Thes
As someone who is doing his bachelor thesis on Reinforcement Learning this is some useful information. OT (but not really) question: does anyone here use Reinforcement Learning techniques at work? For the thesis I am working on black-box optimization of 2 variable functions with Reinforcement Learning (and comparing it with Bayesian Optimization techniques). As someone else suggested the Sutton & Barto book is really great knowledge but I would also like to suggest these lessons ( ▶ this video ) by David Silver (who worked on AlphaGo)
fast.ai Making neural nets uncool again. fast.ai is dedicated to making the power of deep learning accessible to all.[0] Udacity. Intro to Machine Learning: Pattern Recognition for Fun and Profit[1] MIT 6.S099: Artificial General Intelligence[2] Lecture Series on Artificial Intelligence by Prof. P. Dasgupta, Department of Computer Science & Engineering, Indian Institute of Technology, Kharagpur[3] DeepMind. Reinforcement Learning Course by David Silver[4] Stanford Winter Quarter 2016 class: CS231n: Convolutional Neural Networks for Visual Recognition.[5] [0] link [1] link [2] link [3] link [4] ▶ this video [5] link
You can check this Reinforcement Learning Course by David Silver on YouTube: ▶ this video By the way, I believe David Silver was the lead programmer for AlphaZero.
Sutton & Barto's Reinforment Learning complete this triumvirate link David Silver's Reinforcement Course is based on Sutton & Barto ▶ this video