reward function
17:52Training AI Without Writing A Reward Function, with Reward Modelling
259K views • 6 years ago
Robert Miles AI Safety
Robert Miles explains reward modelling, in which an AI learns what humans want from their preference comparisons instead of a hand-written reward function. He walks through the 2017 paper on deep reinforcement learning from human preferences.
22:11But what is the Riemann zeta function? Visualizing analytic continuation
5.4M views • 9 years ago
3Blue1Brown
3Blue1Brown visualizes the Riemann zeta function and the analytic continuation that extends it beyond where its series converges, building toward the Riemann hypothesis.
41:44Numberphile v. Math: the truth about 1+2+3+...=-1/12
3.3M views • 8 years ago
Mathologer
Mathologer examines the infamous Numberphile claim that 1+2+3+... equals -1/12, explaining what is wrong with the calculation and how it connects to real math like the zeta function and analytic continuation.
14:34Visualization of Quantum Physics (Quantum Mechanics)
2.8M views • 9 years ago
udiprod
An animated visualization of basic quantum mechanics using a free particle, with simulations based on the actual equations. It covers waves, particles, and how measurement collapses the wavefunction.
20:33Gradient descent, how neural networks learn | Deep Learning Chapter 2
9.7M views • 9 years ago
3Blue1Brown
3Blue1Brown's second neural network chapter explains cost functions and gradient descent, showing how a network learns by minimizing error during training.
5:51This Is Your Brain On Stale Air
4.2M views • 7 years ago
Tom Scott
Tom Scott features Kurtis Baute inside a sealed homemade biodome as carbon dioxide builds up, showing how stale air with elevated CO2 affects cognitive function. Sources include studies on CO2 and cognitive scores.
5:24Diffie-Hellman Key Exchange
547K views • 14 years ago
Art of the Problem
A short Art of the Problem clip explaining Diffie-Hellman key exchange, using a paint mixing analogy for one-way functions and touching on modular arithmetic and discrete logarithms.
6:58The Skinner Box - How Games Condition People to Play More - Extra Credits
1.2M views • 14 years ago
Extra Credits
An Extra Credits episode on how games use Skinner box operant conditioning and reward schedules to keep players playing and spending. It argues for more immersive design mechanics than simple reward loops.
6:34Why Is It So Hard to Do Something That Should Be Easy? (Wall of Awful pt. 1)
2.1M views • 7 years ago
How to ADHD
A short How to ADHD explainer, featuring Brendan Mahan, on why simple tasks can feel impossible for people with ADHD. It introduces the 'wall of awful', a pile of past failures, shame and anxiety that builds up in front of a task and blocks starting it.
34:25Ramanujan: Making sense of 1+2+3+... = -1/12 and Co.
3.6M views • 10 years ago
Mathologer
Mathologer examines how identities like 1+2+3+... = -1/12 arise in Ramanujan's work, starting from his 1913 letter to Hardy. The video explains the rules for summing infinite series and why such results are meaningful but not naive sums.
7:39Propaganda Games: Sesame Credit - The True Danger of Gamification - Extra Credits
2M views • 10 years ago
Extra Credits
An Extra Credits episode on China's Sesame Credit, which gamifies obedient citizenship through a social score. It covers how the system rewards conformity and pressures people through their friends' behavior.
24:47But what is a Fourier series? From heat flow to drawing with circles | DE4
19M views • 7 years ago
3Blue1Brown
3Blue1Brown introduces Fourier series, from the heat equation to drawing arbitrary shapes with rotating circles. It builds a visual intuition for decomposing functions into sine waves.
7:38How We’re Fooled By Statistics
3.8M views • 12 years ago
Veritasium
A short Veritasium video explaining regression to the mean and how ignoring it leads to wrong conclusions about punishment versus reward, medical treatments and sports streaks. It uses the example of flight instructors who believed criticism works better than praise.