supervised learning

Andrew Ng presents unsupervised feature learning and deep learning, showing how algorithms can learn representations from unlabeled data instead of hand-designed features. He gives examples in vision and audio, including visualizations of features learned by successive layers.

Valve's John McDonald presents at GDC 2018 on how Valve uses deep learning (VACnet) to detect cheaters in Counter-Strike: Global Offensive. He covers training on human-reviewed replays and how model output is confirmed by manual review.

A GDC 2018 talk by Valve's John McDonald on VACNet, a deep learning system that analyzes CS:GO gameplay to detect cheaters. It covers how the model is trained on human-reviewed Overwatch cases and how its output feeds human moderation.

Max Tegmark's MIT CBMM talk on why deep learning works so well. He argues that the laws of physics and the symmetries in physical data make it compressible into small neural networks, tying physics to network structure.

Geoff Hinton's 2010 Google Tech Talk on deep belief networks, learning layers of representation one at a time from unlabeled data, and extending them with multiplicative interactions.

Ali Rahimi accepts the NIPS 2017 Test of Time Award and argues that machine learning has become alchemy, with practice running ahead of understanding.

Veritasium's Derek Muller gives a Perimeter Institute livestream on how AI might change teaching and learning. He draws on past technology shifts and cognitive science to argue that learning requires effortful repetition.

Geoffrey Hinton's Google Tech Talk linking machine learning to biology, explaining dropout as a form of model averaging and why sexual reproduction and stochastic spiking neurons may prevent overfitting.

Chris Lonsdale presents a TEDx talk on how adults can learn a language in about six months, centering on immersion, comprehensible input and a practical learning methodology.

Ali Rahimi's NIPS 2017 Test-of-Time award talk, in which he argues that modern machine learning has become alchemy, working without being rigorously understood. He calls for more rigor and understanding in the field.

Bill Dally of NVIDIA gives a Hot Chips 2023 keynote on the challenges of building hardware for deep learning. He traces how GPUs have been adapted for machine learning, especially training.

Chris Lattner and Brennan Saeta present Swift for TensorFlow at the TensorFlow Dev Summit 2019, covering language-integrated automatic differentiation and tooling for machine learning in Swift.

Sal Khan of Khan Academy argues that schools push students forward with gaps in their foundations, and that students should instead master concepts at their own pace. He compares it to building a house on an unfinished foundation.

Kathy Sierra's Fluent 2015 keynote on the one metaskill for developers: the ability to come up to speed quickly and stay there. She covers how people learn, cognitive resources versus willpower, and building skill.

UC Berkeley EECS colloquium by OpenAI's John Schulman on reinforcement learning from human feedback. He covers why RL helps with truthfulness, hallucination, and the limits of behavior cloning.

Joseph Henrich's Talks at Google presentation of his book. He argues that human success comes from collective brains and cultural learning across generations rather than individual intelligence.

James Mickens's humorous USENIX Security keynote argues that improving security and trusting opaque technology like machine learning is far harder than the industry admits.

Media Molecule's Alex Evans recounts the journey, including the failures, of finding the Dreams engine, based on his Siggraph 2015 talk. It covers the signed-distance-field and splat-based rendering approach and the artistic goals behind it.

Mike Rowe, host of Dirty Jobs, shares stories from messy real-world jobs in this TED talk. He argues that hard work has been unjustly degraded in society.

Salman Khan's TED 2011 talk on Khan Academy. He shows that it goes beyond video lectures to self-paced practice and analytics for teachers, and argues for filling gaps in understanding.

Simon Knowles, co-founder and CTO of Graphcore, talks about "intelligence processors", chips designed specifically for machine learning. The talk was given at the RAAIS 2017 summit and covers Graphcore's architecture.

Alan Kay's TED talk on teaching ideas, in which he argues the world is not what it seems and shows children learning through programming and building their own lessons with Etoys/Squeak.

Luis von Ahn, creator of CAPTCHA and reCAPTCHA, presents Duolingo at TEDxCMU 2011. The idea is to have millions of people translate the web for free while learning a language, an example of human computation.

Jose Valim introduces Nx, the project bringing numerical computing to Elixir, covering multi-dimensional tensors, automatic differentiation and JIT compilation to CPU and GPU.

Jonathan Blow gives a roughly 90-minute talk, followed by Q&A, on how video games could actually improve education, in contrast to what is currently being tried.

Mobileye co-founder and CTO Amnon Shashua explains what goes into sensing for autonomous driving and whether end-to-end deep learning can work for it. He argues for decomposing the problem.

Aaron Hsu explains why programmers often find APL harder to learn than people with no programming background. He identifies eight patterns that contrast traditional software engineering practice with APL practice, starting from Ken Iverson's language design principles.

Joel Spolsky's 2009 Google Tech Talk on why StackOverflow was built, how it addresses the mess of searching for programming help, and the community design behind it. He also takes jabs at paywalled answer sites.

David Ditzel of Esperanto Technologies presents their massively parallel, energy-efficient RISC-V processors at the 7th RISC-V Workshop in 2017. It covers the high-performance many-core design aimed at machine learning.

A full upload of Alan Kay's 1987 talk, with demos of several Smalltalk-era software systems and ideas about visual, kinesthetic and symbolic reasoning. It includes a Smalltalk program written by a 12-year-old and footage of the Rand tablet.

Andrej Karpathy, then Tesla's head of AI, presents at ScaledML 2020 on how Tesla builds full self-driving using vision-based neural nets and fleet data collection. He covers training custom detectors and neural nets gradually replacing traditional code.

Josh Kaufman's TEDx talk argues that you can reach practical competence in almost any skill with about 20 hours of focused practice, rather than the 10,000 hours often quoted. He describes how becoming a parent led him to rethink how adults learn, and lays out a short method for rapid skill acquisition.

Eduardo Briceno gives a TEDx talk on mindset, contrasting fixed and growth views of ability. He argues that believing abilities can be developed encourages challenge, deliberate practice and grit.

Bassist Victor Wooten argues that music should be learned the way children learn their first language: by immersion and play, without early correction or rigid academic instruction. He draws on how babies pick up speech from the people around them.

George Hotz of Comma AI gives a 2017 conference talk on lessons from building a self-driving system. He argues about how driving should be defined and why the common approach to autonomous vehicles is flawed.

Raymond Hettinger's PyBay 2019 talk on the mental habits behind effective programming, drawn from coaching, teaching and StackOverflow. He covers problem decomposition, chunking, managing working memory and getting unstuck.

Peter Norvig's 2007 Google talk on theorizing from data, covering what huge datasets can do for language understanding, translation, information extraction and inference. It argues that more data often beats cleverer models.

Alan Kay argues for rethinking how computer science is taught in schools, drawing on his work on object-oriented programming and GUIs. He discusses how poorly people understand complex systems and what education could do about it.

Peter Norvig, then Director of Research at Google, talks at Startup School 2008 about leveraging large amounts of data and about technical challenges in Google projects such as image search. A central idea is that data can beat hand-written programming.

Chris Stucchio presents the ethical principles behind algorithmic decision making and shows with examples from lending, criminology and education that they cannot all be satisfied at once. The talk frames AI fairness as a set of quantitative tradeoffs.