image processing

A short conference talk from !!Con 2017 in which Kevin Chen explains the HDR imaging algorithm from a foundational paper, framing it as a system of linear equations, and implements it in a Microsoft Excel spreadsheet. No prior image processing knowledge is needed.

Andrew Adams, a Halide developer, presents the Halide language for image processing and tensor computation. The talk explains the separation of algorithm from schedule with illustrated examples of parallelism, locality and redundancy tradeoffs.

A 2006 Google TechTalk in which Luis von Ahn introduces human computation, using people's effort to solve problems like image recognition that computers cannot yet handle. It covers games with a purpose and related ideas such as CAPTCHAs.

Peter Norvig, then Director of Research at Google, talks at Startup School 2008 about leveraging large amounts of data and about technical challenges in Google projects such as image search. A central idea is that data can beat hand-written programming.

Jessie Frazelle's DockerCon SF 2015 talk on running Docker containers for desktop applications, with fun container hacks and images. It shows how far containers can be pushed beyond servers.

Berkeley neuroscientist Jack Gallant shows how fMRI brain mapping can be used to decode what a person sees, with visualizations of brain activity and its implications.

A full upload of Alan Kay's 1987 talk, with demos of several Smalltalk-era software systems and ideas about visual, kinesthetic and symbolic reasoning. It includes a Smalltalk program written by a 12-year-old and footage of the Rand tablet.

David Sachs of InvenSense explains how gyroscopes, accelerometers and compasses work on their own and together, demonstrated on a modified Android handset. He covers sensor fusion algorithms and why rotation math such as Euler angles matters.

Neuroscientist Anil Seth argues in this TED talk that perception is a controlled hallucination: the brain constantly predicts the world and our shared agreement is what we call reality. He also touches on the construction of the self.

Jim Keller's talk at the 2020 Scaled Machine Learning conference on Moore's Law in the age of AI chips. He compares scalar, vector and GPU-style parallel approaches to computation.

Andrew Ng presents unsupervised feature learning and deep learning, showing how algorithms can learn representations from unlabeled data instead of hand-designed features. He gives examples in vision and audio, including visualizations of features learned by successive layers.

Emily Shea explains how repetitive strain injury pushed her to program by voice using speech recognition (Talon), and gives a live coding demo. She argues voice-driven development can be pain-free, efficient and enjoyable.

Andrej Karpathy, then Tesla's head of AI, presents at ScaledML 2020 on how Tesla builds full self-driving using vision-based neural nets and fleet data collection. He covers training custom detectors and neural nets gradually replacing traditional code.

Luis von Ahn, creator of CAPTCHA and reCAPTCHA, explains how small contributions from many people online can digitize books. He then introduces Duolingo as a way to translate the web while people learn languages.

David MacKay's 2007 Google Tech Talk presents Dasher, a text-entry system driven by continuous gestures and a language model, reaching about 35 words per minute with one finger and 25 hands-free. It explains the information-theory reasoning behind the design.

Andrej Karpathy, then Tesla's head of AI, gives a CVPR 2021 workshop keynote on how Autopilot's neural networks work. A large part covers the move to a vision-only stack, including why radar was dropped and how vision produces depth estimates.

Peter Norvig's 2007 Google talk on theorizing from data, covering what huge datasets can do for language understanding, translation, information extraction and inference. It argues that more data often beats cleverer models.

A PyCon 2012 talk by Kurt Grandis on building an automated water-squirting turret that uses Python and computer vision to detect and drive off squirrels from a bird feeder.

Part 2 of the IROS 2011 keynote by Sebastian Thrun and Chris Urmson on Google's self-driving car. It shows how the car perceives its surroundings with a lidar point cloud and recognizes traffic lights and pedestrians. The audio is poor because it was recorded on a pocket camcorder.

Pokey Rule presents Cursorless, a spoken language designed for editing code by voice, built on tree-sitter parsing with smart structural and simple token-level primitives. The talk is from Strange Loop 2023.

Luis von Ahn, creator of CAPTCHA and reCAPTCHA, presents Duolingo at TEDxCMU 2011. The idea is to have millions of people translate the web for free while learning a language, an example of human computation.

Mobileye co-founder and CTO Amnon Shashua explains what goes into sensing for autonomous driving and whether end-to-end deep learning can work for it. He argues for decomposing the problem.

Andrej Karpathy's CVPR 2021 presentation on Tesla's Autopilot, covering its vision-based approach, sensor choices and the scale of Tesla's deep learning compute cluster. This upload is a lower-quality copy of the talk.

Ramesh Raskar presents femto-photography, a technique that captures a trillion frames per second, fast enough to show light itself moving through a scene. He discusses possible uses such as cameras that see around corners or inside the body.

Tom Gally, a former professional translator and University of Tokyo professor, discusses in March 2023 whether GPT-4 and similar models could translate literary and popular fiction. He gives his assessment of Japanese-to-English quality.

A HOPE XI talk on programming by voice with open source speech recognition. The speaker writes Linux systems code by voice and describes building custom voice grammars as an alternative to the keyboard for programmers with repetitive strain injuries.

Martin Kleppmann argues that databases are global shared mutable state and proposes treating them as an ever-growing log of immutable facts. Derived data such as caches, indexes and views is then built by stream processors like Apache Samza. The talk draws on Kafka and LinkedIn's experience with commit logs.

Robert Erdmann, a materials scientist at the Rijksmuseum, gives a PyCon keynote on the ultra-high-resolution imaging of Rembrandt's Night Watch. He covers the automated gantry camera system, the Python software that drives it, and the large volumes of image data involved.

Photopea founder Ivan Kutskir talks about developing a free browser-based photo editor, one of the most complex JavaScript programs ever written, and the web technologies behind it.

David Kriesel's FrOSCon talk on how Xerox scancopiers, due to JBIG2 compression, silently replaced digits in scanned documents. He walks through how he discovered the bug and why it is so dangerous.

Seymour Cray's only surviving recorded talk, introducing the Cray-1 supercomputer in 1976. He describes the machine's design, including its vector architecture and cooling through the frame.

Michael Levin's NeurIPS 2018 talk on bioelectric computation outside the nervous system, showing how cell electrical networks shape development and regeneration. It covers morphological information processing in living tissue.

Rick Houlihan's AWS re:Invent 2018 deep dive on advanced DynamoDB design patterns. It covers index overloading, GSI sharding, composite keys, graph processing and transactions.

Bret Victor's 2013 MIT Media Lab talk argues that the media we think with determine which thoughts are possible. He demos new representations for scientific papers, circuits, filters and signal processing.

A DEF CON 21 talk by Adam Laurie and Zac Franken on decapping chips, covering how to remove chip packaging and image the die to read out contents such as ROM.

A short edited excerpt of Terence McKenna arguing that culture acts as an operating system for the mind, set to imagery and music. It touches on psychedelics and how they change thinking.

Joscha Bach's 31c3 talk argues that the mind should be understood as an information-processing system and that even the physical universe can be seen as computational. It tours the philosophy underlying artificial intelligence and cognitive science.

An AWS re:Invent 2019 session for advanced DynamoDB users on design patterns used by large customers, including Amazon retail. It covers GSI sharding, index overloading, graph processing, composite keys and transactional workflows.

Merlin Mann's 2007 Google Tech Talk on Inbox Zero, covering Getting Things Done, why an empty inbox matters, and strategies for handling high-volume email. It is a talk on attention and processing mail rather than on emptying it for its own sake.