autonomous testing

Will Wilson explains autonomous testing: using deterministic simulation and fuzzing, building on FoundationDB's approach, to test software continuously. It sets out the ideas behind his later company Antithesis.

Sandi Metz's RailsConf 2013 talk offers practical guidelines for deciding what to test and how, so tests stay cheap and stable. She argues for testing the public interface rather than implementation and using mocks appropriately.

John Hughes, co-creator of QuickCheck, talks about property-based testing of hard systems. He shows production examples where it found very low-level bugs, including issues in the CAN bus standard.

Hillel Wayne's PyCon 2018 talk on testing beyond pytest and mypy. It introduces property-based testing with the Hypothesis library and design-by-contract with dpcontracts, and shows how to combine them with an existing test suite.

A short research demo of Autonomous Intersection Management, a protocol in which self-driving cars reserve slots through an intersection instead of obeying signals or stop signs. It uses UT Austin's autonomous vehicle Marvin and a simulation to show cars crossing without stopping.

Alen Ladavac of Croteam talks about continuous integration and automated testing pipelines in games, with case studies from The Talos Principle and Serious Sam.

Short Airbus footage of its ATTOL project, in which a test aircraft performed a fully automatic, vision-based take-off at Toulouse-Blagnac. The crew ran eight take-offs over several hours.

Ted Young of LightStep proposes trace testing, using distributed tracing data to unify testing and observability. The KubeCon-era talk argues for testing against trace data rather than treating tests and monitoring separately.

A demonstration from UPenn's GRASP Lab of an autonomous quadrotor performing flips, flying through windows and perching on surfaces. It shows precise aggressive maneuvering control of a small UAV.

Destin of Smarter Every Day goes behind the scenes at the 23andMe lab to show how genotyping works. He also discusses DNA testing and privacy.

A three-minute clip about Ernst Dickmanns' VaMoR and VaMP projects, in which fully autonomous vehicles drove thousands of miles on public roads in the 1980s. It is a brief look at early German self-driving research.

Will Wilson of FoundationDB explains how the team tested their distributed database using deterministic simulation. By running the whole system in a simulator with injected faults and reproducible seeds, they could find rare concurrency and network bugs.

Gary Bernhardt's RubyConf 2012 talk on testing in isolation without mocking everything. It goes through behavior versus data, mutation versus immutability, and how a functional core with an imperative shell yields natural isolation and parallelism.

Lex Fridman's two-hour podcast with George Hotz, founder of Comma.ai, covering openpilot, autonomous driving and Hotz's views on AI and technology.

Deviant Ollam, head of a physical penetration testing team, presents tactics for getting into buildings, from bypassing door levers with a wire to defeating bank doors. He argues that physical security is often surprisingly weak.

Veritasium tells how Kodak film was fogged by radioactive fallout from the first atomic tests, letting the company detect nuclear testing before anyone announced it. The video also covers the deal to keep it quiet and how fallout contaminated packaging.

MedCram's Dr. Roger Seheult summarizes a discussion with Dr. Michael Mina on cheap, paper-based at-home COVID-19 antigen tests. It explains why lower sensitivity can still work well for screening infectious people.

Mobileye co-founder and CTO Amnon Shashua explains what goes into sensing for autonomous driving and whether end-to-end deep learning can work for it. He argues for decomposing the problem.

Raymond Hettinger's PyBay 2018 keynote on preventing, finding and fixing bugs under a time budget. He covers testing practice, type annotation tradeoffs and the limits of coverage metrics.

Drive.ai shows its car driving fully autonomously on a rainy night in Mountain View, with heavy downpour, glare, a four-way stop and a broken traffic light.

A dramatized fictional video of micro drones with facial recognition and swarm AI used as autonomous killer weapons. It is a Slaughterbots-style warning about lethal autonomous weapons.

GreatScott! tests ProLogium lithium ceramic batteries, a solid-state design. He measures their volumetric and gravimetric energy density, compares them to Li-ion and LiPo, and runs durability tests at the end.

John Oliver's Last Week Tonight segment on standardized testing in American schools. It covers how tests drive school funding, the achievement gap, and the testing industry around companies like Pearson.

A Waymo clip, sped up 3x, showing its autonomous car stopping at a broken traffic light and proceeding on a police officer's hand signals.

A short IEEE Spectrum clip of Stanford's autonomous car Junior learning to powerslide into a parking spot. It shows several approaches to the maneuver.

Waymo's 2017 announcement that its fully autonomous vehicles are test-driving on public roads with no one in the driver's seat. It gives a short overview of the project's history and plans.

Slaughterbots is a fictional short film, backed by Stuart Russell, depicting swarms of cheap autonomous drones that use facial recognition to assassinate targets. It was made to argue for banning autonomous weapons.

J. B. Rainsberger argues that large integrated tests are a scam: they are slow, fail opaquely, and give a false sense of coverage. He advocates focused collaboration and contract tests at boundaries instead.

Misko Hevery's Clean Code Talk shows how to use object-oriented techniques such as polymorphism to remove repeated if and switch statements. The result is code that is easier to test, understand and maintain.

Last Day of War is an award-winning CGI animated short by Dima Fedotov in which automated machines keep following orders and prepare a bomber after all humans are dead.

Builder Matt Risinger freezes water-filled copper and PEX piping capped with SharkBite fittings to see which survives. The video compares how each pipe type handles freezing.

A 3-minute CGI animated sci-fi short by Dima Fedotov. An automated war system keeps a lone bomber attacking a long-dead city after humanity has been wiped out, until life finds a way to survive.

Waymo's 2018 360-degree video lets viewers look around inside a fully driverless ride. It is built from footage and real-time data of an actual trip on city streets.

Asian Boss interviews Professor Kim Woo-joo of Korea University Guro Hospital about COVID-19 in early 2020. He covers masks, testing, aerosol spread, and South Korea's response.

Slaughterbots is a short sci-fi film in which swarms of cheap autonomous drones are programmed to kill targets by profile. It was made as arms-control advocacy against autonomous weapons.

Veritasium takes an IQ test and examines what IQ measures, its history including military use and eugenics, its controversies, and how it correlates with life outcomes. Experts including Cecil Reynolds and Stuart Ritchie contribute.

A doctor from Medlife Crisis explains in under three minutes why even a rich patient should not simply order every medical test, touching on pre-test probability and Bayesian reasoning. False positives make blanket testing counterproductive.

An 8-minute fictional short film, made by campaigners for a ban on autonomous weapons, depicting swarms of cheap AI-guided micro-drones used to kill targeted people. It ends with a call to action against autonomous weapons.

Linus Tech Tips tests a large batch of DisplayPort cables with a Total Phase cable tester, checking bandwidth and signal quality. Many cables did not meet their claimed specs.

A short news clip of a test in which a Tesla hits a child-sized dummy while a car equipped with Luminar's lidar stops in time.