testing

Sandi Metz's RailsConf 2013 talk offers practical guidelines for deciding what to test and how, so tests stay cheap and stable. She argues for testing the public interface rather than implementation and using mocks appropriately.

Will Wilson explains autonomous testing: using deterministic simulation and fuzzing, building on FoundationDB's approach, to test software continuously. It sets out the ideas behind his later company Antithesis.

John Hughes, co-creator of QuickCheck, talks about property-based testing of hard systems. He shows production examples where it found very low-level bugs, including issues in the CAN bus standard.

Hillel Wayne's PyCon 2018 talk on testing beyond pytest and mypy. It introduces property-based testing with the Hypothesis library and design-by-contract with dpcontracts, and shows how to combine them with an existing test suite.

Alen Ladavac of Croteam talks about continuous integration and automated testing pipelines in games, with case studies from The Talos Principle and Serious Sam.

Ted Young of LightStep proposes trace testing, using distributed tracing data to unify testing and observability. The KubeCon-era talk argues for testing against trace data rather than treating tests and monitoring separately.

Will Wilson of FoundationDB explains how the team tested their distributed database using deterministic simulation. By running the whole system in a simulator with injected faults and reproducible seeds, they could find rare concurrency and network bugs.

Misko Hevery's Clean Code Talk shows how to use object-oriented techniques such as polymorphism to remove repeated if and switch statements. The result is code that is easier to test, understand and maintain.

Veritasium tells how Kodak film was fogged by radioactive fallout from the first atomic tests, letting the company detect nuclear testing before anyone announced it. The video also covers the deal to keep it quiet and how fallout contaminated packaging.

Destin of Smarter Every Day goes behind the scenes at the 23andMe lab to show how genotyping works. He also discusses DNA testing and privacy.

MedCram's Dr. Roger Seheult summarizes a discussion with Dr. Michael Mina on cheap, paper-based at-home COVID-19 antigen tests. It explains why lower sensitivity can still work well for screening infectious people.

GreatScott! tests ProLogium lithium ceramic batteries, a solid-state design. He measures their volumetric and gravimetric energy density, compares them to Li-ion and LiPo, and runs durability tests at the end.

John Oliver's Last Week Tonight segment on standardized testing in American schools. It covers how tests drive school funding, the achievement gap, and the testing industry around companies like Pearson.

Tested explains how Apple's Touch ID recognizes fingerprints, then tries to defeat it using fake fingers and prints, retracing methods claimed by a German computer club.

Builder Matt Risinger freezes water-filled copper and PEX piping capped with SharkBite fittings to see which survives. The video compares how each pipe type handles freezing.

America's Test Kitchen tests eight carbon-steel skillets to find the best one, asking whether a single pan can replace stainless, cast iron and nonstick. It names a winner and covers how the pans perform.

Adam Neely tests the claims for tuning to A=432 Hz by trying the unusual tuning systems that its proponents' numerology requires. He compares how they sound against standard tuning and temperaments.

Veritasium's Derek Muller spends an hour in a silent, dark anechoic chamber at BYU to test the claim that 45 minutes is the most anyone can bear. He reports on his experience and other people's reactions.

Short footage from a NASA space suit test in which a technician is exposed to near-vacuum after an accidental depressurization. It shows the instantaneous effects on a human body.

Fully Charged gets an exclusive first drive of the Porsche Taycan, running 0-200 km/h launch control repeatedly. It covers the car's twin-motor 800-volt specs, claimed range and fast charging.

Gary Bernhardt's RubyConf 2012 talk on testing in isolation without mocking everything. It goes through behavior versus data, mutation versus immutability, and how a functional core with an imperative shell yields natural isolation and parallelism.

Raymond Hettinger's PyBay 2018 keynote on preventing, finding and fixing bugs under a time budget. He covers testing practice, type annotation tradeoffs and the limits of coverage metrics.

J. B. Rainsberger argues that large integrated tests are a scam: they are slow, fail opaquely, and give a false sense of coverage. He advocates focused collaboration and contract tests at boundaries instead.

Deviant Ollam, head of a physical penetration testing team, presents tactics for getting into buildings, from bypassing door levers with a wire to defeating bank doors. He argues that physical security is often surprisingly weak.

Ian Cooper's DevTernity talk revisits Kent Beck's original TDD ideas and shows where misunderstandings crept in. It argues tests should target behaviors through public interfaces rather than implementation details, so suites support refactoring instead of resisting it.

Gil Tene of Azul Systems explains common pitfalls in measuring latency and response time, including why averages mislead and the problem of coordinated omission. He introduces open source tools like HdrHistogram for better measurement and reporting.

A Thoughtworks conversation among Martin Fowler, Kent Beck and David Heinemeier Hansson on whether TDD is dead. They discuss the tradeoffs of test-driven development, mocking and where TDD helps or hurts design.

Jim Coplien and Bob Martin debate test-driven development and unit testing in an InfoQ video that grew out of a JAOO 2007 dispute. They also touch on design and architecture.

Brandon Rhodes' PyOhio 2014 talk on applying the Clean Architecture in Python. He shows how this high-level design pattern fits Python's features and addresses maintainability problems in large applications.

Stuart Halloway of Cognitect argues for debugging with the scientific method: form hypotheses, try to falsify them, and write everything down. The talk is given to the Clojure community but applies to any language.

A former Microsoft SDET with 15 years on Windows gives his view on why Windows 10 updates keep shipping with bugs. He points to changes in how the company tests its software.

Isao Hashimoto's time-lapse map shows all 2053 nuclear explosions between 1945 and 1998, with each nation getting a blip and a running tally. Each second represents one month.

Scott Manley tells the story of a computerized telemetry system built to sit at the heart of a nuclear test device in place of the plutonium pit, designed to transmit data in the microseconds before it was destroyed.

Titus Winters' CppCon 2017 talk argues for C++ and Google's Abseil to be maintained as a live at head language, relying on testing and automated tooling rather than never changing or promising no compatibility. It covers Hyrum's law and the limits of semantic versioning.

Deviant Ollam's two-hour conference talk explains how elevators work, from the pit and buffers to the car top, controller logic and access-control features. It shows how this knowledge can be used for optimization and for bypassing building security.

Deviant Ollam and Howard Payne give an in-depth DEF CON 22 explanation of how elevators work, from the pit to the penthouse. It covers their control modes and how pen testers use elevators to bypass building security.

Deviant Ollam shows that most physical attacks on doors bypass the lock, with photo and video examples of how doors, frames and hardware get defeated. It is a physical security talk from Shakacon.

Jake Vanderplas's PyCon 2016 talk shows how sampling-based methods such as simulation, shuffling and bootstrapping make statistics intuitive. His pitch is that if you can write a for-loop, you can do statistics.

Jayson E. Street's DEF CON 19 talk shows photos from real security engagements where he was already inside client facilities, illustrating how social engineering and physical intrusion can cause huge losses. For each attack he also explains what defenses would have stopped him.

LockPickingLawyer cuts through a LiteLok flexible bike lock with cable cutters in about 16 seconds, one of several videos defeating the product.