data visualization

The American Museum of Natural History's film flies from the Himalayas out through the atmosphere and solar system to the afterglow of the Big Bang, using its Digital Universe Atlas four-dimensional map.

Christopher Domas presents his Cantor Dust tool at Derbycon 2012, a 3D visual approach to reverse engineering binaries by visualizing their structure dynamically.

Christopher Domas's REcon 2013 talk on dynamic binary visualization for reverse engineering. He shows how rendering binary data as interactive visual maps and trigraphs reveals structure that hex dumps hide, leading to his Cantor.dust tool.

Bret Victor's talk on Drawing Dynamic Visualizations. It argues that visualization tools offer either the directness of hand drawing or the dynamics of programmed graphics, and shows a tool that combines both.

Tantacrul examines sonification, the practice of turning data into sound or music, and critiques how scientists and musicians, including NASA and CERN projects, use it well and poorly.

A Google Tech Talk by Laurens van der Maaten, co-creator of t-SNE, on visualizing high-dimensional data by mapping it to two dimensions. It explains how the technique works and how it compares with other visualization approaches.

A short demo of the Deep Visualization Toolbox, which shows the activations inside a convolutional neural network as it processes live camera input. Viewers see individual units responding to edges, faces and text.

Physicist Angela Collier rants for 42 minutes about why violin plots are a poor way to show data, citing papers on violin and bean plots. It is part lecture on how to read distributions and part opinionated critique.

A short NASA Goddard visualization from the GEOS-5 model showing a year of atmospheric carbon dioxide moving around the globe. It shows plumes from sources, hemispheric differences and seasonal swings as plants grow and die back.

The first lecture of Andy Pavlo's CMU 15-445 Intro to Database Systems (Fall 2019), covering course introduction and the relational model.

Hans Rosling uses the Gapminder animated-data tool to debunk myths about world development, with sportscaster-like energy. It shows trends in health, income and child survival across countries.

Hans Rosling's TED@Cannes talk uses boxes and animated data graphics to show how world population will grow to about 9 billion. He argues that raising living standards for the poorest is what reduces population growth.

Anna Rosling Rönnlund presents Dollar Street, a project photographing homes in dozens of countries, from stoves to beds to toilets, and sorting them by income. She shows how data visualization can change how we see the world.

A timeline visualization plotting the 2053 nuclear tests and detonations from 1945 to 1998 on a world map, with sound marking each blast. It conveys the pace of the nuclear arms race.

James Powell's nearly two-hour PyData talk builds up Python's data model, decorators, generators and context managers, coding live in Vim. It aims to take intermediate programmers toward real Python expertise.

Hans Rosling uses augmented-reality animation to show 200 countries over 200 years in four minutes, built from 120,000 data points. It tracks life expectancy and income to show the world's development.

Mike Acton of Insomniac Games argues that a program's purpose is transforming data, and shows how common C++ approaches work against that in performance-critical game development. He covers cache behavior, data layout and the limits of compilers.

Juan Pedro Bolivar Puente explains immutable and persistent data structures in C++ and how they support value semantics. He presents the Immer library, rrb-trees, and a prototype text editor that opens a huge file instantly.

A five-minute lightning demo of VisiData, a terminal tool for exploring and manipulating data. It uses two months of NYC 311 complaint data to drill down, plot points on a virtual map and save selected rows.

Database pioneer Michael Stonebraker argues that 'big data' is really at least four different problems: big volumes with small analytics, big analytics, velocity, and variety. He comments on where each market is heading.

Rich Hickey, creator of Clojure and designer of Datomic, gives a JaxConf 2012 talk that takes apart traditional database architecture. He presents a different way to think about databases and explains the reasoning behind Datomic's fact-based design.

Peter Norvig's 2007 Google talk on theorizing from data, covering what huge datasets can do for language understanding, translation, information extraction and inference. It argues that more data often beats cleverer models.

Peter Norvig's UBC distinguished lecture on how massive amounts of simple data, such as for language modeling, can yield understanding that hand-built models could not.

Neil Halloran's animated, data-driven documentary visualizes the human cost of World War II and compares it with other wars and the trend toward fewer war deaths in recent decades.

John Ousterhout's Netdev 0x16 keynote arguing that nearly every aspect of TCP is wrong for the datacenter, from connections and streams to reliable delivery and congestion control. He presents the case for a replacement protocol.

Isao Hashimoto's time-lapse map shows all 2053 nuclear explosions between 1945 and 1998, with each nation getting a blip and a running tally. Each second represents one month.

Raymond Hettinger explains Python's dataclasses module, showing the problem it solves and its key design decisions. He places it in a progression from tuples and dicts through named tuples and attrs.

Edward Kmett's 2013 talk at Prezi in Budapest on succinct data structures, which store data in close to the information-theoretic minimum space while supporting fast queries. It ties together the research and walks through his Haskell succinct library.

Jon Gjengset's 2020 PhD dissertation presentation at MIT on partial state in dataflow-based materialized views, the idea behind the Noria database. The Q&A is cut out.

Linus Tech Tips documents a major RAID failure on its Whonnock server and the attempt to recover the lost data with a data recovery firm.

A Gource visualization of 826 days of Minecraft development, from alpha 1.2 to release 1.5, condensed into eight minutes. Each dot is a file, folders are links, and developers fly around zapping files as they work on them.

An LGR Oddware episode looking at Sony's MDH-10 MD Data drive from 1995, which used MiniDisc for computer storage years before Hi-MD. The host tries out the drive with its original drivers and software.

SciPy 2015 talk by Nathaniel Smith and Stefan van der Walt on choosing a new default colormap for Matplotlib. It covers why Jet misleads, how perceptual color spaces work, and how viridis was designed.

Kevin Fang comically retells GitLab's 2017 incident in which an engineer deleted the production database, based on the company's postmortems. It walks through the confusion and failed backups.

Martin Kleppmann argues that databases are global shared mutable state and proposes treating them as an ever-growing log of immutable facts. Derived data such as caches, indexes and views is then built by stream processors like Apache Samza. The talk draws on Kafka and LinkedIn's experience with commit logs.

Andrew Kelley, creator of Zig, presents practical data-oriented design techniques for shrinking memory footprint and making programs cache friendly. He ends with a case study of how these ideas sped up the Zig compiler.

Gary Garrett's stop-motion animation of his song Flying Dream, with notes arranged on a lattice of fifths and major thirds. It shows how harmony looks in just intonation, inspired by Harmonic Experience.

A visualization and sonification of 15 sorting algorithms, from selection sort to bogo sort, run on shuffled integers in six minutes. Each algorithm gets a size and speed scaled to its complexity.

2swap explains how he solved the Klotski sliding-block puzzle by mapping its full state space as a graph and visualizing it. The video includes footage of the Guinness world-record solve and links to an interactive graph.

A CppCon 2018 talk arguing that OOP has failed to deliver on reuse and performance, and presenting data-oriented design for C++ with practical worked examples from real systems.