scaling

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

Benn Jordan investigates infrasound and low-frequency noise from data centers, including xAI's Colossus and a crypto mine, and reports his own experiments on the effects. The video covers the health and community impacts on nearby residents.

Dave Plummer tours the IBM z16 mainframe from design through factory assembly, test lab, accelerators and water cooling. He explains why mainframes still exist and what makes them reliable.

Eager Space examines the practicality of putting data centers in orbit, walking through three scenarios with cost calculations and the launch cost reductions that would be required.

Scott Manley examines why SpaceX, Google and others are looking at orbital data centers. He walks through the economics, heat rejection and solar power arguments, with links to the Lumen/Starcloud and Google Suncatcher papers.

An 8-minute explainer on the Lightning Network and how it relates to Segwit, Bitcoin and Litecoin. It covers how off-chain payment channels route payments to scale blockchain transactions.

Scott Manley analyzes the idea of putting data centers in orbit, prompted by Lumen Orbit's funding. He examines the claimed advantage of constant solar power against launch cost, cooling and mass.

3Blue1Brown builds intuition for Euler's formula, e^(pi i) = -1, using the core ideas of group theory. It treats exponentiation geometrically as rotation and scaling instead of repeated multiplication.