scaling apps

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

3Blue1Brown builds intuition for Euler's formula, e^(pi i) = -1, using the core ideas of group theory. It treats exponentiation geometrically as rotation and scaling instead of repeated multiplication.