scaling

Stanford Blitzscaling class session where Reid Hoffman interviews Eric Schmidt about structuring teams and scaling Google. Topics include Alphabet, hiring, and how Chrome and Android operated inside the company.

A clip from Lex Fridman's podcast in which chip architect Jim Keller argues that Moore's Law is not dead and that transistor scaling still has lots of room. He also discusses how to break down hard problems.

A standing whiteboard conversation at Lang.NEXT 2012 among Carl Hewitt, Erik Meijer and Clemens Szyperski about the actor model. Hewitt, who originated the model, explains its foundations.

Pixar staff tell the story of how Toy Story 2 was almost deleted from the studio's computers and was saved by a home computer backup.

A short clip from an ACM and Computer History Museum interview in which Leslie Lamport discusses writing his paper on time, clocks and the ordering of events. He explains its link to special relativity.

Dwarkesh Patel interviews Google's Jeff Dean and Noam Shazeer about 25 years at the company, from PageRank and MapReduce to the Transformer, mixture of experts and Gemini. They also discuss where AI is heading.

A Ray Summit 2022 keynote fireside chat between OpenAI's Greg Brockman and Anyscale's Robert Nishihara. They discuss how OpenAI's training infrastructure evolved and its use of Ray.

Fox Business interview in which Oracle co-founder Larry Ellison claims Oracle will beat Amazon at cloud databases. He argues the world's valuable data lives in Oracle and says Amazon struggled to move off it.

Dwarkesh Patel interviews OpenAI chief scientist Ilya Sutskever on time to AGI, what comes after generative models, data limits, alignment, and competing with Google. The title centers on whether next-token prediction could surpass human intelligence.

Dwarkesh Patel interviews Richard Sutton, reinforcement learning pioneer, Turing Award winner and author of The Bitter Lesson. Sutton argues LLMs are a dead end because they cannot learn on the job, and that continual learning from experience will require a new architecture.