dead reckoning

A clip from Lex Fridman's podcast in which chip architect Jim Keller argues that Moore's Law is not dead and that transistor scaling still has lots of room. He also discusses how to break down hard problems.

Dwarkesh Patel interviews Richard Sutton, reinforcement learning pioneer, Turing Award winner and author of The Bitter Lesson. Sutton argues LLMs are a dead end because they cannot learn on the job, and that continual learning from experience will require a new architecture.