llm training

A Ray Summit 2022 keynote fireside chat between OpenAI's Greg Brockman and Anyscale's Robert Nishihara. They discuss how OpenAI's training infrastructure evolved and its use of Ray.

Dwarkesh Patel interviews Richard Sutton, reinforcement learning pioneer, Turing Award winner and author of The Bitter Lesson. Sutton argues LLMs are a dead end because they cannot learn on the job, and that continual learning from experience will require a new architecture.

A 42-minute CBS interview with Geoffrey Hinton at the Vector Institute in 2023, covering the history of neural networks and the present and future of AI. He discusses AGI timelines and whether language models truly understand.

Dwarkesh Patel interviews OpenAI chief scientist Ilya Sutskever on time to AGI, what comes after generative models, data limits, alignment, and competing with Google. The title centers on whether next-token prediction could surpass human intelligence.

Dwarkesh Patel interviews Andrej Karpathy on why reinforcement learning is flawed, why AGI may blend into steady GDP growth, why self-driving took so long, and the future of education. The conversation runs about two and a half hours.

A short clip of Steve Jobs describing the computer as a bicycle for the mind. He compares human efficiency of travel to what computers do for mental work.

Computerphile interviews AI safety researcher Rob Miles about ChatGPT: how it was trained with human feedback, why it tends to produce confident nonsense, and where it may or may not be dangerous.

A 60 Minutes segment in which Navy pilots Dave Fravor and Alex Dietrich recount their 2004 encounter with the 'tic tac' UAP during training with the USS Nimitz group.

Part two of a StrictlyVC interview with OpenAI CEO Sam Altman, focused on AI. He discusses regulation, commodification of AI, Google's reluctance to release its own models, and best- and worst-case futures.