hallucination

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

UC Berkeley EECS colloquium by OpenAI's John Schulman on reinforcement learning from human feedback. He covers why RL helps with truthfulness, hallucination, and the limits of behavior cloning.

Neuroscientist Anil Seth argues in this TED talk that perception is a controlled hallucination: the brain constantly predicts the world and our shared agreement is what we call reality. He also touches on the construction of the self.

A short demo of a GPT-powered Linux shell that guesses the bash command you meant and sometimes hallucinates absurd results. The creator stresses that it is real and should not be trusted.

Joe Rogan interviews ultramarathon runner Courtney Dauwalter shortly after she won the Moab 240 in under 58 hours. She tells stories of enduring extreme fatigue and hallucinations.