agent-based model

Rob Miles explains on Computerphile how language models generate plausible text and how transformers improved on recurrent networks, with a look at what comes next.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

Isaac Arthur explores space-based solar power, in which satellites beam energy down via microwaves to rectennas on Earth. He discusses feasibility, profitability and its role in spurring space colonization.

3Blue1Brown builds toy SIR models to simulate how an epidemic spreads and tests scenarios like social distancing, travel restrictions, central gathering places and quarantine. It was made during the early COVID-19 outbreak.

PBS Space Time considers whether life could be based on silicon instead of carbon, comparing the two elements' chemistry and why silicon is the most plausible alternative.

Sabine Hossenfelder explains climate sensitivity and why recent observations suggest climate models may have underestimated warming. She says this changed her view on how worried to be.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

A guest video by Welch Labs on 3Blue1Brown explaining how text-to-image and video models work. It covers CLIP, shared embedding spaces, diffusion models (DDPM, DDIM), conditioning, guidance and negative prompts.

Mick West analyzes the Navy's Gimbal UFO video and gives four checkable observations suggesting it is an infrared glare that appears to rotate because the camera rotates while tracking. He argues the object is likely a hot craft hidden behind the glare.

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

Huygens Optics explores the idea that space is a non-linear elastic medium, and uses simulations to show how wave energy might be confined locally into particle-like objects. It touches on inertia, the Schwinger limit and the vacuum as a medium.

Alex O'Connor shows that ChatGPT cannot draw a wine glass filled to the brim, and ties the failure to David Hume's missing shade of blue. It asks what the failure says about how image models learn.

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Ray Dalio's 30-minute animated video explains how the economy works through credit, debt, interest rates, and short- and long-term cycles. It is based on his template for understanding the economy.

An illustrated 23-minute summary of David Friedman's talk based on The Machinery of Freedom. It describes how law, police and courts could work as market services in a stateless society, covering private law, polycentric law and objections.

Potholer54 presents the climate science case and a market-oriented, conservative-friendly approach to addressing global warming, with sources listed. It is part one of a two-part series.

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

Musician and audio engineer Benn Jordan tries Dolby Atmos as a consumer, covering the theory of immersive audio, its business model, and home theater and headphone listening. He concludes it often falls short of the pitch.

Veritasium explores how electrical energy actually travels in a circuit, arguing that it flows through electromagnetic fields around the wires rather than through the electrons. It builds a long-cable experiment with Caltech to test when a distant bulb lights.

Mark Rober digs into bed bugs, testing popular beliefs about where they come from and how to get rid of them. It mixes entertaining experiments with research-based advice on what works and what does not.

Dr Mike Pound of Computerphile shows how a modern laptop can crack Enigma, using a ciphertext-only attack based on an older paper. He compares it with the tooling in CrypTool.

Rob Miles explains on Computerphile why implementing an off switch for a general AI is hard. A capable agent would resist being stopped because shutdown prevents it from achieving its goal.

Technology Connections explains in 33 minutes why thermoelectric (Peltier) cooling is far less efficient than compressor-based refrigeration.

Dr. John Campbell reviews studies on vitamin D deficiency and immunity, including links to influenza and COVID-19, with Public Health England advice. He walks through the sources he cites.

Yosh trains a reinforcement learning agent to drive Trackmania until he can no longer beat it. The video explains how the training works and the design choices involved.

A Veritasium video on how a feud between Russian mathematicians led to Markov chains and the modern prediction algorithms built on them. It covers the history and the math behind them.