basic training

The 8-Bit Guy reviews the Color Maximite 2, a modern ARM-based computer that boots straight into BASIC. He shows what it can do as a retro-style machine.

8-Bit Show And Tell walks through the BASIC source code of the original Commodore 64 Sid Meier's Pirates!. It covers bugs, quirks and traces of abandoned features and scenarios left in the code.

A Ray Summit 2022 keynote fireside chat between OpenAI's Greg Brockman and Anyscale's Robert Nishihara. They discuss how OpenAI's training infrastructure evolved and its use of Ray.

The first stream in the Emacs From Scratch series, building a custom Emacs configuration from zero while teaching basics. It covers a usable baseline setup and the packages for completion, themes and productivity.

Yosh trains a reinforcement learning agent to drive Trackmania until he can no longer beat it. The video explains how the training works and the design choices involved.

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

Andrej Karpathy gives a one-hour general-audience introduction to large language models, covering what they are, how they are trained, comparisons to operating systems, and security challenges such as jailbreaks.

The introduction to MangoJelly's beginner course for FreeCAD 1.0. The course teaches solid modeling with the Part Design, Sketcher and Part workbenches.

Andrej Karpathy walks through how GPT assistants are trained, from tokenization and pretraining to supervised finetuning and RLHF, and gives practical prompting strategies and a view of the tooling ecosystem.

The first part of Freya Holmer's three-part, nearly four-hour lecture on shader coding for game devs in Unity. It covers what shaders are, vertex and fragment shaders, interpolators, data types, blending and textures.

Alex O'Connor shows that ChatGPT cannot draw a wine glass filled to the brim, and ties the failure to David Hume's missing shade of blue. It asks what the failure says about how image models learn.

Part one of an American Airlines training video presented by Captain Warren VanderBurgh on automation dependency. It grew out of a program on wake turbulence avoidance, and this restored version has the audio cleaned up.

Dwarkesh Patel interviews OpenAI chief scientist Ilya Sutskever on time to AGI, what comes after generative models, data limits, alignment, and competing with Google. The title centers on whether next-token prediction could surpass human intelligence.

Andrej Karpathy's first Neural Networks: Zero to Hero lecture, which builds micrograd, a tiny autograd engine, from scratch in Python. It explains backpropagation and neural network training step by step, assuming only basic Python and some high-school calculus.

Adam Neely explains what perfect (absolute) pitch is, how it differs from relative and quasi-absolute pitch, and why he would not want it. He covers its drawbacks, including drift with age.

Tesla's full AI Day 2022 presentation, covering the Tesla Bot hardware and software, Full Self-Driving planning and perception, the occupancy network, data labeling, simulation and Dojo training infrastructure.

A No Priors podcast conversation with Andrej Karpathy covering self-driving (Tesla versus Waymo), the Optimus robot, bottlenecks in AI development, and his education project Eureka Labs.

The video argues that machine-learning-based aimbots, which read the screen and drive the controls externally, could make cheating in FPS games undetectable. It explains how conventional aimbots work, how the new approach differs, and speculates on possible detection.

Inigo Quilez live-paints a mountain landscape using only math in a shader, building up from a basic polynomial noise surface through fractal terrain, lighting and atmosphere. The code runs in real time on Shadertoy so viewers can edit it as they follow along.

Andrej Karpathy, then Tesla's head of AI, presents at ScaledML 2020 on how Tesla builds full self-driving using vision-based neural nets and fleet data collection. He covers training custom detectors and neural nets gradually replacing traditional code.

Valve's John McDonald presents at GDC 2018 on how Valve uses deep learning (VACnet) to detect cheaters in Counter-Strike: Global Offensive. He covers training on human-reviewed replays and how model output is confirmed by manual review.

Louis Rossmann gives a basic, non-technical introduction to right to repair legislation for people new to the issue.

Mario Zechner explains why he built pi, a minimal coding agent, out of frustration with existing agent harnesses. He also discusses how AI agents are straining open source projects and argues for slowing down.

Andrew Huberman discusses ADHD, its biology and myths, behavioral and pharmacologic treatments, and training protocols to improve focus for people with or without ADHD. It covers dopamine and the coordination of brain networks.

In this first Crust of Rust episode, Jon Gjengset live-codes an example that needs multiple explicit lifetime annotations. Along the way he covers string types and generics over a custom trait.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Lesson 1 of fast.ai's Practical Deep Learning for Coders, taught by Jeremy Howard. It takes coders from running code in a Jupyter notebook straight into training a real image model.

Bill Dally of NVIDIA gives a Hot Chips 2023 keynote on the challenges of building hardware for deep learning. He traces how GPUs have been adapted for machine learning, especially training.

Rob Miles explains "glitch" tokens, odd strings in large language model vocabularies that make the model produce gibberish. He covers how they likely arise from tokenizer training data, such as Reddit usernames, that never appeared in the model's own training.

The US Chemical Safety Board's updated animation of the 2005 BP Texas City refinery explosion, which killed 15 workers. It was released ahead of a process safety training application.

Computerphile interviews AI safety researcher Rob Miles about ChatGPT: how it was trained with human feedback, why it tends to produce confident nonsense, and where it may or may not be dangerous.

Musician Benn Jordan explains and demonstrates adversarial noise that poison-pills music files against AI training and scraping.

A 60 Minutes segment in which Navy pilots Dave Fravor and Alex Dietrich recount their 2004 encounter with the 'tic tac' UAP during training with the USS Nimitz group.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

Practical Engineering explains how continuous welded rail copes with thermal expansion by restraining it, using the relationship between temperature, stress and strain. The video is part of a series on railways.

Tesla's 2021 AI Day presentation covering vision, planning and control, auto-labeling, simulation, the Dojo training hardware and the Tesla Bot announcement, followed by a Q&A.

A nearly four-hour video essay by hbomberguy on plagiarism on YouTube, centered on specific creators who copied other people's work. It examines what plagiarism is and how it went unaddressed.