research

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

Martin Gorner's Devoxx talk introduces deep learning with TensorFlow, walking through neural networks for MNIST, how to choose an architecture and how to diagnose networks that fail to train.

A short video of stretching and hand exercises for preventing and easing tendinitis and carpal tunnel syndrome, from a percussion teacher. The exercises were shown to him by a doctor.

The first episode of Google's Machine Learning Recipes series. It introduces machine learning and builds a first supervised-learning classifier in about six lines of Python using scikit-learn.

A short promotional video demonstrating a head-thumping technique that is claimed to relieve tinnitus. Covering the ears and tapping the back of the head is said to silence the ringing temporarily.

A University of Michigan Medicine demonstration of building a cheap DIY air purifier from a box fan and a HEPA or high-MERV filter using hardware-store parts. It explains why this helps against dust, smoke and viruses and ties it to local air quality readings.

Kristy Viers demonstrates the iPhone Magnifier combined with VoiceOver to describe the user's surroundings. She shows how the built-in feature reports scenes, faces and lighting.

The first of a short series by Welch Labs on building a complete neural network in Python. It introduces the data and the architecture of a simple network before later parts cover forward propagation, gradient descent, and backpropagation.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

A long Tsoding Daily programming stream in which he implements hot code reloading in C by loading a dynamic library at runtime without stopping the main program. It also touches on migrating struct versions across reloads.

Mitchell Hashimoto walks through his setup for running a NixOS virtual machine on a Mac as his development environment, with a config repo on GitHub.

GE Lighting's official how-to for factory resetting C by GE smart bulbs, using a long sequence of precisely timed on and off cycles.

A 2018 vlog showing how to use the windshield wipers on a Tesla Model 3, including auto mode, manual settings and voice commands. It is labeled outdated.

The Original Ace shows how creators can use a third-party music distributor to file Content ID claims on their own videos, turning false-claim abuse into a share of ad revenue. It also names distribution companies and their revenue splits.

A guide to using YouTube's Content ID by claiming your own videos through a distributor, so the claims share revenue with the creator and monetize re-uploads. It credits another creator who pioneered the method.

NightHawkInLight shows how to make ultra-white radiative paint that cools surfaces below ambient temperature without electricity. He walks through the research papers and the household-materials process.