research

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

Kristy Viers demonstrates the iPhone Magnifier combined with VoiceOver to describe the user's surroundings. She shows how the built-in feature reports scenes, faces and lighting.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

A long Tsoding Daily programming stream in which he implements hot code reloading in C by loading a dynamic library at runtime without stopping the main program. It also touches on migrating struct versions across reloads.

Mitchell Hashimoto walks through his setup for running a NixOS virtual machine on a Mac as his development environment, with a config repo on GitHub.

A guide to using YouTube's Content ID by claiming your own videos through a distributor, so the claims share revenue with the creator and monetize re-uploads. It credits another creator who pioneered the method.

NightHawkInLight shows how to make ultra-white radiative paint that cools surfaces below ambient temperature without electricity. He walks through the research papers and the household-materials process.