arithmetic

Matt Parker of Stand-up Maths explains why people keep making the same mistake with millions and billions, using a Bloomberg cash calculator example. He looks at the unit slip behind the repeated arithmetic error.

Bill Dally of NVIDIA gives a University of Washington lecture on trends in deep learning hardware. It covers numeric formats, specialized instructions, energy per operation and co-design of hardware and software.

OpenAI cofounder Greg Brockman explains the design principles behind ChatGPT and demos unreleased plug-ins at TED 2023. In the follow-up, TED head Chris Anderson presses him on the timeline of development and the risks of releasing such a tool.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.