Geoffrey Hinton in conversation with Fei-Fei Li — Responsible AI development

See "Geoffrey Hinton in conversation with Fei-Fei Li" where the two got together and looked back at the developments over the last ~10 years, including why and how they did their part: * ▶ this video

François Chollet says LLMs do not learn in-context. But Geoff Hinton says LLMs' few-shot learning compares quite favorably with people! ▶ this video The truth is in the middle, I think. They learn in-context, but not as well as humans. The approach in the article hides the unreliability of current LLMs by generating thousands of programs, and still the results aren't human-level. (This is impressive work though -- I'm not criticizing it.)

This 'conversation' with Geoffrey Hinton and Fei-Fei Li goes over a lot of the history of things (1h50m): * ▶ this video * link ('mirror') Goes over Hinton's history and why he went the direction he did with his research, as well as Li's efforts with ImageNet.