Why Can't AI Make Its Own Discoveries? — With Yann LeCun
Alex Kantrowitz2 HN recommenders · recommended in 2 months, 2025-2026
222K views · 1 year ago · podcast · dated
Yann LeCun on the Big Technology Podcast discusses why current AI models cannot make discoveries despite their knowledge. He argues systems need abstract world models and also covers limits of AI research, investor expectations, and open source after DeepSeek.
Pointed to as LeCun's argument for the limits of LLMs and the need for world models.
2:47:17Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI | Lex Fridman Podcast #416
Lex Fridman
1.3M views • 2 years ago
1:31:13A Hackers' Guide to Language Models
Jeremy Howard
580K views • 3 years ago
1:07:09Richard Sutton – Father of RL thinks LLMs are a dead end
Dwarkesh Patel
804K views • 1 year ago
24:07AI can't cross this line and we don't know why.
Welch Labs
2.5M views • 2 years ago
![[1hr Talk] Intro to Large Language Models](https://i.ytimg.com/vi/zjkBMFhNj_g/hq2.jpg)
59:48[1hr Talk] Intro to Large Language Models
Andrej Karpathy
4.3M views • 2 years ago
3:31:24Deep Dive into LLMs like ChatGPT
Andrej Karpathy
10.2M views • 1 year ago
20:55Why ChatGPT Can't Draw a Full Glass of Wine
Alex O'Connor
6.3M views • 1 year ago
38:59StrictlyVC in conversation with Sam Altman, part two (OpenAI)
Connie Loizos
254K views • 3 years ago
8:25Large Language Models from scratch
Graphics in 5 Minutes
375K views • 4 years ago
42:30Full interview: "Godfather of artificial intelligence" talks impact and potential of AI
CBS Mornings
2M views • 3 years ago
2:46:27Why Greatness Cannot Be Planned — Kenneth Stanley
Machine Learning Street Talk
154K views • 5 years ago
27:14Transformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown
11.6M views • 2 years ago
1:05:18Recent Developments in Deep Learning
Google TechTalks
85K views • 16 years ago
28:48LSTM is dead. Long Live Transformers!
Seattle Applied Deep Learning
540K views • 6 years ago
48:32Sparks of AGI: early experiments with GPT-4
Sebastien Bubeck
1.8M views • 3 years ago
57:21An Observation on Generalization
Simons Institute for the Theory of Computing
210K views • 3 years ago
25:57GPT3: An Even Bigger Language Model - Computerphile
Computerphile
446K views • 6 years ago
1:22:38CS480/680 Lecture 19: Attention and Transformer Networks
Pascal Poupart
374K views • 7 years ago
23:20Ali Rahimi's talk at NIPS(NIPS 2017 Test-of-time award presentation)
ObservantVids
78K views • 8 years ago
![Neural Networks Demystified [Part 1: Data and Architecture]](https://i.ytimg.com/vi/bxe2T-V8XRs/hq2.jpg)
3:07Neural Networks Demystified [Part 1: Data and Architecture]
Welch Labs
838K views • 12 years ago
3 comments from Hacker News
This is not an appeal to authority, but this video probably contains the answers to your questions if you are open minded about it ▶ this video
In this podcast episode[0] he does talk about this kind of model and how it "learns about physics" through experience instead of just ingesting theorical material. It's quite eye opening. 0. ▶ this video
What? The "article" is from anthropic, so I think they would know what they write about. Also, RL is an additional training process that does not negate that GPT / transformers are left-right autoencoders that are effectively next token predictors. [Why Can't AI Make Its Own Discoveries? — With Yann LeCun] ( ▶ this video )