Jim Keller - Moore's Law in the age of AI Chips
Matroid1 HN recommender · recommended in 1 month, 2020-2020
33K views · 6 years ago · talk · evergreen
Jim Keller's talk at the 2020 Scaled Machine Learning conference on Moore's Law in the age of AI chips. He compares scalar, vector and GPU-style parallel approaches to computation.
Cited in hardware threads as a Keller talk on the different ways of doing parallel processing.
1:04:53Jim Keller: Moore’s Law is Not Dead
UC Berkeley EECS
77K views • 7 years ago
1:37:12[7] Jim Keller, Silicon Wizard 🧙♂️
TechTechPotato
67K views • 5 years ago
26:02Moore's Law is Not Dead (Jim Keller) | AI Podcast Clips
Lex Fridman
172K views • 6 years ago
1:34:44Jim Keller: Moore's Law, Microprocessors, and First Principles | Lex Fridman Podcast #70
Lex Fridman
742K views • 6 years ago
56:54Change w/ Jim Keller
Tenstorrent
61K views • 3 years ago
2:39:15Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162
Lex Fridman
1.3M views • 5 years ago
35:45RAAIS 2017 - Simon Knowles, Co-Founder and CTO of Graphcore
The Research and Applied AI Summit - RAAIS
7K views • 9 years ago
1:19:38John Hennessy and David Patterson 2017 ACM A.M. Turing Award Lecture
Association for Computing Machinery (ACM)
150K views • 8 years ago
1:21:07David Patterson - A New Golden Age for Computer Architecture: History, Challenges and Opportunities
UBC Computer Science
99K views • 7 years ago
23:32Industrial Strength High Performance RISC V Processors For Energy Efficient Computing
RISC-V International
8K views • 8 years ago
21:42Future Computers Will Be Radically Different (Analog Computing)
Veritasium
13.2M views • 4 years ago
32:35Scale By The Bay 2019: Bryan Cantrill, Was He Wright All Along? Software After Moore's Law
FunctionalTV
11K views • 6 years ago
1:10:58Trends in Deep Learning Hardware: Bill Dally (NVIDIA)
Paul G. Allen School
32K views • 2 years ago
1:05:28HC2023-K2: Hardware for Deep Learning
hotchipsvideos
15K views • 3 years ago
14:21Building AI Silicon
Tenstorrent
17K views • 4 years ago
24:07AI can't cross this line and we don't know why.
Welch Labs
2.5M views • 2 years ago
2:38Dr. Chris Mack Toasts the End of Moore's Law at SPIE Advanced Lithography 2014
SPIETV
9K views • 12 years ago
2:50:14Simple Code, High Performance
Molly Rocket
463K views • 5 years ago
1:34:42The Great Debate @ARITH23: John Gustafson and William Kahan
dancefan
4K views • 10 years ago
1:26:50The Mill CPU Architecture - the Belt (2 of 13)
Mill Computing, Inc.
38K views • 13 years ago
4 comments from Hacker News
The pattern of holes technique in that link (MURA) is also used in UV lithography for IC fabrication (example: ▶ this video ).
Jim Keller had an interesting talk recently [1] about ways of doing parallel processing to better us the billions of transistors we have - assuming the task is parallelizable. There's the scalar core (i.e the basic CPU) which is easy to program realtively. Then a scalar core with vector instructions - difficult to program efficiently. Then there are arrays of scalar cores, i.e. GPUs, so relatively easy to program again, and now a lot of startups with arrays of scalar cores each with vector engines, so expected to be most difficult to program. He didn't go into why vector instructions are hard to use efficiently, and hard for compiler writers, but I'd be interested if anyone here could explain that. 1. ▶ this video
What makes this more bizarre than Keller’s typical short stints at previous companies is that he has done a ton of media in the last year. He’s probably given more time to journalists/interviewers in 2020 than in the previous 3 decades of his career combined. A Fortune piece from May of this year gave some insights into his plans (as well as provided a nice overview of his career) ( link ). > Keller won’t talk much about the massive chip redesign he’s overseeing—chip designers seldom do—and Intel’s new chip probably won’t be ready for another year or two. Still, both Intel and Keller have scattered some clues about how the chips might work. The new chips will cleanly separate major functions, to make it easier for the company to improve one section at a time—an approach that evokes the chiplet model Keller used at AMD. Keller also hints that Intel’s low-power Atom line of chips may figure more prominently in his future designs for PCs and servers. It doesn’t sound like at press time he was planning to leave. Keller also did a great interview on Lex Fridman’s podcast, which was released in February of this year ( link ). Keller then did a presentation at the Matroid conference (held at the end of February) ( ▶ this video ). I hope he’s ok, since the Intel statement specifically mentioned “personal reasons”.
Jim Keller giving a talk on Moore's Law at Berkeley, link And another ▶ this video And another link DEC, PA Semi, Apple, AMD, Tesla, Intel. He's been everywhere. link The internal announcement memo: link