HackerTube
HomeLongsLikedHistoryWatch laterCategoriesPlaylistsSettings

Jim Keller - Moore's Law in the age of AI Chips

Matroid1 HN recommender · recommended in 1 month, 2020-2020
YouTube
33K views · 6 years ago · talk · evergreen

Jim Keller's talk at the 2020 Scaled Machine Learning conference on Moore's Law in the age of AI chips. He compares scalar, vector and GPU-style parallel approaches to computation.

Cited in hardware threads as a Keller talk on the different ways of doing parallel processing.

Computer architecture & CPUsMachine learning & deep learningTech pioneers & interviews#jimkeller#moore'slaw#parallelprocessing#vectorprocessing#aiaccelerators

4 comments from Hacker News

@metrognome2020 · in “Cameras and Lenses”

The pattern of holes technique in that link (MURA) is also used in UV lithography for IC fabrication (example: ▶ this video ).

CitesView on HN
@tails4e2020 · in “Linus Torvalds on AVX512”

Jim Keller had an interesting talk recently [1] about ways of doing parallel processing to better us the billions of transistors we have - assuming the task is parallelizable. There's the scalar core (i.e the basic CPU) which is easy to program realtively. Then a scalar core with vector instructions - difficult to program efficiently. Then there are arrays of scalar cores, i.e. GPUs, so relatively easy to program again, and now a lot of startups with arrays of scalar cores each with vector engines, so expected to be most difficult to program. He didn't go into why vector instructions are hard to use efficiently, and hard for compiler writers, but I'd be interested if anyone here could explain that. 1. ▶ this video

RecommendsView on HN
@cepth2020 · in “Jim Keller Resigns from Intel, Effective Immediately”

What makes this more bizarre than Keller’s typical short stints at previous companies is that he has done a ton of media in the last year. He’s probably given more time to journalists/interviewers in 2020 than in the previous 3 decades of his career combined. A Fortune piece from May of this year gave some insights into his plans (as well as provided a nice overview of his career) ( link ). > Keller won’t talk much about the massive chip redesign he’s overseeing—chip designers seldom do—and Intel’s new chip probably won’t be ready for another year or two. Still, both Intel and Keller have scattered some clues about how the chips might work. The new chips will cleanly separate major functions, to make it easier for the company to improve one section at a time—an approach that evokes the chiplet model Keller used at AMD. Keller also hints that Intel’s low-power Atom line of chips may figure more prominently in his future designs for PCs and servers. It doesn’t sound like at press time he was planning to leave. Keller also did a great interview on Lex Fridman’s podcast, which was released in February of this year ( link ). Keller then did a presentation at the Matroid conference (held at the end of February) ( ▶ this video ). I hope he’s ok, since the Intel statement specifically mentioned “personal reasons”.

CitesView on HN
@CalChris2020 · in “Jim Keller to Depart Intel”

Jim Keller giving a talk on Moore's Law at Berkeley, link And another ▶ this video And another link DEC, PA Semi, Apple, AMD, Tesla, Intel. He's been everywhere. link The internal announcement memo: link

CitesView on HN
Jim Keller: Moore’s Law is Not Dead1:04:53

Jim Keller: Moore’s Law is Not Dead

UC Berkeley EECS
77K views • 7 years ago
[7] Jim Keller, Silicon Wizard 🧙‍♂️1:37:12

[7] Jim Keller, Silicon Wizard 🧙‍♂️

TechTechPotato
67K views • 5 years ago
Moore's Law is Not Dead (Jim Keller) | AI Podcast Clips26:02

Moore's Law is Not Dead (Jim Keller) | AI Podcast Clips

Lex Fridman
172K views • 6 years ago
Jim Keller: Moore's Law, Microprocessors, and First Principles | Lex Fridman Podcast #701:34:44

Jim Keller: Moore's Law, Microprocessors, and First Principles | Lex Fridman Podcast #70

Lex Fridman
742K views • 6 years ago
Change w/ Jim Keller56:54

Change w/ Jim Keller

Tenstorrent
61K views • 3 years ago
Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #1622:39:15

Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162

Lex Fridman
1.3M views • 5 years ago
RAAIS 2017 - Simon Knowles, Co-Founder and CTO of Graphcore35:45

RAAIS 2017 - Simon Knowles, Co-Founder and CTO of Graphcore

The Research and Applied AI Summit - RAAIS
7K views • 9 years ago
John Hennessy and David Patterson 2017 ACM A.M. Turing Award Lecture1:19:38

John Hennessy and David Patterson 2017 ACM A.M. Turing Award Lecture

Association for Computing Machinery (ACM)
150K views • 8 years ago
David Patterson - A New Golden Age for Computer Architecture: History, Challenges and Opportunities1:21:07

David Patterson - A New Golden Age for Computer Architecture: History, Challenges and Opportunities

UBC Computer Science
99K views • 7 years ago
Industrial Strength High Performance RISC V Processors For Energy Efficient Computing23:32

Industrial Strength High Performance RISC V Processors For Energy Efficient Computing

RISC-V International
8K views • 8 years ago
Future Computers Will Be Radically Different (Analog Computing)21:42

Future Computers Will Be Radically Different (Analog Computing)

Veritasium
13.2M views • 4 years ago
Scale By The Bay 2019: Bryan Cantrill, Was He Wright All Along? Software After Moore's Law32:35

Scale By The Bay 2019: Bryan Cantrill, Was He Wright All Along? Software After Moore's Law

FunctionalTV
11K views • 6 years ago
Trends in Deep Learning Hardware: Bill Dally (NVIDIA)1:10:58

Trends in Deep Learning Hardware: Bill Dally (NVIDIA)

Paul G. Allen School
32K views • 2 years ago
HC2023-K2: Hardware for Deep Learning1:05:28

HC2023-K2: Hardware for Deep Learning

hotchipsvideos
15K views • 3 years ago
Building AI Silicon14:21

Building AI Silicon

Tenstorrent
17K views • 4 years ago
AI can't cross this line and we don't know why.24:07

AI can't cross this line and we don't know why.

Welch Labs
2.5M views • 2 years ago
Dr. Chris Mack Toasts the End of Moore's Law at SPIE Advanced Lithography 20142:38

Dr. Chris Mack Toasts the End of Moore's Law at SPIE Advanced Lithography 2014

SPIETV
9K views • 12 years ago
Simple Code, High Performance2:50:14

Simple Code, High Performance

Molly Rocket
463K views • 5 years ago
The Great Debate @ARITH23: John Gustafson and William Kahan1:34:42

The Great Debate @ARITH23: John Gustafson and William Kahan

dancefan
4K views • 10 years ago
The Mill CPU Architecture - the Belt (2 of 13)1:26:50

The Mill CPU Architecture - the Belt (2 of 13)

Mill Computing, Inc.
38K views • 13 years ago