Skip to content
Hallway
0:00 / 0:00

#jimkeller#tenstorrent#moore'slaw

Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162

Lex Fridman

5M subscribers • 39 videos on Hallway

YouTube
  • Recommended by 3 people: 3 on Hacker News.
  • Presented by Jim Keller, microprocessor engineer

Intermediate. Assumes working knowledge.

1.2M views5 years ago3 recommendations

HardwareAI and machine learningCPUs and computer architectureTransformers and LLMsPerformance and optimization

Lex Fridman interviews legendary chip architect Jim Keller about CPU design, branch prediction, Moore's Law, and the future of AI hardware.

Jim Keller is a legendary microprocessor engineer, previously at AMD, Apple, Tesla, Intel, and now Tenstorrent. Please support this podcast by checking out our sponsors: - Athletic Greens: athleticgreens.com/lex and use code LEX to get 1 month of fish oil - Brooklinen: brooklinen.com and use code LEX to get $25 off + free shipping - ExpressVPN: expressvpn.com/lexpod and use code LexPod to get 3 months free - Belcampo: belcampo.com/lex and use code LEX to get 20% off first order EPISODE LINKS: Jim's Twitter: twitter.com/jimkxa Jim's Wiki: en.wikipedia.org/wiki/Jim_Keller_(engineer) Tenstorrent: tenstorrent.com/ PODCAST INFO: Podcast website: lexfridman.com/podcast Apple Podcasts: apple.co/2lwqZIr Spotify: open.spotify.com/episode/13evHqkSPMpMMU1zfXEtAg RSS: lexfridman.com/feed/podcast/ Full episodes playlist: youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: - Introduction - Good design is both science and engineering - Javascript - RISC vs CISC - What makes a great processor? - Intel vs ARM - Steve Jobs and Apple - Elon Musk and Steve Jobs - Father - Perfection - Modular design - Moore's law - Hardware for deep learning - Making neural networks fast at scale - Andrej Karpathy and Chris Lattner - How GPUs work - Tesla Autopilot, NVIDIA, and Mobileye - Andrej Karpathy and Software 2.0 - Tesla Dojo - Neural networks will understand physics better than humans - Re-engineering the human brain - Infinite fun and the Culture Series by Iain Banks - Neuralink - Dreams - Ideas - Aliens - Jordan Peterson - Viruses - WallStreetBets and Robinhood - Advice for young people - Human condition - Fear is a cage - Love - Regrets SOCIAL: - Twitter: twitter.com/lexfridman - LinkedIn: linkedin.com/in/lexfridman - Facebook: facebook.com/LexFridmanPage - Instagram: instagram.com/lexfridman - Medium: medium.com/@lexfridman - Reddit: reddit.com/r/lexfridman - Support on Patreon: patreon.com/lexfridman

Why it's here

3 people recommend this

What people say. Engineers recommend this interview for Jim Keller's deep wisdom on computer architecture, productivity, and why imperfect designs often win.

jiggawattson Hacker News • Recommends

On “Ask HN: Have you stopped reading most news?”

…h a soundbite from a politician in another country talking about something that will never affect you, or do you want to hear from the horse's mouth how your everyday life will change because of new technology? I used to feel I didn't have time for this kind of thing, but overlapping it with gameplay makes it seem like zero time "spent" on it. 1 link to this video…
View on Hacker News

comboyon Hacker News • Recommends

On “Sam Zeloof and Jim Keller start a new semiconductor fab”

K8 seems pretty small after he made the fucking Zen architecture (and Tesla AI). Lex has good interviews with Jim1, he's not just very smart, he is wise. He started Tenstorrent some time ago with Ljubisa Bajic so I'm assuming this fab is related. Here is youtube channel for Tenstorrent2, and last time I checked it was getting under 100 views per video... Ian also interviewed him3 some time ago. Long story short if I had money that would be relevant in this context I would invest really hard into Tenstorrent. Investing time to listen to the guy seems to be not worse. 1a. link 1b. link to this video 2. link 3. link
View on Hacker News

WestCoastJustinon Hacker News • Recommends

On “Second IC – Homemade 1000 transistor array chip”

I didn't make the connection until now, but Jim Keller was on the Lex Fridman podcast twice 1, 2 and it was awesome. In terms of founders this is pretty great team. 1 link 2 link to this video
View on Hacker News

AlchemistCampon Hacker News • Mentions

On “Jim Keller: The Future of Computing, AI, Life, and Consciousness – Lex Pod #162”

A part about "bad" designs regularly winning both in software and in hardware: link to this video Jim Keller's thoughts of the relationship between productivity and chaos: link to this video His father's later years: link to this video The fast and slow versions of Moore's Law: link to this video On Chris Lattner and Swift: link to this video Do you dream? link to this video Advice to young people: link to this video
View on Hacker News

limaoscarjulieton Hacker News • Mentions

On “Accidentally quadratic: When Python is faster than C++”

Per Jim Keller, current source of speed in CPU is better branch prediction and data fetching prediction. It is possible C++ (or some other lang) may have more met information to drive these better, in which case it will be faster than C/assembler. link to this video
View on Hacker News

joakleafon Hacker News • Mentions

On “Efficiency Is the Enemy”

I heard Jim Keller (the chip-designer) say this (or something similar) recently in a podcast with Lex Fridman. It is at the 24.40 mark in "Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast" link to this video "So there is a graph. Y-axis is productivity. X-axis at 0 is chaos and infinity is complete order. As you improve order, you increase productivity. And at some point productivity peaks, and it goes down again. Too much order -- Nothing can happen... Once you start moving towards order, the force vector that drives you towards order is unstoppable."
View on Hacker News

anonymouse008on Hacker News • Mentions

On “B-tree Path Hints”

I'm not qualified to truly understand this, but when Lex first interviewed Jim Keller, Jim basically said regarding processor design -- 'yeah, if you just guess the same result as last time, you get a 50% speed increase.' First Interview (where that poorly paraphrased quote resides): link Second Interview: link to this video
View on Hacker News

ricopagson Hacker News • Mentions

On “Mojo – a new programming language for AI developers”

Congratulations on the launch preview! This is exciting, as I've been waiting for this announcement since Jim Keller's callout on Lex Fridman podcast two years ago0. I'm curious about the teasing around open source. Obviously the amount of money and the slick product launch dictate a need to capitalize on this pooled expertise. Don't want to give away the game to the hyperscalers. I wonder what the revenue and license models are going to end up looking like. A cloud of their own, professional services to HW manufacturers to optimize their performance, professional services to hyperscalers? Curious if anybody has any ideas beyond the obvious. 0 link to this video
View on Hacker News