Skip to content
Hallway
0:00 / 0:00

#andrejkarpathy#teslaautopilot#waymo

No Priors Ep. 80 | With Andrej Karpathy from OpenAI and Tesla

No Priors: AI, Machine Learning, Tech, & Startups

99K subscribers • 1 video on Hallway

YouTube
  • Recommended by 1 person: 1 on Hacker News.
  • Presented by Andrej Karpathy, co-founder of OpenAI and former Tesla Autopilot lead

Intermediate. Assumes working knowledge.

242K views2 years ago1 recommendation

AI and machine learningTransformers and LLMsComputer visionNeural networks and deep learning

Andrej Karpathy discusses the evolution of self-driving cars, comparing Tesla and Waymo, AI development bottlenecks, and his new education startup Eureka Labs.

Andrej Karpathy joins Sarah and Elad in this week of No Priors. Andrej, who was a founding team member of OpenAI and the former Tesla Autopilot leader, needs no introduction. In this episode, Andrej discusses the evolution of self-driving cars, comparing Tesla's and Waymo’s approaches, and the technical challenges ahead. They also cover Tesla’s Optimus humanoid robot, the bottlenecks of AI development today, and how AI capabilities could be further integrated with human cognition. Andrej shares more about his new mission Eureka Labs and his insights into AI-driven education and what young people should study to prepare for the reality ahead. Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Karpathy Show Notes: Introduction Evolution of self-driving cars The Tesla vs. Waymo approach to self-driving Training Optimus with automotive models Reasoning behind the humanoid form factor Existing challenges in robotics Bottlenecks of AI progress Parallels between human cognition and AI models Merging human cognition with AI capabilities Building high performance small models Andrej’s current work in AI-enabled education How AI-driven education reshapes knowledge networks and status Eureka Labs What young people study to prepare for the future

Why it's here

1 person recommends this

What people say. Recommended for Karpathy's valuable insights on neural networks, AI infrastructure, and the comparison between Tesla and Waymo.

modelesson Hacker News • Recommends

On “Tesla Robotaxi”

Check the video here. link to this video He's not just politely saying he likes Tesla, he's talking for 5 minutes in detail about exactly why he believes Tesla is ahead of Waymo and will beat them to scale.
View on Hacker News

93poon Hacker News • Mentions

On “Learning to Reason with LLMs”

Karpathy himself believes that neural networks are perfectly plausible as a key component to AGI. He has said that it doesn't need to be superseded by something better, it's just that everything else around it (especially infrastructure) needs to improve. As one of the most valuable opinions in the entire world on the subject, I tend to trust what he said. source: link to this video
View on Hacker News

jstummbilligon Hacker News • Mentions

On “Facebook scraped every Australian adult user's public posts to train AI”

This benefits actually everyone. If our combined creative work until this point is what turns out to be necessary to kick-start a great shot at abundance (and if you do not believe that, if it's all for nothing, why care at all about the money wasted on models?) it might simply be our societal moral obligation to endorse it -- just as is will be the model creators moral obligation to uphold their end of this deal. Interestingly, Andrej Karpathy recently described the data we are debating as more or less undesirable to build a better LLM and accidentally good enough to have made it work so far ( link to this video ). We'll see about that.
View on Hacker News

93poon Hacker News • Mentions

On “OpenAI Discusses Giving Altman 7% Stake in For-Profit Shift”

…believes that neural networks are perfectly plausible as a key component to AGI. He has said that it doesn't need to be superseded by something better, it's just that everything else around it (especially infrastructure) needs to improve. As one of the most valuable opinions in the entire world on the subject, I tend to trust what he said. source: link to this video I think the consensus of people with the most valid opinions is that AGI is actually not that far off, definitely in our lifetimes, and likely in the next decade. I'm personally not concerned if we recreate a human in a computer, in fact we might be better off not doing that. If we can replace nearly all manual labor, all software developme…
View on Hacker News

HarHarVeryFunnyon Hacker News • Mentions

On “Two things LLM coding agents are still bad at”

Right. In a recent YouTube interview Karpathy claimed that LLMs have a lot more "working memory" than a human: link to this video What I assume he's talking about is internal activations such as stored in KV cache that have same lifetime as tokens in the input, but this really isn't the same as "working memory" since these are tied to the input and don't change. What it seems an LLM would need to do better at these sort of iterative/sequencing tasks would be a real working memory that had more arbitrary task-duration lifetime and could be updated (vs fixed KV cache), and would allow it to track progress or more generally maintain context (english usage - not LLM) over the course of a task. I'm a bit su…
View on Hacker News