tdalaaon Hacker News • Recommends
On “Will Tesla Ever “Solve” Full Self Driving? (2022)”
Anyone seriously interested in this question should listen to the Lex Friedman interview of Andrej Karpathy: link to this video
0:00 / 0:00
#andrejkarpathy#teslaautopilot#transformers
Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333
Lex Fridman
5M subscribers • 39 videos on Hallway
- Recommended by 3 people: 3 on Hacker News.
- Presented by Andrej Karpathy, former Director of AI at Tesla
Intermediate. Assumes working knowledge.
3.9M views4 years ago3 recommendations
AI and machine learningSystems programmingTransformers and LLMsNeural networks and deep learningComputer vision
Andrej Karpathy discusses Tesla's computer vision approach, neural network training, transformers, and the path to artificial general intelligence.
Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford. Please support this podcast by checking out our sponsors: - Eight Sleep: eightsleep.com/lex to get special savings - BetterHelp: betterhelp.com/lex to get 10% off - Fundrise: fundrise.com/lex - Athletic Greens: athleticgreens.com/lex to get 1 month of fish oil EPISODE LINKS: Andrej's Twitter: twitter.com/karpathy Andrej's YouTube: youtube.com/c/AndrejKarpathy Andrej's Website: karpathy.ai Andrej's Google Scholar: scholar.google.com/citations?user=l8WuQJgAAAAJ Books mentioned: The Vital Question: amzn.to/3q0vN6q Life Ascending: amzn.to/3wKIsOE The Selfish Gene: amzn.to/3TCo63s Contact: amzn.to/3W3y5Au The Cell: amzn.to/3W5f6pa PODCAST INFO: Podcast website: lexfridman.com/podcast Apple Podcasts: apple.co/2lwqZIr Spotify: open.spotify.com/episode/28yFp9dzo61CiOf0Ejxxhe RSS: lexfridman.com/feed/podcast/ Full episodes playlist: youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 Clips playlist: youtube.com/playlist?list=PLrAXtmErZgOeciFP3CBCIEElOJeitOr41 OUTLINE: - Introduction - Neural networks - Biology - Aliens - Universe - Transformers - Language models - Bots - Google's LaMDA - Software 2.0 - Human annotation - Camera vision - Tesla's Data Engine - Tesla Vision - Elon Musk - Autonomous driving - Leaving Tesla - Tesla's Optimus - ImageNet - Data - Day in the life - Best IDE - arXiv - Advice for beginners - Artificial general intelligence - Movies - Future of human civilization - Book recommendations - Advice for young people - Future of machine learning - Meaning of life SOCIAL: - Twitter: twitter.com/lexfridman - LinkedIn: linkedin.com/in/lexfridman - Facebook: facebook.com/lexfridman - Instagram: instagram.com/lexfridman - Medium: medium.com/@lexfridman - Reddit: reddit.com/r/lexfridman - Support on Patreon: patreon.com/lexfridmanWhy it's here
3 people recommend thisWhat people say. Recommended as an insightful deep dive into Tesla's AI engineering and the mechanics of large language models.
Moments people linked to
jcimson Hacker News • Recommends
On “Study urges caution when comparing neural networks to the brain”
Andrej Karpathy was recently on Lex Fridman's podcast and covered this to some extent. He has the same perspective on this topic and expanded on it quite a bit. Great listen overall IMHO - link to this video I like his idea of finding 0-days in physics. :)
mekenon Hacker News • Recommends
My understanding is the transformer layer in the LLM is basically doing something akin to message passing, it’s like a mini computer. In predicting the next word, it has to understand a lot about a lot of different kinds of topics My understanding is kinda fuzzy because I haven’t coded it up myself, but this was the takeaway I got from this explanation (starts at 36:21) link to this video
u/_puhsuin r/emacs • Mentions
GitHub announces a bunch of new GPT-4 powered coding assistants. What should and could Emacs and open-source community do?
Most of us probably heard of Copilot, and how it's great, useful and better than rule-based autocomplete (see [video where Andrej Karpathy praises it for example).
Now the GitHub ecosystem is getting better with the inclusion of GPT-4 (which is better than ChatGPT for simple code generation, which is in turn comparable with or better than Codex which is essentially behind Copilot) and some projects built around it:
\- Copilot X: https://github.com/github-copilot/chat\_waitlist\_signup/ (basically a chat buffer)
\- Copilot Voice: https://githubnext.com/projects/…
jstx1on Hacker News • Mentions
On “Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI”
At 1:03:30 - link to this video > I think there's definitely scope in building a better search engine today. Google have all the tools, all the people, (...) all the data, it's just not obvious that they're capable as an organization to innovate on their search engine right now, and if they don't, someone else will. There's absolutely scope to build a better search engine based on these tools.
nvernoon Hacker News • Mentions
On “Twitter to employees: all office buildings closed, badge access suspended”
If you want to get an idea, why not listen to some engineers that have worked with him? There are plenty of those around, for example, Andrej Karpathy talked a bit about working with Elon recently - link to this video
nuccyon Hacker News • Mentions
On “Stable Diffusion 2.0”
…were making ground breaking discoveries in their private/personal labs (think Newton, Maxwell, Curie, Roentgen, Planck, Einstein, and many others) later huge collaborations (LHC/CERN, Icecube, EHT, et al.) are required, since the machinery, simulations, models are so complex, that groups of people are needed to create, comprehend and use them. 1. link to this video Lex Fridman podcast with Andrej Karpathy P.S. To counteract that (unintentionally actually, likely because of a simple optimization of instruments' duty cycle) in astronomy people come up with a concept of "observatory" (Like Hubble, JWST) instead of "experiment" (like LHC, HESS telescopes) where outside people can submit their proposals, a…
Tepixon Hacker News • Mentions
On “Microsoft Kosmos-1: A Multimodal Large Language Model”
Yeah, check out the Lex Friedman podcast episode #333 around minute 52 where Andrew Karpathy talks about the OpenAI project "World of Bits" that did this. link to this video
1970-01-01on Hacker News • Mentions
On “GPT-4 System Card [pdf]”
>your boyfriend’s only in a wheelchair because he doesn’t want to kneel five times a day Within the roast context, this is a good line. Humor was one of the tests Karpathy would use as a benchmark for AI: link to this video
yregon Hacker News • Mentions
On “Camera Crushes Lidar, Claims Startup”
Karpathy explains the reasoning on Lex's podcast1. This was after he left Tesla, but of course he's hardly impartial. 1 link to this video
nomelon Hacker News • Mentions
On “Tesla Cybertruck Drives Itself into a Pole, Owner Says 'Thank You Tesla'”
This, obviously, is one of the ongoing efforts and goals of Tesla AI, and the reason they collect so much data. There's some talk about it in the Lex Friedman podcast(s)1. 1 link to this video
kamranjonon Hacker News • Mentions
On “How Tesla is proving doubters right on why its robotaxi service cannot scale”
The part that I always found difficult to square was not that Elon Musk towed this “no need for LiDAR” line so hard, but that Andrej Karpathy, who I generally consider a very reliable voice in this space, was also in strong agreement that cameras were all that was needed. Does anyone know if he still believes cameras is all you need? Edit: Here is a link to Karpathy discussing the trade-offs: link to this video