__sy__on Hacker News • Recommends
On “Launch HN: Aquarium (YC S20) – Improve Your ML Dataset Quality”
Btw, for anyone interested, here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack. link to this video
0:00 / 0:00
#software2.0#neuralnetworks#andrejkarpathy
Building the Software 2 0 Stack (Andrej Karpathy)
Databricks
169K subscribers • 4 videos on Hallway
- Recommended by 1 person: 1 on Hacker News.
- Presented by Andrej Karpathy
- May be out of date. Uploaded 8 years ago, in an area where tools change fast.
- An opinion. It argues one side of a question engineers disagree on.
Intermediate. Assumes working knowledge.
72K views8 years ago1 recommendation
AI and machine learningSoftware designNeural networks and deep learningTraining and serving models
Andrej Karpathy explains the transition from human-written code to neural network optimization and the tooling required for this new paradigm.
A lot of our code is in the process of being transitioned from Software 1.0 (code written by humans) to Software 2.0 (code written by an optimization, commonly in the form of neural network training). In the new paradigm, much of the attention of a developer shifts from designing an explicit algorithm to curating large, varied, and clean datasets, which indirectly influence the code. I will provide a number of examples of this ongoing transition, cover the advantages and challenges of the new stack, and outline multiple opportunities for new tooling. To learn more: databricks.com/product/getting-started-guide About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business. Read more here: databricks.com/product/unified-data-analytics-platform Connect with us: Website: databricks.com Facebook: facebook.com/databricksinc Twitter: twitter.com/databricks LinkedIn: linkedin.com/company/databricks Instagram: instagram.com/databricksinc/ Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. databricks.com/databricks-named-leader-by-gartnerWhy it's here
1 person recommends thisWhat people say. Recommended as a foundational talk on the shift toward data-driven software development and machine learning workflows.
wcoenenon Hacker News • Mentions
On “Tesla Live Stream – Autonomy Day [video]”
Andrej Karpathy (who was one of the presenters today) actually made similar statements last year, about how the part of the software stack that is not neural networks is gradually shrinking: link to this video
gfdon Hacker News • Mentions
On “/r/StableDiffusion – Mod here – My side of the story”
Was there a dedicated HN submission for this topic? This is extremely fascinating to me. In what Andrej Karpathy calls "software 2.0"1, leaking your model is equivalent to leaking the main IP of your company. Unlike source code where it loses value quickly out of context (e.g. twitch leaked their code yet that didn't spawn a bunch of twitch clones), models can be fine-tuned and transfer-learning-ed for many other purposes Since these models take millions of dollars to train, I see these sort of hacks becoming a thing! I wonder when companies will start adding "trap streets"2 to prove that others are using their stolen models? 1 link to this video 2 link