Building the Software 2 0 Stack (Andrej Karpathy)
Databricks1 HN recommender · recommended in 1 month, 2019–2022
talk · intermediate · evergreen · 2019–2022 on HN
Andrej Karpathy's Databricks talk on Software 2.0, the shift from human-written code to code produced by neural network training. It covers how developer work moves toward curating datasets, the advantages and challenges, and opportunities for new tooling.
HN uses it as the primary source for the 'Software 2.0' idea and recommends it as a quick talk on the next software stack.
Up next
2 mo on HNHow does Starlink Satellite Internet Work?📡☄🖥
Branch Education
2 HN recommender · 2022–2024
16 mo on HNThe spelled-out intro to neural networks and backpropagation: building micrograd
Andrej Karpathy
17 HN recommender · 2022–2025
14 mo on HNBut what is a neural network? | Deep learning chapter 1
3Blue1Brown
16 HN recommender · 2017–2025
10 mo on HNAlphaGo - The Movie | Full award-winning documentary
Google DeepMind
10 HN recommender · 2020–2025
10 mo on HNTransformers, the tech behind LLMs | Deep Learning Chapter 5
3Blue1Brown
13 HN recommender · 2024–2026
10 mo on HNUSENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible?
USENIX
10 HN recommender · 2018–2026
11 mo on HNLecture 1 | Machine Learning (Stanford)
Stanford
11 HN recommender · 2008–2020
10 mo on HNMarI/O - Machine Learning for Video Games
SethBling
10 HN recommender · 2015–2026
8 mo on HNDeep Dive into LLMs like ChatGPT
Andrej Karpathy
10 HN recommender · 2025–2026
10 mo on HNComputer program that learns to play classic NES games
suckerpinch
9 HN recommender · 2015–2025
9 mo on HNRL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning
Google DeepMind
9 HN recommender · 2017–2026
8 mo on HNLet's build GPT: from scratch, in code, spelled out.
Andrej Karpathy
14 HN recommender · 2023–2025
3 comments from Hacker News
Btw, for anyone interested, here's a good/quick talk by Andrej Kapathy on what it will take to build the next software stack. ▶ this video
Was there a dedicated HN submission for this topic? This is extremely fascinating to me. In what Andrej Karpathy calls "software 2.0"[1], leaking your model is equivalent to leaking the main IP of your company. Unlike source code where it loses value quickly out of context (e.g. twitch leaked their code yet that didn't spawn a bunch of twitch clones), models can be fine-tuned and transfer-learning-ed for many other purposes Since these models take millions of dollars to train, I see these sort of hacks becoming a thing! I wonder when companies will start adding "trap streets"[2] to prove that others are using their stolen models? [1] ▶ this video [2] link
Andrej Karpathy (who was one of the presenters today) actually made similar statements last year, about how the part of the software stack that is not neural networks is gradually shrinking: ▶ this video