In 2001, Jeff Dean and Sanjay Ghemawat did the math and realized Google’s entire search index would fit in RAM — then shipped it in a few days, and search got fast. In 2013, another napkin calculation showed that three minutes of daily speech recognition per user would require doubling Google’s server fleet. That one became the TPU.
At Startup School 2026, Google’s Chief Scientist talks with YC’s Diana Hu through the thought experiments behind both, why inference hardware is the next specialization, and where two or three people in a room can still win.
Transcript: https://www.ycrootaccess.com/p/jeff-dean-the-1-rule-for-building
Apply to Y Combinator: https://www.ycombinator.com/apply
Work at a startup: https://www.ycombinator.com/jobs
Chapters:
00:00 — Intro
00:07 — Are AI Models Already Junior Engineers?
01:44 — AI Systems That Improve Themselves
02:40 — The Google Search Breakthrough That Changed Everything
04:38 — AI Agents Will Run for Weeks
05:58 — The Napkin Math That Led to TPUs
09:20 — How to Find Breakthrough Ideas
10:25 — The AI Engineer’s New Mental Model
12:33 — Why AI Is Really an Energy Problem
16:11 — Context Engineering Is the Next Frontier
19:46 — The Skill That Made AI Better at Optimization
22:13 — Why Long-Running Agents Fail
25:21 — Where Startups Can Still Beat Google
31:19 — How to Become an AI-Native Founder
36:36 — Question Your Biggest Assumptions
42:08 — AI That Builds Better AI
50:02 — Build Something That Truly Matters
source
