The Bitter Lesson

Plain English. Richard Sutton's 2019 essay observing that, over seventy years of AI research, general methods that scale with computation have always beaten systems built on hand-crafted human knowledge. Cleverness loses to scale — bitterly, because researchers keep betting on cleverness anyway.

Why it moves money. It is the most-cited idea in AI, and functionally a valuation tool. Any moat built on domain-specific engineering — curated features, expert rules, elaborate scaffolding around a model's current weaknesses — is a bet against the Bitter Lesson, and history says that bet loses when the next scaled-up general model absorbs the cleverness for free. It is also the intellectual licence for the capex boom: if scale reliably wins, buying compute is buying capability. The counter-case matters too — where physics, data scarcity or economics cap the scaling, specialised approaches keep their value, and knowing which regime you are in is the analysis.

What to watch. Each frontier release, watch which specialised products it absorbs — and note the domains where it keeps failing to, because those are where engineering moats are real.

From the signals. Mistral Forge: the Bitter Lesson comes for enterprise fine-tuning. The Inverse Bitter Lesson: why specialised software beats generalised. The RAM crisis: the Bitter Lesson hits physics.

Further reading. Sutton, The Bitter Lesson (2019)