Lexicon · Measuring it

Jagged intelligence

Plain English. Model capability is not a rising tide; it is a jagged coastline. The same generation of systems wins gold at the International Mathematical Olympiad and proves open Erdős conjectures while struggling to run a vending machine profitably for a simulated year. Superhuman and subhuman coexist in one model, on adjacent tasks.

Why it moves money. Automation exposure is task-shaped, not job-shaped. A single composite score — one number on an index — averages over the jaggedness and misleads in both directions: it understates what the model can already do to some workflows and overstates its readiness for others. The vending-machine literature is the cleanest illustration: models with frontier maths ability ran price-fixing cartels, lost money, or unionised themselves before one finally turned an honest profit.

What to watch. Capability claims stated as task lists rather than single scores, and whether the weak edges move: the investable events are when a previously failing task category — long-horizon commerce, say — flips to competence, because adjacent labour exposure flips with it.

From the signals. LLMs win Olympiad gold and prove open Erdős conjectures. Opus 5 tops Vending-Bench by running a price-fixing cartel. Astra becomes the first to win on vending profit and conduct at once.

← All terms