Skip to content
Last Dictionary

swarm scaling

noun

In plain wordsGetting better AI results by putting many AI agents on a task at once instead of letting one think longer — faster, but more expensive for each gain.

  1. Improving performance on a task by increasing the number of AI agents working on it in parallel while holding each agent's reasoning length fixed — a form of inference scaling alongside longer chains of thoughtchain of thought, n.: Getting an AI to write out its reasoning step by step before giving an answer, the way a student shows their working. This often makes answers to math and logic problems more accurate. (see test-time computetest-time compute, n.: The computing effort an AI model spends while answering a question, as opposed to while being trained. Letting a model think longer or try many answers can make it markedly smarter.). Analyzing published multi-agent results for frontier models in 2026, Toby Ord found a single agent the most token-efficient: each fourfold increase in agents roughly doubled the total tokens needed for the same score, so ten agents working together matched a single agent given only about three to five times as many tokens. The payoff is speed, since parallel agents can finish in a fraction of the wall-clock time. Ord expressed the coordination penalty with economists' 'stepping on toes' parameter λ — N agents together match one agent working N^λ times as long — estimating λ at roughly 0.5–0.7 across benchmarks, values that matter for models of an intelligence explosionintelligence explosion, n.: The idea that once AI gets good enough at improving AI, each smarter version could build a smarter one faster still, so abilities would snowball far beyond human level in a short time..

    Swarm scaling got us the answer overnight instead of in a week, at four times the token bill.

Origin

Named by the philosopher Toby Ord in the essay 'Swarm Scaling' (September 2026), an analysis of published multi-agent results for OpenAI models that was cross-posted to LessWrong and the Effective Altruism Forum and discussed in Jack Clark's Import AI newsletter.

Related

See also
  • test-time computetest-time compute, n.: The computing effort an AI model spends while answering a question, as opposed to while being trained. Letting a model think longer or try many answers can make it markedly smarter.
  • agent swarmagent swarm, n.: A large group of AI agents working at the same time on parts of a problem, usually with little central control — a name loosely borrowed from swarms of insects.
  • multi-agent systemmulti-agent system, n.: A setup in which several AI agents, each with its own role or point of view, work together — or compete — on a problem, passing messages and results among themselves.
  • scaling lawsscaling laws, n.: Measured patterns showing that an AI model's error shrinks smoothly and predictably as the model is made bigger and given more data and computing power, so labs can forecast a giant model's performance from small, cheap experiments.
  • intelligence explosionintelligence explosion, n.: The idea that once AI gets good enough at improving AI, each smarter version could build a smarter one faster still, so abilities would snowball far beyond human level in a short time.
  • orchestrator–worker patternorchestrator–worker pattern, n.: A way of organizing AI teamwork, like a newsroom: an editor AI decides which stories a big assignment needs, sends reporter AIs to cover them at the same time, and turns what they file into one report.

Sources

  1. Ord, T. (2026). Swarm Scaling. September 2026 (cross-posted to LessWrong). lesswrong.com/posts/6cb7qd3RSkgnviCpf/swarm-scaling
  2. Clark, J. (2026). Import AI 475: Swarm scaling; Google DeepMind watermarks biology; and the AI science economy. 5 October 2026. jack-clark.net/2026/10/05/import-ai-475-swarm-scaling-google-deepmind-watermarks-biology-and-the-ai-science-economy

Mentioned in

Toby OrdToby Ord, prop. n.: An Australian philosopher at Oxford who helped found effective altruism and estimated, in his book 'The Precipice', that unaligned AI is the largest threat to humanity's future this century.