AI arms race
In plain wordsA competition among countries or companies to build the most powerful AI first, in which fear of falling behind pushes everyone to move faster and cut corners on safety.
Competition among states or companies to develop more capable AI faster than rivals, especially when the perceived stakes, such as military or economic dominance or a decisive strategic advantagedecisive strategic advantage, n.: A lead in technology and power so large that whoever holds it, whether a country, a company or an AI, could impose its will on the whole world., create pressure to put speed ahead of safety. Game-theoretic models show how racing erodes precautions: each participant fears that slowing down only hands the lead to a less careful rival. The term covers two overlapping arenas: geopolitical competition, above all between the United States and China, involving export controls on AI chipsexport controls on AI chips, n.: Government rules that limit which countries and companies may buy the most advanced AI chips and the machines used to make them. The United States uses them mainly to slow China's progress in AI., national compute programs and calls for a Manhattan Project for AGI; and commercial competition among frontier laboratoriesfrontier lab, n.: One of the handful of companies building the most advanced AI models of the moment, spending billions of dollars on computing power to train them. over model releases, talent and investment. Proposed remedies include safety commitments binding all competitors, verification of compute use, international agreements and deterrence schemes such as Mutual Assured AI MalfunctionMutual Assured AI Malfunction, n.: A proposed deterrence strategy in which any country racing for overwhelming AI dominance would expect rivals to sabotage its AI projects, so none tries, much as with nuclear deterrence.. Critics of the framing argue that it is partly self-fulfilling, that AI is not a single winner-take-all prize, and that race rhetoric is used to justify deregulation.
Every lab says it would slow down if the others did; that is what makes it an arms race.
Origin
Applied to AI by the 2010s, in debates over autonomous weapons and in Stuart Armstrong, Nick Bostrom and Carl Shulman's 2016 model 'Racing to the Precipice'. It went mainstream after Vladimir Putin said in 2017 that whoever leads in AI 'will become the ruler of the world'; in 2024 a US congressional commission recommended a Manhattan Project-like program to race to AGI.
Related
- multipolar scenariomultipolar scenario, n.: A possible future in which many powerful AIs, companies or countries coexist and compete, with none able to dominate the rest.
- decisive strategic advantagedecisive strategic advantage, n.: A lead in technology and power so large that whoever holds it, whether a country, a company or an AI, could impose its will on the whole world.
- Mutual Assured AI MalfunctionMutual Assured AI Malfunction, n.: A proposed deterrence strategy in which any country racing for overwhelming AI dominance would expect rivals to sabotage its AI projects, so none tries, much as with nuclear deterrence.
- export controls on AI chipsexport controls on AI chips, n.: Government rules that limit which countries and companies may buy the most advanced AI chips and the machines used to make them. The United States uses them mainly to slow China's progress in AI.
- AI pauseAI pause, n.: A proposed halt, temporary or indefinite, on building AI systems more powerful than today's, to give safety research and regulation time to catch up.
- DeepSeek momentDeepSeek moment, n.: The shock of January 2025, when a little-known Chinese company released a free AI model nearly as good as the best American ones at a fraction of the reported cost, briefly wiping hundreds of billions off chip stocks.
- sovereign AIsovereign AI, n.: A country's ability to build and run AI on its own terms, so that the computers, models and know-how it relies on cannot be withheld or dictated by foreign companies or governments.
Sources
- Armstrong, S., Bostrom, N. & Shulman, C. (2016). Racing to the precipice: a model of artificial intelligence development. AI & Society 31(2).
Mentioned in
AI riskAI risk, n.: The ways AI could cause harm: people misusing it on purpose, systems behaving in ways nobody intended, and slower effects on jobs, power and society that no single person causes., export controls on AI chipsexport controls on AI chips, n.: Government rules that limit which countries and companies may buy the most advanced AI chips and the machines used to make them. The United States uses them mainly to slow China's progress in AI., lethal autonomous weapons systemlethal autonomous weapons system, n.: A weapon that, after a person sets it going, picks out and attacks targets — including people — on its own, with no human deciding each strike. Critics call them killer robots., AI 2027AI 2027, prop. n.: A detailed 2025 forecast, written as a month-by-month story, imagining AI becoming superhuman by the end of 2027, with two alternative endings depending on whether humanity slows down., AI pauseAI pause, n.: A proposed halt, temporary or indefinite, on building AI systems more powerful than today's, to give safety research and regulation time to catch up., DeepSeek momentDeepSeek moment, n.: The shock of January 2025, when a little-known Chinese company released a free AI model nearly as good as the best American ones at a fraction of the reported cost, briefly wiping hundreds of billions off chip stocks., frontier labfrontier lab, n.: One of the handful of companies building the most advanced AI models of the moment, spending billions of dollars on computing power to train them., game theorygame theory, n.: The mathematics of strategic decisions, where each player's best move depends on what the others do. It is used to study competition and cooperation among people, firms, nations and AI agents., alignment taxalignment tax, n.: The price of caution in AI: whatever performance, money or time a developer sacrifices to make a system safe and aligned, compared with an otherwise identical system built with no such care., Center for Security and Emerging TechnologyCenter for Security and Emerging Technology, prop. n.: A Georgetown University think tank in Washington, D.C., whose researchers advise the US government on AI and national security, paying special attention to China and to the chip supply chain., CERN for AICERN for AI, n.: A proposed publicly funded, international AI laboratory modeled on CERN, the European particle-physics center, where countries would pool money, computers and scientists to do AI research together., decisive strategic advantagedecisive strategic advantage, n.: A lead in technology and power so large that whoever holds it, whether a country, a company or an AI, could impose its will on the whole world., Fifth Generation Computer Systems projectFifth Generation Computer Systems project, prop. n.: Japan's government-backed effort, from 1982 to 1992, to build a new kind of computer that reasons with logic using many processors at once. It fell short, but it alarmed other countries into launching AI programs of their own., Leopold AschenbrennerLeopold Aschenbrenner, prop. n.: A German-born former OpenAI researcher whose 2024 essay series 'Situational Awareness' predicted human-level AI around 2027 and a government-led race to build superintelligence., multipolar scenariomultipolar scenario, n.: A possible future in which many powerful AIs, companies or countries coexist and compete, with none able to dominate the rest., Mutual Assured AI MalfunctionMutual Assured AI Malfunction, n.: A proposed deterrence strategy in which any country racing for overwhelming AI dominance would expect rivals to sabotage its AI projects, so none tries, much as with nuclear deterrence., pivotal actpivotal act, n.: A single decisive action, usually imagined as carried out with an early powerful AI, that would stop anyone else from building dangerous AI and so change the world's long-term course., Situational Awareness (essay)Situational Awareness (essay), prop. n.: A long 2024 essay by a former OpenAI researcher arguing that AGI could arrive around 2027, that superintelligence could follow soon after, and that the US government should run a national AGI project.