Statement on AI Risk
In plain wordsA one-sentence public statement from May 2023, signed by hundreds of leading AI scientists and company heads, declaring that guarding against the chance of AI wiping out humanity should rank as a priority for the whole world.
A single-sentence declaration released by the Center for AI SafetyCenter for AI Safety, prop. n.: A San Francisco nonprofit that studies how advanced AI could lead to disaster and how to prevent it. In 2023 it gathered signatures for a one-sentence warning that AI could threaten human extinction. on 30 May 2023 stating that 'mitigating the risk of extinction from AI should be a global priority', on a par with other dangers to society as a whole such as pandemics and nuclear war. Kept deliberately brief so that people who disagreed about specific risks or remedies could sign, it was endorsed at launch by hundreds of AI researchers and executives, including Geoffrey HintonGeoffrey Hinton, prop. n.: A British-Canadian scientist whose decades of persistent work on brain-inspired neural networks laid the foundations of modern AI; often called a 'godfather of AI', he now warns publicly about its dangers., Yoshua BengioYoshua Bengio, prop. n.: A Canadian computer scientist who helped found deep learning, including ideas behind today's language models, and who has become a leading voice on the risks of advanced AI., Sam AltmanSam Altman, prop. n.: An American entrepreneur who co-founded OpenAI and runs it; the company's 2022 release of ChatGPT turned him into one of the public faces of the AI era. of OpenAIOpenAI, prop. n.: The American company that makes ChatGPT and the GPT models. It began in 2015 as a nonprofit research lab and is now a for-profit company overseen by a nonprofit foundation., Demis HassabisDemis Hassabis, prop. n.: A British AI researcher and former chess prodigy who co-founded DeepMind, led the teams behind AlphaGo and AlphaFold, and shared the 2024 Nobel Prize in Chemistry. of Google DeepMindGoogle DeepMind, prop. n.: Google's main artificial intelligence laboratory, formed in 2023 by joining DeepMind and Google Brain. It builds the Gemini models and scientific AI systems such as AlphaFold. and Dario AmodeiDario Amodei, prop. n.: An American AI researcher who co-founded Anthropic and is its chief executive, known for early work on scaling and AI safety and for forecasting very rapid AI progress. of AnthropicAnthropic, prop. n.: An American AI company that makes the Claude chatbot and models. It was founded in 2021 by former OpenAI staff and puts particular emphasis on AI safety research.. Its significance lay less in its content than in its signatories: leaders of the companies building frontier systems publicly ranked their technology's dangers alongside those of nuclear weapons. Critics argued that it distracted from present harms, or that it served those companies by implying that only they could manage the danger.
After the Statement on AI Risk, heads of government began using the word extinction in speeches about AI.
Origin
Organized by the Center for AI Safety under its director, Dan Hendrycks, two months after the Pause Giant AI ExperimentsPause Giant AI Experiments, prop. n.: A 2023 open letter, signed by tens of thousands of people including prominent technologists, that asked AI labs to halt the training of any AI more capable than GPT-4 for at least half a year. letter. It was widely cited in the run-up to the first AI Safety SummitAI Safety Summit, prop. n.: A series of international meetings of governments, AI companies and researchers, begun in England in 2023, to agree on how to handle the risks and benefits of the most advanced AI., held at Bletchley Park in November 2023.
Usage note
Not to be confused with the pause letter, which asked for a specific action; this statement made no policy demand.
Related
- existential riskexistential risk, n.: A danger that could end humanity, or shut it out of a good future forever. Some experts count advanced AI among the largest such risks; others think this worry is overblown.
- Center for AI SafetyCenter for AI Safety, prop. n.: A San Francisco nonprofit that studies how advanced AI could lead to disaster and how to prevent it. In 2023 it gathered signatures for a one-sentence warning that AI could threaten human extinction.
- Pause Giant AI ExperimentsPause Giant AI Experiments, prop. n.: A 2023 open letter, signed by tens of thousands of people including prominent technologists, that asked AI labs to halt the training of any AI more capable than GPT-4 for at least half a year.
- AI Safety SummitAI Safety Summit, prop. n.: A series of international meetings of governments, AI companies and researchers, begun in England in 2023, to agree on how to handle the risks and benefits of the most advanced AI.
- AI safetyAI safety, n.: The effort to keep AI from doing serious harm, whether because it pursues aims its makers never intended, is turned to bad uses or simply malfunctions — a concern that grows as systems become more capable.
- godfathers of AIgodfathers of AI, phr.: A media nickname for three scientists — Geoffrey Hinton, Yoshua Bengio and Yann LeCun — whose decades of work on neural networks underpins modern AI. They shared computing's top prize in 2019.
Sources
- Center for AI Safety (2023). Statement on AI Risk. 30 May 2023.
Mentioned in
existential riskexistential risk, n.: A danger that could end humanity, or shut it out of a good future forever. Some experts count advanced AI among the largest such risks; others think this worry is overblown., Geoffrey HintonGeoffrey Hinton, prop. n.: A British-Canadian scientist whose decades of persistent work on brain-inspired neural networks laid the foundations of modern AI; often called a 'godfather of AI', he now warns publicly about its dangers., Center for AI SafetyCenter for AI Safety, prop. n.: A San Francisco nonprofit that studies how advanced AI could lead to disaster and how to prevent it. In 2023 it gathered signatures for a one-sentence warning that AI could threaten human extinction., Dan HendrycksDan Hendrycks, prop. n.: An American AI-safety researcher who created widely used AI tests such as MMLU and Humanity's Last Exam, and who runs the Center for AI Safety., Pause Giant AI ExperimentsPause Giant AI Experiments, prop. n.: A 2023 open letter, signed by tens of thousands of people including prominent technologists, that asked AI labs to halt the training of any AI more capable than GPT-4 for at least half a year., Asilomar AI PrinciplesAsilomar AI Principles, prop. n.: A list of 23 guidelines for safe and beneficial AI drawn up at a 2017 conference in California and signed by thousands of researchers and public figures., Open Letter on Artificial IntelligenceOpen Letter on Artificial Intelligence, prop. n.: A 2015 open letter, signed by Stephen Hawking, Elon Musk and many leading AI researchers, urging that AI research aim not only at making systems more capable but also at making them safe and beneficial., Statement on SuperintelligenceStatement on Superintelligence, prop. n.: A 2025 public statement, signed by scientists, celebrities and politicians, calling for a ban on building superintelligent AI until it is shown to be safe and the public supports it.