tool AI
In plain wordsAI built to be used like an instrument, answering, suggesting or calculating when asked, rather than pursuing goals on its own. Some argue that this is the only kind we should build.
AI designed to function as an instrument that performs bounded tasks, such as calculating, predicting, recommending or answering, under human direction, without itself pursuing goals in the world. It was proposed as a safer alternative to agentic AGIartificial general intelligence, n.: AI that could learn and do almost any mental task a capable adult can, rather than excelling at one narrow job. Experts disagree on the exact bar and on when, or whether, it will arrive.: a system that merely displays the best course of action leaves the decision to a human. Critics replied that the boundary is blurry, that a tool optimizing for good recommendations may still steer its users, and, in the title of Gwern Branwen's essay, that tool AIs want to be agent AIs, because autonomy is economically valuable. The shift toward agentic AIagentic AI, n.: AI built to pursue goals on its own — planning, taking actions and adjusting along the way — instead of only responding to one prompt at a time. 'Agentic' describes how much of this independence a system has. since 2024 is often cited as bearing out the economic argument, while advocates such as Max Tegmark and the Future of Life InstituteFuture of Life Institute, prop. n.: An advocacy group that warns about the dangers of advanced AI and other powerful technologies, funds research and lobbies governments. It organized the 2023 open letter calling for a pause on giant AI experiments. argue that most of AI's benefits are obtainable from capable but non-agentic, non-general tools.
Tool AI was supposed to recommend actions, not take them; agents erased that line.
Origin
Proposed by Holden Karnofsky in a May 2012 LessWrong critique of the Singularity Institute; Eliezer Yudkowsky replied the following month. Gwern Branwen's essay 'Why Tool AIs Want to Be Agent AIs' (2016) became the standard counter-argument.
Usage note
Unrelated to tool usetool use, n.: An AI model's ability to reach beyond its own knowledge by operating outside tools — searching the web, running code, using a calculator or an app — and folding the results into its work., in which an AI agent calls external software tools; there the AI is the agent, not the tool.
Related
- oracle AIoracle AI, n.: An AI kept to answering questions, without acting in the world on its own. Proposed as a safer kind of superintelligence, though its answers could still steer the people who read them.
- comprehensive AI servicescomprehensive AI services, n.: The idea that superintelligent-level AI could arrive as many specialized AI tools, each doing a bounded job, rather than as one all-powerful AI agent with goals of its own.
- agentic AIagentic AI, n.: AI built to pursue goals on its own — planning, taking actions and adjusting along the way — instead of only responding to one prompt at a time. 'Agentic' describes how much of this independence a system has.
- AI agentAI agent, n.: An AI system that does not just answer but acts: given a goal, it decides on steps, uses tools such as a browser or code editor, checks the results and keeps going until the job is done.
- capability controlcapability control, n.: Keeping a powerful AI safe by limiting what it is able to do, for example by cutting it off from the internet, rather than by shaping what it wants.
- narrow AInarrow AI, n.: AI built to do one specific job, or a small set of related jobs, such as playing chess or spotting spam, without being able to turn its skill to unrelated problems.
- AI agentAI agent, n.: An AI system that does not just answer but acts: given a goal, it decides on steps, uses tools such as a browser or code editor, checks the results and keeps going until the job is done.
- tool usetool use, n.: An AI model's ability to reach beyond its own knowledge by operating outside tools — searching the web, running code, using a calculator or an app — and folding the results into its work.
Mentioned in
intelligent agentintelligent agent, n.: In AI theory, a decision-maker, such as a robot, a self-driving car, a chess program or a helpful piece of software, that notices what is going on around it and responds in ways that serve its goals., sovereign AIsovereign AI, n.: A country's ability to build and run AI on its own terms, so that the computers, models and know-how it relies on cannot be withheld or dictated by foreign companies or governments., tooltool, n.: Any outside capability an AI model is allowed to use — a web search, a calculator, a code runner, a database or an app — described to the model so it can ask for it by name., comprehensive AI servicescomprehensive AI services, n.: The idea that superintelligent-level AI could arrive as many specialized AI tools, each doing a bounded job, rather than as one all-powerful AI agent with goals of its own., humanist superintelligencehumanist superintelligence, n.: Microsoft AI's name for very advanced AI that is deliberately kept limited, controllable and aimed at specific human problems such as medicine and energy, rather than all-powerful general systems., oracle AIoracle AI, n.: An AI kept to answering questions, without acting in the world on its own. Proposed as a safer kind of superintelligence, though its answers could still steer the people who read them.