Joseph Weizenbaum
In plain wordsA German-American computer scientist who built ELIZA, one of the first chatbots, and then became a leading critic of handing human judgment over to computers.
German-born American computer scientist at MIT who wrote ELIZAELIZA, prop. n.: A 1960s computer program that chatted by turning a user's own words back into questions, like a therapist. Many users felt understood, though the program understood nothing. (1964–66) and then became one of the best-known critics of the trust people place in computers. His Jewish family had fled Nazi Germany in 1936, and he worked on bank automation at General Electric before joining MIT in 1963. ELIZA held typed conversations by spotting keywords and transforming the user's sentences according to a script; its best-known script, DOCTOR, imitated a Rogerian psychotherapist. Weizenbaum was disturbed that users, including people who knew how it worked, confided in the program and credited it with understanding, the reaction now called the ELIZA effectELIZA effect, n.: Our tendency to believe that a computer understands us, cares or thinks just because it produces humanlike words, even when it is only following simple rules.. In 'Computer Power and Human Reason: From Judgment to Calculation' (1976) he argued that decisions requiring judgment, respect and care should never be delegated to computers, whatever their capabilities. He remained a prominent critic of military computing and of uncritical faith in technology, spending his last years in Germany.
Related
- ELIZAELIZA, prop. n.: A 1960s computer program that chatted by turning a user's own words back into questions, like a therapist. Many users felt understood, though the program understood nothing.
- ELIZA effectELIZA effect, n.: Our tendency to believe that a computer understands us, cares or thinks just because it produces humanlike words, even when it is only following simple rules.
- chatbotchatbot, n.: Software you chat with in ordinary language, by typing or talking, as you would with a person. The newest ones, such as ChatGPT, can answer questions, draft writing and keep long conversations going.
- anthropomorphismanthropomorphism, n.: Treating something that isn't human — a pet, a car, a chatbot — as if it had human thoughts, feelings or intentions. AI that talks fluently makes this temptation unusually strong.
- AI ethicsAI ethics, n.: The study of what is right and wrong in how AI is built and used: who it may harm, who is responsible when it fails, and which values it should respect.
- automation biasautomation bias, n.: The habit of trusting a computer's suggestion too much: following it even when it is wrong, or missing problems because the machine did not flag them.
Sources
- Weizenbaum, J. (1966). ELIZA—A Computer Program for the Study of Natural Language Communication between Man and Machine. Communications of the ACM 9(1): 36–45.
- Weizenbaum, J. (1976). Computer Power and Human Reason: From Judgment to Calculation. W. H. Freeman.
Mentioned in
ELIZAELIZA, prop. n.: A 1960s computer program that chatted by turning a user's own words back into questions, like a therapist. Many users felt understood, though the program understood nothing.