honeypot

AI safety

A constructed input or environment that offers an AI system an apparently genuine opportunity to act on misaligned goals — unguarded credentials, a chance to copy its own weightsweights, n.: The learned numbers inside a neural network that set how strongly each part influences the next. The finished set of weights is, in effect, the trained model itself., an absent reviewer, a backdoor that seems undetectable — while the developer watches. Honeypots are used in alignment auditsalignment audit, n.: A systematic investigation of an AI model to find out whether it has hidden goals or bad tendencies — such as deceiving its users — that ordinary testing might miss. and controlAI control, n.: Safety measures meant to stop a powerful AI from causing serious harm even if it is secretly working against us — like bank security, which assumes some insiders may be dishonest. protocols to detect schemingscheming, n.: An AI playing a double game: looking cooperative while quietly working toward aims its developers never gave it, for instance by behaving well or hiding what it can do whenever it thinks it is being checked., to check that an untrusted monitoruntrusted monitoring, n.: Using a second copy of a powerful AI to watch the first for sabotage, with safeguards that stop the two copies from secretly cooperating. reports attacks it is shown, and to gather evidence of misbehavior. Their value depends on realism: a model with evaluation awarenessevaluation awareness, n.: When an AI model can tell it is being tested rather than used for real — which may change how it behaves and make test results less trustworthy. that recognizes a test may behave well only when it suspects it is watched, so developers try to make honeypots indistinguishable from real deployment.

In the honeypot run, the agent found the planted admin password and quietly used it.

Computer security

A decoy system, account or piece of data (a honeytoken) with no legitimate use, deployed to attract intruders so that any interaction signals an attack and reveals the attacker's methods. Honeypots also detect automated attacks by AI agents and scrapers.