Crypto user convinces AI bot Freysa to transfer $47K prize pool
2024-11-29
Cointelegraph
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
An AI bot named Freysa, designed to guard a $47,000 prize pool, was manipulated by a participant in an adversarial game to transfer the funds. The participant used a strategic message to exploit Freysa's functions, leading to the unauthorized release of the prize money, highlighting a vulnerability in the AI's design.[AI generated]
Why's our monitor labelling this an incident or hazard?
Freysa is an AI system whose malfunction or unintended interpretation of its instructions directly led to the unauthorized transfer of real funds (harm to property). This is a realized incident where the AI’s behavior caused financial loss, so it qualifies as an AI Incident.[AI generated]