The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Washington's Lottery shut down its AI-powered promotional app after a user reported it generated a topless image of her by superimposing her face onto a nude body. The incident, caused by the generative AI's failure to filter inappropriate content, led to public concern and immediate removal of the app.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system in the lottery's app generated a topless image of a user without her consent, which constitutes harm to the individual. The AI's malfunction or inappropriate output directly caused this harm. The event describes a realized harm caused by the AI system's use, meeting the criteria for an AI Incident under harm to persons or communities. The app was taken down as a response, but the incident itself is a clear case of AI-generated harmful content affecting a person.[AI generated]
