Widespread Harm from AI-Generated Non-Consensual Intimate Images Revealed

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study led by RMIT University found that about 7% of adults in Australia, the UK, and the US have experienced abuse involving AI-generated intimate images, including creation, sharing, or threats without consent. Victims report significant impacts on health, relationships, and finances, highlighting widespread harm from AI misuse.[AI generated]

Why's our monitor labelling this an incident or hazard?

The study documents realized harm caused by AI systems used to generate non-consensual intimate images, which is a violation of rights and causes psychological harm to victims. The AI system's involvement is explicit and central to the harm described. The harms are direct and significant, including threats and actual sharing of AI-generated sexual imagery without consent, fitting the definition of an AI Incident under violations of human rights and harm to communities.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalEconomic/PropertyHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard