The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Indian actresses Shriya Saran and Janhvi Kapoor have condemned the misuse of AI to create sexually explicit, morphed images and videos without their consent. The AI-generated content, which distorts physical features and objectifies women, has circulated online, causing reputational and emotional harm and raising concerns about digital abuse.[AI generated]
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system used to create a morphed, sexually explicit video of a real person without consent, which is a direct violation of personal rights and causes harm to the individuals depicted. The harm is realized and ongoing, as the video was widely circulated before removal, sparking outrage and condemnation. The AI system's misuse directly led to harm (violation of rights and harm to community standards). The article does not merely discuss potential harm or societal responses but reports on an actual incident of AI misuse causing harm. Hence, the classification is AI Incident.[AI generated]