AI Misuse Creates Fake Explicit Content Targeting Porsche Sales Champion

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Qingdao Porsche sales champion Mou Qianwen reported that AI technology was used to maliciously manipulate her photos into fake explicit images and videos posted on adult websites. She confirmed the content was unauthorized, filed a police report, and condemned the misuse of AI for defamation.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes how AI technology was used to generate fake pornographic images of a person by maliciously manipulating her photos. This misuse of AI has directly led to harm in the form of reputational damage and personal rights violations. Therefore, it qualifies as an AI Incident due to the realized harm caused by the AI system's malicious use.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyAccountabilityRobustness & digital securityTransparency & explainability
Industries
Media, social platforms, and marketingDigital security
Affected stakeholders
WorkersWomen
Harm types
ReputationalPsychologicalHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard