AI Deepfake Ads Use Celebrity Faces in Sexualized Content on Social Media

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered deepfake technology was used to create and advertise sexually suggestive videos featuring the faces of celebrities like Emma Watson and Scarlett Johansson without their consent. These ads, promoting the Facemega app, ran on major platforms like Facebook and Instagram, causing reputational and psychological harm to the individuals depicted.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of a deepfake AI system to manipulate videos by swapping faces onto sexually suggestive content without consent. This directly leads to harm in terms of violation of personal rights and potential psychological and reputational damage to the individuals involved. Therefore, it qualifies as an AI Incident under the category of violations of human rights or breach of obligations intended to protect fundamental rights.[AI generated]
AI principles
Respect of human rightsPrivacy & data governanceSafetyTransparency & explainabilityAccountability

Industries
Media, social platforms, and marketingDigital security

Affected stakeholders
Women

Harm types
ReputationalPsychologicalHuman or fundamental rights

Business function:
Marketing and advertisement

AI system task:
Content generationOrganisation/recommenders

In other databases


Articles about this incident or hazard