Deepfake Video Falsely Links Peso Pluma and Anitta

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A deepfake video of Mexican singer Peso Pluma falsely depicts him saying he relied on Anitta after splitting from Nicki Nicole. The AI-manipulated footage, featuring synthesized audio and altered visuals, went viral on social media, creating public confusion and reputational risk, prompting calls to verify content before sharing.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was used to generate a fake video (deepfake) that falsely portrays Peso Pluma making statements he never made. This misinformation has led to public controversy and personal harm to the individual, which qualifies as harm to communities and individuals. Since the AI-generated content directly led to reputational harm and social disruption, this event meets the criteria for an AI Incident.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy
Industries
Media, social platforms, and marketingArts, entertainment, and recreationDigital security
Affected stakeholders
OtherGeneral public
Harm types
ReputationalHuman or fundamental rightsPsychologicalPublic interest
Business function:
Other
AI system task:
Content generation

Articles about this incident or hazard