AI-Generated Deepfake Falsely Announces Influencer's Death, Spreads Misinformation Online

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Internet users created and circulated a deepfake video using AI, depicting TV host Pati Chapoy falsely announcing the death of influencer Aimep3. The realistic AI-generated content caused widespread misinformation, emotional distress, and reputational harm, highlighting the risks of AI-driven synthetic media in spreading false news.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system used to generate synthetic media (deepfake video and voice) that falsely reports a death, which is a clear violation of rights and causes harm to the individuals targeted (reputational and emotional harm). The AI system's use directly led to this harm through misinformation dissemination. Therefore, this qualifies as an AI Incident under the framework, as it involves realized harm caused by AI-generated false content affecting persons and communities.[AI generated]
AI principles
AccountabilityTransparency & explainabilityPrivacy & data governanceRobustness & digital securitySafetyRespect of human rightsDemocracy & human autonomy
Industries
Media, social platforms, and marketing
Affected stakeholders
WorkersGeneral public
Harm types
PsychologicalReputationalPublic interestHuman or fundamental rights
Severity
AI incident
AI system task:
Content generation

Articles about this incident or hazard

Thumbnail Image

¿Aimep3 se murió? Una mala broma con inteligencia artificial involucró hasta a Pati Chapoy

2024-04-16
SDPnoticias.com
Why's our monitor labelling this an incident or hazard?
The event involves an AI system used to generate synthetic media (deepfake video and voice) that falsely reports a death, which is a clear violation of rights and causes harm to the individuals targeted (reputational and emotional harm). The AI system's use directly led to this harm through misinformation dissemination. Therefore, this qualifies as an AI Incident under the framework, as it involves realized harm caused by AI-generated false content affecting persons and communities.
Thumbnail Image

Crean VIDEO con IA de Pati Chapoy anunciando supuesta muerte de Aimep3

2024-04-16
Milenio.com
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system used to create a deepfake video, which is a clear AI system involvement. The AI-generated content directly led to the spread of false information about a person's death, causing harm to the influencer's reputation and emotional distress to viewers, which fits the definition of harm to communities and individuals. The harm is realized, not just potential, as the video went viral and caused reactions among users. Hence, this is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

¿Aimep3 Murió? Videos de Pati Chapoy anunciando el presunto deceso de

2024-04-16
Diario de Morelos
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system to generate a deepfake video that falsely reports a death, which is a clear case of misinformation causing harm to communities through deception and emotional impact. The AI system's role is pivotal in creating the realistic but false content that led to this harm. Therefore, this qualifies as an AI Incident under the definition of harm to communities due to misinformation and deception caused by AI-generated content.