Deepfake Video of Metropolitan Gavriil Used in Online Scam

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An AI-generated deepfake video falsely depicting Metropolitan Gavriil advertising medicines circulated on social media in Bulgaria. The manipulated video used his image and voice without consent, misleading the public and damaging his reputation. Authorities and the church have condemned the incident and called for the video's removal.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event explicitly mentions the use of artificial intelligence to create a falsified video with manipulated image and voice, which is a clear example of an AI system's use leading to harm. The harm includes misinformation, reputational damage, and violation of rights related to identity and possibly intellectual property. Since the AI-generated deepfake video is actively spreading and causing harm, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceTransparency & explainability
Industries
Media, social platforms, and marketing
Affected stakeholders
General publicOther
Harm types
ReputationalHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard