AI-Generated Deepfakes Cause Harm Across South Asia and Beyond

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered deepfake technology has led to widespread harm, including misinformation, financial fraud, privacy violations, and targeted harassment—especially against women and public figures in India, Bangladesh, and Pakistan. Incidents include political manipulation, financial scams, and personal attacks, prompting governments to consider stricter regulations and legal measures.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (deepfake technology using AI and machine learning) that have been used maliciously to cause financial fraud, which is a form of harm to property and individuals. The described events include real financial losses (e.g., a $35 million bank heist and a Rs 40,000 scam), directly caused by the use of AI deepfake systems. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingPrivacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketingDigital securityFinancial and insurance servicesGovernment, security, and defence

Affected stakeholders
WomenGeneral publicConsumers

Harm types
Economic/PropertyReputationalPsychologicalHuman or fundamental rightsPublic interest

Severity
AI incident

AI system task:
Content generation


Articles about this incident or hazard