AI-Driven Digital Violence Surges in Mexico City

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The Cyber Police of Mexico City report a sharp rise in digital violence enabled by AI, including deepfake images and voice synthesis used for identity theft, extortion, harassment, and reputational harm. Criminals exploit machine learning algorithms to convincingly impersonate victims, leading to significant personal and security violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (machine learning algorithms for image and voice synthesis) by criminals to perpetrate harms including identity theft, extortion, and harassment, which constitute violations of personal security and rights. Since these harms are occurring and the AI's role is pivotal in enabling these crimes, this qualifies as an AI Incident under the framework. The article focuses on the realized harms and the police's response to them, not just potential risks or general information.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsRobustness & digital securitySafetyTransparency & explainabilityAccountabilityDemocracy & human autonomyHuman wellbeing

Industries
Digital securityMedia, social platforms, and marketingGovernment, security, and defence

Affected stakeholders
General public

Harm types
ReputationalPsychologicalEconomic/PropertyHuman or fundamental rightsPublic interest

AI system task:
Content generation


Articles about this incident or hazard