AI-Generated 'Homeless Man' Prank on TikTok Triggers Emergency Calls and Police Warnings in US and UK

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A viral TikTok trend uses AI-generated images to stage fake home invasions, leading to panic, emotional distress, and false emergency calls in the US and UK. Police warn that these pranks waste emergency resources and disrupt public safety, highlighting the real-world harm caused by misuse of AI image generators.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system is explicitly involved as it generates images used in a prank that indirectly causes harm by wasting police resources and causing distress to individuals. Although no physical harm or direct violation of rights is reported, the misuse of emergency services and the social disruption caused by the prank constitute harm to communities and property (misuse of public resources). Therefore, this event qualifies as an AI Incident due to the realized harm stemming from the AI system's use.[AI generated]
AI principles
AccountabilitySafetyTransparency & explainabilityRobustness & digital security

Industries
Media, social platforms, and marketingGovernment, security, and defence

Affected stakeholders
General publicGovernment

Harm types
PsychologicalEconomic/PropertyPublic interest

AI system task:
Content generation


Articles about this incident or hazard