AI-Generated Videos of Fake Wounded Veterans Used in Online Merchandise Scam

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Scammers used AI-generated videos of fake wounded veterans to sell cheap, mass-produced patriotic merchandise online, deceiving sympathetic buyers in the UK. The AI-created personas exploited emotional appeals, resulting in financial loss and eroding trust in legitimate veterans' charities. Products were shipped from China, not handmade as claimed.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event describes AI-generated videos used in scams that have directly led to financial harm and emotional exploitation of consumers. The AI system's role in creating fake veterans and emotionally charged content is pivotal to the scam's success. This constitutes a violation of consumer rights and causes harm to individuals and communities through deception and fraud. Therefore, this is classified as an AI Incident.[AI generated]
AI principles
Transparency & explainabilityAccountability

Industries
Media, social platforms, and marketingConsumer services

Affected stakeholders
ConsumersBusiness

Harm types
Economic/PropertyReputational

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard