AI-Generated Fake Explicit Images Used to Blackmail Children in Bosnia and Herzegovina

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In Bosnia and Herzegovina, perpetrators are using AI to create fake explicit images of children, which are then used to blackmail and coerce victims into sending real photos. This digital abuse, highlighted by Abida Pehlić of the Novi put association, is causing psychological harm and complicating detection and prevention efforts.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI to generate fake explicit photographs of children, which are then used to blackmail and coerce real children into sending actual photos. This constitutes direct harm to the mental health and rights of children, fulfilling the criteria for an AI Incident. The AI system's role is pivotal in producing the harmful content that leads to psychological and sexual exploitation harms. Therefore, this event is classified as an AI Incident.[AI generated]
AI principles
Respect of human rightsSafety
Industries
Media, social platforms, and marketingDigital security
Affected stakeholders
Children
Harm types
PsychologicalHuman or fundamental rights
AI system task:
Content generation

Articles about this incident or hazard