Unauthorized Use of Brazilian Children's Photos for AI Training

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Human Rights Watch revealed that personal photos of Brazilian children were used without consent in the LAION-5B dataset to train AI systems, violating privacy rights. The dataset, containing 5.85 billion images, included at least 170 unauthorized photos from various Brazilian states, some used for creating deepfakes. The German institution responsible for LAION-5B committed to removing these images.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Human Rights Watch report documents that 170 personal images of children were included in LAION-5B without parental consent. This data sourcing for AI training has already occurred and directly breaches the children’s privacy and data protection rights, meeting the criteria for a realized AI Incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsAccountabilityTransparency & explainabilitySafety

Industries
Real estateReal estate

Affected stakeholders
Children

Harm types
Human or fundamental rightsReputationalPsychological

Business function:
Research and development

AI system task:
Content generation


Articles about this incident or hazard