South Carolina School's AI-Generated 'Future Self' Photo of Child Sparks Privacy Outcry

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A South Carolina mother, Nikki Anderson, criticized her daughter's school for using AI to create an image of her 6-year-old as a 25-year-old nurse without parental consent. The incident raised concerns about children's privacy, consent, and the ethical use of AI in educational settings.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system was used to generate an image of a child as an adult, which involves the development and use of AI. The mother's concerns about privacy and lack of consent indicate potential violations of rights and privacy, which could lead to harm if not addressed. However, since no actual harm or rights violation has been confirmed or reported, and the event centers on concerns and awaiting responses from the school, it fits the definition of an AI Hazard rather than an AI Incident. The event is not merely general AI news or a beneficial use, nor is it complementary information since it is a primary report of a potential issue.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Education and training

Affected stakeholders
Children

Harm types
Human or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard