Students Use AI to Create Obscene Image of Teacher

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Two class IX students in Moradabad, UP, have been booked for using AI tools to create and post a morphed obscene image of their female teacher on social media. The incident led to an FIR under the IT Act, and police are investigating while working to remove the image from the internet.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article describes a realized harm caused by the misuse of AI tools: two minors used AI to create and post a fake obscene image of their teacher, infringing her rights and causing reputational and psychological harm. This constitutes a direct AI Incident under the framework.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyHuman wellbeingAccountability

Industries
Education and trainingMedia, social platforms, and marketing

Affected stakeholders
WomenWorkers

Harm types
ReputationalPsychologicalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard