University of Washington Cancels AI Classroom Camera Study After Privacy Backlash

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

University of Washington researchers planned to record preschool classrooms using teacher-worn cameras to train AI models assessing classroom interactions. The opt-out consent process and unclear data usage raised parental concerns over privacy and informed consent, leading to the project's cancellation before any data collection or AI deployment occurred.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly involved as the footage was intended to train AI models. The event stems from the planned use of AI (use phase). However, since the study was cancelled before any data collection or AI deployment, no realized harm occurred. The parental concerns and potential privacy violations represent plausible future harms if the study had proceeded. Therefore, this event qualifies as an AI Hazard because it plausibly could have led to violations of privacy and consent (a form of harm to rights) but did not materialize into an incident.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Education and training

Affected stakeholders
ChildrenWorkers

Harm types
Human or fundamental rights

Business function:
Research and development

AI system task:
Recognition/object detection


Articles about this incident or hazard