Stanford University Uses AI to Alter Student Photo, Causing Identity Erasure

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Stanford University used AI to alter a promotional photo, replacing a Hispanic male student with an AI-generated Black female student and modifying others' appearances. This violated university policy and led to feelings of erasure and misrepresentation among affected students, sparking public backlash and prompting Stanford to promise staff training and policy enforcement.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system was explicitly used to alter the photograph, changing racial appearances and misrepresenting individuals. This alteration caused harm by erasing the identity of a student and misleading the public about the university's diversity, which can be seen as harm to communities and a violation of rights. The harm has materialized as the affected student expressed upset and the university is responding to the incident. The AI system's misuse directly led to this harm, fulfilling the criteria for an AI Incident.[AI generated]
AI principles
AccountabilityFairness

Industries
Education and training

Affected stakeholders
General public

Harm types
Psychological

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard