AI Proctoring in University Exams Raises Privacy and Bias Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Universities worldwide have adopted AI-powered proctoring software to monitor students during remote exams. These systems, using facial recognition and behavior analysis, have led to privacy invasions, discriminatory bias, and unfair treatment of students, prompting complaints, protests, and legal actions over their impact on student rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly used in automated proctoring software that monitor students during exams. The harms described—privacy invasion, discriminatory bias in facial recognition, unfair suspicion and investigation of students, and technical failures causing stress—are direct consequences of the AI system's use. These harms fall under violations of rights and harm to communities as defined. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information, since the harms are realized and ongoing.[AI generated]
AI principles
Privacy & data governanceFairnessRespect of human rightsTransparency & explainabilityAccountability

Industries
Education and training

Affected stakeholders
Consumers

Harm types
Human or fundamental rightsPsychological

Business function:
Monitoring and quality control

AI system task:
Recognition/object detectionEvent/anomaly detection


Articles about this incident or hazard