China's Emotion Recognition AI Used for Mass Surveillance and Human Rights Violations

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Chinese authorities have widely deployed AI-based emotion recognition systems, such as the 'Alpha Eagle Eye,' to monitor, profile, and preemptively arrest individuals based on micro-expressions and inferred intent. This technology, integrated with surveillance cameras, has led to human rights abuses, targeting minorities, dissenters, and ordinary citizens, and is being exported abroad.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (emotion recognition technology integrated into surveillance cameras) used by Chinese authorities to monitor and suppress citizens, leading to direct violations of human rights, which qualifies as harm under the AI Incident definition. The system's deployment for preemptive arrests based on emotional analysis constitutes direct harm. The export of this technology also implies potential future harm, but the realized harm to citizens in China is sufficient to classify this as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingPrivacy & data governanceRespect of human rightsSafetyTransparency & explainabilityDemocracy & human autonomy

Industries
Government, security, and defence

Affected stakeholders
General publicOther

Harm types
Human or fundamental rights

AI system task:
Recognition/object detection


Articles about this incident or hazard