South Korean AI System Predicts Crimes by Reading Emotions, Raising Human Rights Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

South Korean researchers have developed an AI system, 5G-I-VEmoSYS, that uses emotion recognition and 5G networks to detect potentially dangerous emotions across cities and alert authorities to prevent crimes. While no harm has occurred yet, the technology raises significant concerns about privacy, wrongful interventions, and human rights violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article presents a newly developed AI system that can detect human emotions and potentially prevent crimes by alerting authorities. There is no indication that any harm has yet occurred due to this system's use, but the technology could plausibly lead to significant impacts on privacy, civil liberties, or misuse leading to harm. Therefore, it fits the definition of an AI Hazard, as it could plausibly lead to an AI Incident involving violations of rights or other harms if misused or malfunctioning. It is not an AI Incident because no harm has been reported as realized, nor is it merely Complementary Information or Unrelated, since the system's potential for harm is central to the report.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Government, security, and defence

Affected stakeholders
General public

Harm types
Human or fundamental rights

AI system task:
Recognition/object detectionEvent/anomaly detection


Articles about this incident or hazard