Chinese Schools Deploy AI Voice Alarms to Prevent Bullying in Hidden Areas

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple schools across China have installed AI-powered voice recognition alarm devices in locations like restrooms, where bullying often goes undetected. These systems identify distress calls or abusive language and alert staff for rapid intervention, aiming to prevent harm and deter bullying, though no incidents have yet been directly reported.[AI generated]

Why's our monitor labelling this an incident or hazard?

The described system is an AI system because it involves intelligent voice recognition and comparison against a corpus to detect harmful speech and sounds. Its use directly addresses harm to the health and well-being of students by identifying bullying incidents that would otherwise go unnoticed, thus preventing or reducing injury or harm to persons. Since the AI system's use has directly led to harm prevention and intervention in bullying cases, this qualifies as an AI Incident under the framework, as it involves realized harm prevention and protection of individuals' rights and health.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityRobustness & digital securitySafetyFairness

Industries
Education and trainingDigital security

Affected stakeholders
Children

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

Business function:
Monitoring and quality control

AI system task:
Recognition/object detectionEvent/anomaly detection


Articles about this incident or hazard

Thumbnail Image

让隐秘之恶无处藏身

2024-04-03
杭州网
Why's our monitor labelling this an incident or hazard?
The described system is an AI system because it involves intelligent voice recognition and comparison against a corpus to detect harmful speech and sounds. Its use directly addresses harm to the health and well-being of students by identifying bullying incidents that would otherwise go unnoticed, thus preventing or reducing injury or harm to persons. Since the AI system's use has directly led to harm prevention and intervention in bullying cases, this qualifies as an AI Incident under the framework, as it involves realized harm prevention and protection of individuals' rights and health.
Thumbnail Image

预防校园欺凌靠技术更靠责任担当

2024-04-03
baby.sina.com.cn
Why's our monitor labelling this an incident or hazard?
The presence of AI systems is reasonably inferred from the description of intelligent voice alarm devices that recognize abusive or violent sounds to alert teachers. The article discusses the use of these AI systems in preventing harm (bullying) but does not describe any incident where the AI system caused harm or malfunctioned. It also emphasizes the importance of human responsibility and institutional response alongside technology. Since no direct or indirect harm from the AI system is reported, and the article mainly provides information on the deployment and role of AI technology in a social context, it fits the definition of Complementary Information rather than an AI Incident or AI Hazard.
Thumbnail Image

多地学校安装防欺凌装置,防范校园欺凌还需要做什么?

2024-03-31
china.org.cn/china.com.cn(中国网)
Why's our monitor labelling this an incident or hazard?
The event involves the use of AI systems (intelligent voice recognition and alert devices) actively deployed in schools to detect bullying behaviors. The AI system's use is directly related to preventing harm to students (injury or harm to health), which falls under the definition of an AI Incident since the AI system's use is intended to mitigate and has a direct role in preventing harm. Although no specific harm event triggered by the AI system is reported, the system is in active use to prevent harm, and the article discusses its role in real-world harm prevention. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information, as the AI system's use is directly linked to preventing realized or ongoing harm (bullying).
Thumbnail Image

喊「救命」5秒觸發 多校廁所裝防霸凌警報 | 聯合新聞網

2024-04-01
UDN
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI audio recognition systems installed in schools to detect bullying-related speech and trigger alerts. The AI system's use is directly linked to addressing harm to students' health and safety by preventing or mitigating bullying incidents. The AI system is actively used and operational, not just a potential risk or future possibility. Therefore, this event meets the criteria for an AI Incident because the AI system's use is directly involved in managing harm to persons in the school environment.
Thumbnail Image

多地学校安装防欺凌装置,防范校园欺凌还需要做什么?_教育家_澎湃新闻-The Paper

2024-03-31
The Paper
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of intelligent voice recognition alarm devices that employ AI to detect bullying behaviors by recognizing specific harmful speech patterns and sounds. These systems are actively used in schools to prevent bullying, which is a form of harm to students' health and safety. Although no confirmed bullying incidents have been triggered by the system yet, the AI system's deployment and operational use to prevent and respond to bullying constitutes an AI Incident because the AI system's use is directly linked to preventing harm to persons. The article also discusses broader social and legal measures but the core AI-related event is the deployment and use of AI-powered voice recognition alarms for bullying prevention, which fits the definition of an AI Incident.
Thumbnail Image

新京报 - 好新闻,无止境

2024-03-31
bjnews.com.cn
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI technology used in voice recognition alarm devices installed in schools to detect bullying-related sounds and alert responsible personnel. The AI system's use is directly linked to preventing or mitigating harm to students' health and safety by enabling early detection and response to bullying incidents. This fits the definition of an AI Incident because the AI system's use is directly involved in addressing a harm scenario (injury or harm to persons) through prevention and intervention. Although no specific bullying incident triggered the alarm yet, the system's active deployment and its role in harm prevention qualify it as an AI Incident rather than a hazard or complementary information. The article also discusses broader governance and social responses but the core event is the AI system's use in real-world harm prevention.
Thumbnail Image

语音预警,织密校园欺凌防护网_文体娱教_红辣椒评论

2024-04-01
红网
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (intelligent voice alert devices) that processes audio to detect harmful behaviors indicative of bullying. The system's deployment and use have directly contributed to preventing harm to students, which qualifies as injury or harm to health (a). Since the AI system's use has led to a reduction or prevention of bullying incidents, this is a realized positive impact related to harm prevention. Therefore, this qualifies as an AI Incident because the AI system's use has directly led to harm prevention, which is a form of harm addressed in the framework. The article does not merely discuss potential risks or general AI developments but reports on an implemented system actively influencing outcomes.
Thumbnail Image

多地学校安装防欺凌警报装置:技术之手能否触及隐秘角落_文体娱教_红辣椒评论

2024-03-31
红网
Why's our monitor labelling this an incident or hazard?
The described devices clearly involve AI systems, specifically advanced speech recognition and audio analysis technologies, used in real-time to detect bullying-related sounds and trigger alerts. The use of AI here is in the system's development and use to prevent harm (bullying) to students, which is a direct harm to the health and well-being of persons (harm category a). Since the devices are actively deployed and intended to detect and prevent bullying incidents, this constitutes an AI system whose use is directly linked to preventing or mitigating harm. There is no indication of malfunction or failure causing harm, nor is the article about potential future harm only. Therefore, this event qualifies as an AI Incident because the AI system's use is directly related to addressing an existing harm (bullying) and its prevention, impacting student safety.
Thumbnail Image

期待防欺凌装置撕开"隐秘角落"

2024-04-02
大洋网
Why's our monitor labelling this an incident or hazard?
An AI system is explicitly involved as the intelligent voice alarm device uses AI to recognize specific harmful audio cues (e.g., insults, hitting) to trigger alerts. The event concerns the use of AI systems to prevent harm (bullying) by detecting it early and enabling intervention. Although no specific harm is reported as having occurred due to the AI system, the system's use is intended to reduce harm and protect vulnerable individuals. There is no indication of malfunction or misuse causing harm. Therefore, this event does not describe an AI Incident (no harm caused) nor an AI Hazard (no plausible future harm from the AI system itself). Instead, it provides complementary information about the deployment and societal response to AI technology aimed at addressing a significant social problem (bullying).
Thumbnail Image

喊「救命」5秒觸發 多校廁所裝防欺凌警報 - 20240401 - 中國

2024-03-31
明報新聞網 - 即時新聞 instant news
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly described as intelligent voice recognition alarms that detect bullying-related audio cues and alert responsible personnel. The AI system's use is intended to prevent injury or harm to students by early detection of bullying, which is a recognized harm under the framework. Although no direct harm caused by the AI system is reported, the system's deployment plausibly leads to prevention of harm, fitting the definition of an AI Hazard. The article does not report any malfunction or misuse causing harm, nor does it focus on responses or governance measures alone, so it is not Complementary Information. Therefore, the classification is AI Hazard.