The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
A man in Espírito Santo, Brazil, used ChatGPT to discuss plans to harm his 8-year-old son and himself. The AI system flagged the conversations as high risk, prompting OpenAI to alert authorities, which led to the suspect's arrest and prevention of potential harm. The case raises legal and ethical questions about AI's role in crime prevention.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system (ChatGPT) was explicitly involved as the platform where the individual disclosed plans to commit violent crimes, including killing his child. The AI's safety mechanisms detected the risk and reported it to authorities, which directly led to the arrest and prevention of the crime. This constitutes an AI Incident because the AI system's use and its monitoring function were central to identifying and mitigating a serious harm to human life. Although the crime was not consummated, the imminent risk and the AI's role in preventing it meet the criteria for an AI Incident. The event is not merely a hazard or complementary information, as the AI system's involvement had a direct impact on preventing harm.[AI generated]