
The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.
Meta's AI system flagged a suicide risk on Instagram, alerting Uttar Pradesh Police, who intervened within eight minutes to save a 25-year-old man in Meerut. The AI-driven alert enabled rapid response, preventing harm and highlighting the effectiveness of AI in suicide prevention through social media monitoring.[AI generated]
Why's our monitor labelling this an incident or hazard?
The AI system developed and used by Meta to monitor Instagram posts for suicide risk directly contributed to preventing harm by alerting authorities who then intervened. This is a clear case where the AI system's use led to a positive outcome by preventing injury or harm to a person. Therefore, it qualifies as an AI Incident under the definition, as the AI system's use directly led to harm prevention (a form of injury or harm to a person).[AI generated]