Microsoft Launches Project Artemis AI to Detect and Prevent Online Child Grooming

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Microsoft, in collaboration with partners like The Meet Group, Roblox, Kik, Thorn, and the UK Home Office, launched Project Artemis, an AI tool that analyzes online chat to detect and flag child grooming and predatory behavior. The system rates conversations and alerts moderators or law enforcement, aiming to prevent child exploitation on digital platforms.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system (Project Artemis) that analyzes online conversations to detect child grooming, which is a form of harm to individuals (children) and communities. The AI system's use directly aims to prevent harm, and its deployment addresses a significant social issue. Since the system is actively used to detect and report harmful behavior, this constitutes an AI Incident as it involves the use of AI leading to harm prevention related to child safety online.[AI generated]
Industries
Media, social platforms, and marketing

Business function:
Monitoring and quality control

AI system task:
Event/anomaly detection


Articles about this incident or hazard