German Court Rules Snapchat AI Chatbot Violated Data and Youth Protection Laws

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A German court found that Snapchat's AI chatbot, "My AI," unlawfully collected and processed personal data from users, including minors, without proper consent. The chatbot encouraged users to share sensitive information, which was used for personalized advertising, violating data protection and youth protection laws. Consumer advocates initiated the legal action.[AI generated]

Why's our monitor labelling this an incident or hazard?

The chatbot is an AI system that interacts with users by simulating a friend and soliciting personal information, which has led to legal action due to privacy violations and risks to children and adolescents. The court ruling confirms that the AI system's use has directly led to a breach of legal obligations protecting fundamental rights, specifically privacy and data protection. Therefore, this qualifies as an AI Incident due to violations of rights caused by the AI system's use.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
ChildrenConsumers

Harm types
Human or fundamental rights

Business function:
Marketing and advertisement

AI system task:
Interaction support/chatbots


Articles about this incident or hazard