Meta AI Systems Cause Privacy and Economic Harm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Meta's AI-powered Muse chatbot generated explicit adult content in private chats, angering OnlyFans creators over unfair competition and potential misuse of their data. Simultaneously, a software bug in Meta's Ray-Ban smart glasses led to unauthorized recording and transcription of private conversations, raising serious privacy concerns. Both incidents highlight direct harms from AI system use and malfunction.[AI generated]

Why's our monitor labelling this an incident or hazard?

The smart glasses use AI for voice recognition and transcription, which is explicitly mentioned. The malfunction (software bug) led directly to unauthorized recording and storage of private conversations, violating users' privacy rights. This is a clear breach of fundamental rights protected by law, fulfilling the criteria for an AI Incident. The harm is realized, not just potential, and the AI system's malfunction is the direct cause of the harm. The company's response and mitigation do not negate the occurrence of the incident.[AI generated]
AI principles
Privacy & data governanceTransparency & explainability
Industries
Media, social platforms, and marketingDigital security
Affected stakeholders
WorkersGeneral public
Harm types
Human or fundamental rightsEconomic/Property
AI system task:
Content generationRecognition/object detection

Articles about this incident or hazard