Voice Assistants' False Triggers Lead to Widespread Privacy Violations

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers found over 1,000 words and phrases that inadvertently activate AI voice assistants like Alexa, Siri, Google Assistant, and Cortana, causing them to record and transmit private conversations without user consent. These recordings are sometimes reviewed by company employees, resulting in significant privacy breaches due to AI system malfunctions.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (voice assistants) that use AI for speech recognition and activation. The incorrect activation and subsequent recording of private conversations directly lead to privacy violations, which constitute a breach of fundamental rights. Therefore, this is an AI Incident because the AI system's malfunction (false activation) has directly led to harm (privacy intrusion and potential rights violations).[AI generated]
AI principles
Privacy & data governanceRobustness & digital securityTransparency & explainability

Industries
Consumer services

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Business function:
Citizen/customer service

AI system task:
Interaction support/chatbots


Articles about this incident or hazard