Study Uncovers Privacy Risks in Amazon Alexa's Third-Party Skills

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers found that Amazon Alexa's third-party skills, powered by AI, have significant privacy vulnerabilities. Flaws in Amazon's vetting process allow third-party developers to access users' personal data, change code post-approval, and potentially mislead users, resulting in unauthorized data access and privacy violations.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems explicitly through Amazon Alexa's voice-activated assistant and its third-party skills, which are AI-powered programs enabling user interaction. The study documents direct privacy harms caused by these AI systems' vulnerabilities, such as unauthorized data access and misleading invocation phrases leading to potential phishing. The researchers demonstrated that developers can modify skill behavior post-approval to collect more data, indicating a malfunction or misuse of the AI system's development and use. These factors meet the criteria for an AI Incident as the AI system's use has directly led to violations of privacy rights and harm to users' personal information.[AI generated]
AI principles
Privacy & data governanceRobustness & digital securityTransparency & explainabilityAccountabilityRespect of human rights

Industries
Consumer servicesDigital security

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Business function:
Citizen/customer service

AI system task:
Interaction support/chatbots


Articles about this incident or hazard