Amazon Alexa Vulnerability Enables Self-Issued Malicious Commands

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers from Royal Holloway, University of London, discovered a vulnerability in Amazon Alexa devices that allowed attackers to exploit the AI assistant to issue unauthorized voice commands via the device's own speakers. This flaw enabled privacy breaches, unauthorized purchases, and control of smart appliances before being patched.[AI generated]

Why's our monitor labelling this an incident or hazard?

The Alexa voice assistant is an AI system that processes and executes voice commands. The described vulnerability allowed attackers to exploit the AI system's behavior to issue unauthorized commands, leading to harms such as privacy breaches (eavesdropping), unauthorized purchases, and control of smart appliances. These harms fall under injury to persons (privacy and security), harm to property (unauthorized appliance control), and violation of rights (privacy). The event is not merely a potential risk but a realized vulnerability that could be exploited, thus constituting an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Robustness & digital securityPrivacy & data governanceSafetyAccountabilityRespect of human rightsTransparency & explainability

Industries
Consumer productsConsumer servicesDigital securityIT infrastructure and hosting

Affected stakeholders
Consumers

Harm types
Human or fundamental rightsEconomic/PropertyPsychologicalReputational

Severity
AI incident

AI system task:
Interaction support/chatbots


Articles about this incident or hazard

Thumbnail Image

Amazon Alexa compromise possible through own speakers

2022-03-03
TheRegister.com
Why's our monitor labelling this an incident or hazard?
The Alexa voice assistant is an AI system that processes and executes voice commands. The described vulnerability allowed attackers to exploit the AI system's behavior to issue unauthorized commands, leading to harms such as privacy breaches (eavesdropping), unauthorized purchases, and control of smart appliances. These harms fall under injury to persons (privacy and security), harm to property (unauthorized appliance control), and violation of rights (privacy). The event is not merely a potential risk but a realized vulnerability that could be exploited, thus constituting an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Si possono violare i dispositivi Alexa facendoli parlare tra loro

2022-03-07
Wired
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Amazon Alexa) whose malfunction or exploitation has directly led to harms including unauthorized control of smart home devices, unauthorized calls, and purchases. These harms fall under harm to property and potentially harm to persons (security risks). The AI system's voice recognition and command processing capabilities are central to the incident, as attackers use audio commands to manipulate the system. Therefore, this qualifies as an AI Incident due to direct harm caused by the AI system's exploitation.
Thumbnail Image

Forscher bringen Amazons Echo-Lautsprecher dazu, sich selbst zu hacken

2022-03-08
der Standard
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Amazon Alexa voice assistant) whose malfunction or exploitation leads directly to harms including unauthorized control of smart home devices, privacy breaches, and potential physical harm (e.g., turning on an oven to dangerous temperatures). The researchers demonstrated the attack, indicating realized vulnerabilities rather than just theoretical risks. Therefore, this qualifies as an AI Incident because the AI system's use and malfunction have directly led to harms or risks of harm to persons and property.
Thumbnail Image

Alexa hackt sich selbst - Sicherheitslücke in Amazons Sprachassistent

2022-03-10
Netzwoche
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Alexa, a voice assistant using AI for speech recognition and command execution). The vulnerability allows malicious use of the AI system to cause harm including privacy violations (eavesdropping), unauthorized control of devices, and potential financial harm (unauthorized orders). These harms fall under violations of rights and harm to property or communities. Since the harm has occurred or is directly enabled by the AI system's misuse, this qualifies as an AI Incident. The company's response is noted but does not change the classification.