Signal President Warns of Agentic AI Privacy Risks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Signal President Meredith Whittaker warned at SXSW about the risks of agentic AI, emphasizing potential privacy and security issues. She highlighted how autonomous AI agents, which handle personal tasks by accessing user data, might compromise user privacy if not adequately managed.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems described as agentic AI performing autonomous tasks with deep access to user data and system controls, which fits the definition of an AI system. The concerns raised relate to the plausible future risk of privacy and security harms due to the AI's access and data handling, but no actual incident of harm is reported. Therefore, this qualifies as an AI Hazard because it describes a credible risk of harm that could plausibly arise from the development and use of such AI systems.[AI generated]
AI principles
AccountabilityPrivacy & data governanceRespect of human rightsRobustness & digital securityTransparency & explainabilityDemocracy & human autonomy

Industries
Consumer servicesDigital securityIT infrastructure and hosting

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Severity
AI hazard

Business function:
Citizen/customer service

AI system task:
Interaction support/chatbotsGoal-driven organisationReasoning with knowledge structures/planning


Articles about this incident or hazard