Worldcoin's iris-scanning AI halted over GDPR privacy breaches

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

World, formerly known as Worldcoin and co-founded by OpenAI’s Sam Altman, had its iris-scanning AI biometric ID service suspended in Spain and Bavaria over unauthorized data collection, including minors'. Regulators CNPD and BayLDA ordered data deletion, unlimited erasure rights, and anonymization, delaying relaunch until 2025.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (biometric iris scanning technology) whose use has led to a violation of data protection laws, which are legal rights protecting individuals' privacy. The regulatory order to delete data is a response to this violation. Since the AI system's use has directly led to a breach of applicable law protecting fundamental rights, this qualifies as an AI Incident under the framework.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsAccountabilityTransparency & explainability

Industries
Digital securityConsumer servicesIT infrastructure and hosting

Affected stakeholders
ConsumersChildren

Harm types
Human or fundamental rightsReputationalEconomic/Property

Severity
AI incident

Business function:
ICT management and information security

AI system task:
Recognition/object detection


Articles about this incident or hazard

Thumbnail Image

Órgão espanhol determina à Worldcoin a exclusão de todos os dados de íris escaneadas

2024-12-19
uol.com.br
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (biometric iris scanning technology) whose use has led to a violation of data protection laws, which are legal rights protecting individuals' privacy. The regulatory order to delete data is a response to this violation. Since the AI system's use has directly led to a breach of applicable law protecting fundamental rights, this qualifies as an AI Incident under the framework.
Thumbnail Image

Worldcoin obrigada a permitir eliminação de dados. Empresa vai recorrer da decisão - SAPO Tek

2024-12-20
SAPO Tek
Why's our monitor labelling this an incident or hazard?
Worldcoin is an AI-related system that processes biometric data for identity verification, which involves AI technologies. The regulatory decision mandates compliance with data protection laws, focusing on user rights and data deletion. While the decision addresses potential risks related to data privacy, it does not describe an actual harm or incident caused by the AI system. The company is responding to regulatory scrutiny and plans to appeal, indicating ongoing governance and compliance processes. This fits the definition of Complementary Information, as it updates on societal and governance responses to AI-related data privacy concerns without reporting a new AI Incident or AI Hazard.
Thumbnail Image

Worldcoin obrigada a permitir aos utilizadores apagarem dados biométricos

2024-12-19
Sapo - Portugal Online!
Why's our monitor labelling this an incident or hazard?
Worldcoin uses AI systems to collect and process biometric data (iris scans). The investigation found that the company's data handling practices violated data protection regulations, infringing on users' rights to control their biometric data. This constitutes a violation of fundamental rights under applicable law, fulfilling the criteria for an AI Incident. The event describes realized harm in terms of rights violations and regulatory enforcement, not just potential harm or general information, so it is classified as an AI Incident.
Thumbnail Image

Regulador alemão ordena ao projeto de identificação biométrica World que apague os dados

2024-12-19
euronews
Why's our monitor labelling this an incident or hazard?
The World project involves an AI system that processes biometric data (iris and facial scans) for identification purposes. The German data protection authority's order to delete data arises from the AI system's use leading to violations of data privacy rights under the GDPR, which constitutes a breach of applicable law protecting fundamental rights. This is a direct harm related to human rights and privacy caused by the AI system's use. Therefore, this event qualifies as an AI Incident because the AI system's use has directly led to a violation of fundamental rights and legal obligations, triggering regulatory enforcement actions.
Thumbnail Image

Órgão espanhol determina à Worldcoin a exclusão de todos os dados de íris escaneadas

2024-12-19
Terra
Why's our monitor labelling this an incident or hazard?
Worldcoin's system uses AI to scan and process iris data for identity verification, which is explicitly mentioned. The Spanish authority's order to delete data and the upheld court ban demonstrate that the AI system's use has directly led to violations of data protection laws, a breach of legal obligations protecting fundamental rights. This fits the definition of an AI Incident under violations of human rights or breach of applicable law. The event is not merely a potential risk but a realized harm in terms of legal and privacy rights violations.
Thumbnail Image

Worldcoin vai recorrer das medidas ordenadas pela Autoridade da Baviera

2024-12-19
Notícias ao Minuto
Why's our monitor labelling this an incident or hazard?
The event involves an AI system insofar as Worldcoin uses biometric iris scanning technology and AI-related methods (e.g., secure multiparty computation and anonymization) to create digital identities. The issue arises from the use and processing of biometric data by an AI-enabled system, which is subject to data protection regulations. However, the event does not describe any realized harm such as injury, rights violations, or other direct impacts caused by the AI system. Instead, it focuses on regulatory compliance, data privacy concerns, and ongoing legal and technical adjustments. There is no indication of actual harm or incident caused by the AI system, nor a direct or indirect causal link to harm. The event is primarily about governance, legal scrutiny, and the company's response to regulatory findings, which fits the definition of Complementary Information.
Thumbnail Image

Worldcoin obrigada a permitir aos utilizadores apagarem dados biométricos

2024-12-19
RTP - Rádio Televisão Portuguesa
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (biometric iris recognition technology) used by Worldcoin. However, the article does not describe any realized harm such as injury, rights violations that have led to complaints or legal actions, or other direct harms caused by the AI system's malfunction or misuse. Instead, it focuses on regulatory enforcement to ensure compliance with data protection laws and user rights, including the right to data deletion. There is no indication of an incident causing harm, nor a plausible future harm scenario beyond regulatory concerns. The main content is about regulatory response and compliance measures, which fits the definition of Complementary Information rather than an AI Incident or AI Hazard.
Thumbnail Image

Autoridade da Baviera ordena "medidas corretivas" à Worldcoin no tratamento de dados dos utilizadores

2024-12-19
Observador
Why's our monitor labelling this an incident or hazard?
Worldcoin's biometric data processing involves AI systems for iris recognition, so AI system involvement is clear. The event concerns regulatory actions enforcing compliance with data protection laws, addressing past non-compliance and requiring corrective measures. There is no indication of direct or indirect harm caused by the AI system's malfunction or misuse; rather, the focus is on ensuring lawful processing and user rights protection. The event does not describe a realized AI Incident or a plausible future AI Hazard but rather a governance response to prior issues. Hence, it fits the definition of Complementary Information, as it updates on regulatory oversight and company responses related to AI data processing practices.
Thumbnail Image

Worldcoin obrigada a permitir aos utilizadores apagarem dados biométricos

2024-12-19
Revista SÁBADO
Why's our monitor labelling this an incident or hazard?
The article involves an AI system that processes biometric data (iris scans), which is a form of AI system involvement. The event concerns the use and management of personal biometric data and the enforcement of data protection rights, specifically the right to erasure. However, there is no indication that harm has occurred or that there is a plausible risk of harm from the AI system's use. Instead, this is a governance and regulatory response to ensure compliance with data protection laws. Therefore, this is Complementary Information as it provides an update on societal and governance responses related to AI systems handling biometric data.
Thumbnail Image

Worldcoin obrigada a eliminar dados dos utilizadores

2024-12-21
TugaTech
Why's our monitor labelling this an incident or hazard?
Worldcoin's biometric iris scanning system is an AI system used for identity authentication. The regulatory decisions forcing deletion of data and banning the platform temporarily in Spain and Germany indicate that the AI system's use has led to violations of data protection laws, which protect fundamental rights. This constitutes a breach of obligations under applicable law, fitting the definition of an AI Incident. The harm is realized (legal violations and regulatory penalties), not just potential, so it is not an AI Hazard. The event is not merely complementary information or unrelated, as it involves direct regulatory action due to the AI system's use causing harm.
Thumbnail Image

Empresa que lê os dados da íris em troca de criptomoedas prepara regresso em 2025 após controvérsias com proteção de dados - Executive Digest

2024-12-18
Executive Digest - A leitura indispensável para executivos
Why's our monitor labelling this an incident or hazard?
The event involves an AI system that uses biometric iris scanning for identity verification, which is central to the company's operations. The system's use has directly led to violations of data protection and privacy rights, including unauthorized data collection from minors, which is a breach of applicable law protecting fundamental rights. Regulatory authorities have suspended the system's operation due to these harms. The company's subsequent measures to anonymize data and improve privacy are responses to these incidents, but the harms have already occurred. Hence, this is an AI Incident rather than a hazard or complementary information.