Public Facial Recognition AI Sparks Privacy and Safety Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

PimEyes, a powerful AI-driven facial recognition tool, enables users to identify strangers from photos, leading to privacy violations, stalking, and doxxing. Despite warnings from tech leaders like Google, the technology is publicly accessible and has been misused, raising significant concerns about personal safety and human rights.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions AI systems such as facial recognition search engines (PimEyes) and AI-generated deepfake voices used in scams. These AI systems have been used to identify children from online photos without consent, leading to privacy violations and potential exploitation, which constitute harm to individuals and communities. The harms are realized, as evidenced by stalking, doxxing, and scam calls. Thus, this qualifies as an AI Incident because the development and use of AI systems have directly or indirectly led to violations of rights and harm to communities. The article also discusses societal responses and parental strategies but the primary focus is on the harms caused by AI use.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsSafetyRobustness & digital securityTransparency & explainabilityAccountabilityHuman wellbeing

Industries
Media, social platforms, and marketingDigital securityConsumer services

Affected stakeholders
General public

Harm types
Human or fundamental rightsPsychologicalReputational

Severity
AI incident

Business function:
Other

AI system task:
Recognition/object detection


Articles about this incident or hazard

Thumbnail Image

Can You Hide a Child's Face From A.I.?

2023-10-14
The New York Times
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions AI systems such as facial recognition search engines (PimEyes) and AI-generated deepfake voices used in scams. These AI systems have been used to identify children from online photos without consent, leading to privacy violations and potential exploitation, which constitute harm to individuals and communities. The harms are realized, as evidenced by stalking, doxxing, and scam calls. Thus, this qualifies as an AI Incident because the development and use of AI systems have directly or indirectly led to violations of rights and harm to communities. The article also discusses societal responses and parental strategies but the primary focus is on the harms caused by AI use.
Thumbnail Image

Facial Recognition Tech Even Google Determined Was 'Too Dangerous' Raises Alarm Bells, Privacy Concerns

2023-10-11
Entrepreneur
Why's our monitor labelling this an incident or hazard?
PimEyes is an AI system performing facial recognition and reverse image search, clearly involving AI. Its use has directly led to harms related to privacy violations and potential stalking, which are violations of human rights and harm to communities. The article documents actual use cases where individuals' identities were exposed without consent, demonstrating realized harm. Therefore, this qualifies as an AI Incident due to the direct link between the AI system's use and harm to individuals' rights and privacy.
Thumbnail Image

'Too dangerous:' Why even Google was afraid to release this technology

2023-10-11
KPBS
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (facial recognition tools) that are being used in ways that have directly led to harms such as privacy violations, stalking, and potential breaches of fundamental rights. The harms are realized and ongoing, not merely potential. Therefore, this qualifies as an AI Incident under the framework, as the AI systems' use has directly or indirectly led to violations of human rights and harm to communities through privacy breaches and surveillance.
Thumbnail Image

'Too dangerous:' Why even Google was afraid to release this technology

2023-10-11
Georgia Public Broadcasting
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems, specifically facial recognition AI that scans and identifies individuals from images. The harms described include violations of privacy rights and potential breaches of fundamental rights due to surveillance and stalking, which fall under violations of human rights and harm to communities. These harms are occurring or have occurred, as evidenced by the use of PimEyes by stalkers and the collection of images without consent. Therefore, this qualifies as an AI Incident because the AI system's use has directly or indirectly led to significant harms. The discussion of potential future harms and regulatory responses complements the incident but does not overshadow the realized harms described.
Thumbnail Image

Too dangerous: Why even Google was afraid to release this technology Imagine strolling down a busy city street and snapping a photo of a stranger then

2023-10-11
Bollyinside - Breaking & latest News worldwide
Why's our monitor labelling this an incident or hazard?
The article clearly involves AI systems, namely facial recognition AI. The concerns raised about privacy violations and misuse by governments or private companies indicate plausible future harms, such as violations of human rights and privacy. Since no actual harm or incident is described as having occurred, but the potential for harm is credible and significant, this qualifies as an AI Hazard. The article also emphasizes the need for regulation to prevent abuse, reinforcing the potential risk nature of the event.
Thumbnail Image

Too dangerous: Why even Google was afraid to release this technology | News PimEyes, a powerful facial recognition tool, has become popular among internet

2023-10-11
Bollyinside - Breaking & latest News worldwide
Why's our monitor labelling this an incident or hazard?
The article centers on the potential risks and ethical concerns related to the deployment and use of AI-powered facial recognition systems. It does not report a specific incident where harm has already occurred but emphasizes the credible risk of privacy violations, harassment, and misuse if such technology becomes widespread without regulation. Therefore, it fits the definition of an AI Hazard, as the development and use of these AI systems could plausibly lead to harms such as privacy invasion and online harassment.