Medical AI Models Expose Privacy Risks for Vulnerable Patients

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A study led by the Technical University of Munich and Imperial College London found that medical AI models trained on sensitive patient data can expose individuals, especially those with rare diseases or from minority groups, to privacy breaches. Membership inference attacks can reveal whether specific patient data was used in training, compromising privacy.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly involves AI systems (medical AI models) and discusses a security vulnerability (MIA) that can lead to privacy breaches, a violation of fundamental rights related to data protection and privacy. While the harm is not reported as having occurred yet, the study demonstrates that such attacks could plausibly lead to significant harm to individuals' privacy, especially vulnerable groups. Therefore, this event fits the definition of an AI Hazard, as it describes circumstances where AI system use could plausibly lead to an AI Incident involving violations of rights and harm to individuals.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Other

Harm types
Human or fundamental rights

Severity
AI hazard

Business function:
Research and development

AI system task:
Forecasting/prediction


Articles about this incident or hazard

Thumbnail Image

La IA médica puede exponer la privacidad de pacientes con enfermedades raras y grupos minoritarios

2026-06-24
Agencia Sinc
Why's our monitor labelling this an incident or hazard?
The event involves AI systems explicitly used in medical data analysis and training. The study documents actual privacy breaches where AI models can reveal whether specific individuals' data were used in training, leading to exposure of sensitive medical information. This constitutes a violation of privacy rights and potentially other legal protections, fulfilling the criteria for harm under human rights and legal obligations. The harm is realized, not just potential, as the study shows successful attacks. Hence, it is an AI Incident rather than a hazard or complementary information.
Thumbnail Image

La IA aplicada a la medicina puede comprometer la privacidad de ciertos pacientes

2026-06-24
infobae
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (medical AI models) and discusses a security vulnerability (MIA) that can lead to privacy breaches, a violation of fundamental rights related to data protection and privacy. While the harm is not reported as having occurred yet, the study demonstrates that such attacks could plausibly lead to significant harm to individuals' privacy, especially vulnerable groups. Therefore, this event fits the definition of an AI Hazard, as it describes circumstances where AI system use could plausibly lead to an AI Incident involving violations of rights and harm to individuals.
Thumbnail Image

La IA médica puede exponer datos sensibles, pero el riesgo no es igual para todos

2026-06-24
EL PAÍS
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems used in medical contexts and describes a type of attack (MIA) that can infer sensitive personal data from AI models. While no actual data breach or harm is reported, the study demonstrates that such attacks are feasible and pose a credible risk, especially to vulnerable populations. This fits the definition of an AI Hazard, where the AI system's use could plausibly lead to violations of privacy and human rights. The article also discusses potential mitigation techniques and the need for further research, indicating ongoing concern rather than a resolved incident. Hence, it is not an AI Incident or Complementary Information, but an AI Hazard.
Thumbnail Image

Advierten que la IA médica puede exponer datos de pacientes vulnerables

2026-06-24
Montevideo Portal / Montevideo COMM
Why's our monitor labelling this an incident or hazard?
The event involves AI systems used in medicine and their development and use with sensitive patient data. The study identifies a concrete risk of privacy harm to individuals, especially vulnerable groups, due to AI models memorizing specific data patterns, enabling attackers to infer patient data membership. This constitutes a violation of privacy rights, a form of harm to individuals and communities. Although the harm is currently a risk rather than a realized widespread breach, the article presents credible evidence that such harm could plausibly occur if unmitigated. Therefore, this qualifies as an AI Hazard because it describes a plausible future harm stemming from the use and development of AI systems in medicine, but does not report an actual incident of data breach or harm having already occurred.
Thumbnail Image

La IA aplicada a la medicina puede comprometer la privacidad de ciertos pacientes

2026-06-24
ABC Digital
Why's our monitor labelling this an incident or hazard?
The event involves the use and development of AI systems (medical AI models) that process sensitive patient data. The article describes realized privacy harms to individuals, particularly vulnerable groups, due to successful attacks exploiting AI models. This constitutes a violation of privacy rights, a form of harm to individuals and communities. Since the harm is occurring or has occurred due to the AI system's use and vulnerabilities, this qualifies as an AI Incident under the framework, specifically under violations of human rights or breach of obligations intended to protect fundamental rights (privacy).