Study Finds Nearly Half of FDA-Approved AI Medical Devices Trained Without Real Patient Data

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers from UNC, Duke, Oxford, Columbia and other institutions found that 226 of 521 FDA-approved AI-based medical devices lack published clinical validation using real patient data. This raises safety and accuracy concerns and underscores calls for stronger regulatory standards and greater transparency to prevent potential harm from unvalidated AI tools in healthcare.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems in medical devices whose development and approval processes are under scrutiny due to insufficient clinical validation. Although no direct harm is reported, the potential for harm exists because these devices assist in critical health decisions. This aligns with the definition of an AI Hazard, as the use or development of these AI systems could plausibly lead to injury or harm to patients if the devices are ineffective or unsafe. The article does not describe an actual incident of harm, nor does it focus on responses or updates to past incidents, so it is not an AI Incident or Complementary Information.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRobustness & digital securitySafetyTransparency & explainability

Industries
Healthcare, drugs, and biotechnologyReal estateReal estate

Affected stakeholders
Consumers

Harm types
Physical (injury)Physical (death)PsychologicalEconomic/PropertyReputationalPublic interest

Business function:
Research and developmentMonitoring and quality control

AI system task:
Recognition/object detectionEvent/anomaly detectionForecasting/prediction


Articles about this incident or hazard