AI Note-Taking in Therapy Breaches Patient Trust and Privacy

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

A therapist in Fayetteville, Arkansas used an AI tool to record and transcribe sessions without clear patient consent, causing the patient to feel violated and lose trust. The incident highlights privacy and ethical concerns over AI use in sensitive mental health settings, with broader public distrust of such technologies.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system explicitly used to record and transcribe therapy sessions. The harm is realized: a patient experienced a breach of trust and felt violated when recorded without consent, which is a violation of privacy and ethical standards in healthcare. The AI system's use directly contributed to this harm. The article also discusses broader concerns about privacy and data security risks inherent in such AI tools. Given the direct link between AI use and harm to patient trust and privacy rights, this qualifies as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceRespect of human rights

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
ConsumersGeneral public

Harm types
Human or fundamental rightsPsychological

Business function:
Other

AI system task:
Recognition/object detection


Articles about this incident or hazard