AI-Generated Patient Complaints Overwhelm UK GPs

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

In the UK, general practitioners are facing a surge of lengthy, AI-generated patient complaints—sometimes exceeding 20 pages—which are significantly increasing workloads and negatively impacting staff wellbeing and morale. Nearly half of surveyed GP practice managers report these AI-generated letters are straining already stretched healthcare services.[AI generated]

Why's our monitor labelling this an incident or hazard?

An AI system is explicitly involved as it generates the complaints. The harm arises from the use of AI-generated complaints that are overly complex and time-consuming, leading to increased workload and emotional toll on GPs and staff, which is a form of harm to groups of people (healthcare workers) and indirectly to patients due to diverted care. The event describes realized harm, not just potential harm, and the AI system's role is pivotal in causing this harm. Hence, it meets the criteria for an AI Incident rather than an AI Hazard or Complementary Information.[AI generated]
AI principles
AccountabilitySafety

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
Workers

Harm types
Psychological

AI system task:
Content generation


Articles about this incident or hazard