AI Algorithm in Australian Aged Care Causes Funding Errors and Harm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

An AI-driven Integrated Assessment Tool used by the Australian government to allocate at-home aged care funding has led to over 1,000 complaints, with reports of inadequate support and inability to override algorithmic decisions. Lack of clinical validation and auditing has resulted in harm to elderly recipients.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly mentions an automated assessment tool (an AI system) used in aged care that has led to under-assessment, which implies harm to the health and well-being of older people (harm category a). This harm has already occurred as the tool has 'frequently under-assessed cases' leading to inadequate care. Therefore, this qualifies as an AI Incident because the AI system's use has directly or indirectly led to harm to people. The government's response to refine the system is a complementary action but the main event is the harm caused by the AI system's prior use.[AI generated]
AI principles
AccountabilitySafety

Industries
Government, security, and defenceHealthcare, drugs, and biotechnology

Affected stakeholders
Consumers

Harm types
Economic/Property

Business function:
Planning and budgeting

AI system task:
Goal-driven organisation


Articles about this incident or hazard