Apple's 'Live Notes' AI at Genius Bar Raises Employee Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Apple is piloting an AI tool called Live Notes at select Genius Bars in the US, which records, transcribes, and summarizes customer interactions. While intended to boost efficiency, employees are concerned about potential future misuse for monitoring or performance evaluation, though current safeguards require opt-in and restrict manager access.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (Live Notes) is explicitly mentioned and is used to transcribe and summarize conversations, which fits the definition of an AI system. The employees' concerns about management using transcripts for evaluation relate to potential violations of labor rights or privacy, which are harms under the framework. However, since the article states that currently there is a policy preventing managers from accessing unedited transcripts and no mandatory use is imposed, no actual harm has occurred yet. The event thus fits the definition of an AI Hazard, as the AI system's use could plausibly lead to an AI Incident if policies change or misuse happens in the future. There is no indication of a beneficial use countering external harm, nor is this a complementary information piece or unrelated news.[AI generated]
AI principles
Privacy & data governance

Industries
Consumer services

Affected stakeholders
Workers

Harm types
Human or fundamental rights

Severity
AI hazard

Business function:
Citizen/customer service

AI system task:
Content generation


Articles about this incident or hazard