AI Voice Profiling Raises Privacy and Discrimination Risks in Marketing

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

AI-powered voice profiling systems are increasingly used by companies to analyze callers' speech and route them to agents likely to influence their purchasing decisions. Experts warn this technology poses significant risks of privacy invasion, discrimination, and unfair profiling, highlighting the urgent need for regulation before harms materialize.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article clearly involves AI systems, specifically AI-assisted vocal analysis technologies used for profiling and marketing. The harms discussed—such as discrimination, privacy violations, and unfair treatment—are potential and plausible future harms rather than documented incidents. There is no description of a concrete event where harm has already occurred due to AI voice profiling. Instead, the article serves as a warning and advocacy for policy measures to mitigate risks. Therefore, it fits the definition of an AI Hazard, as it describes circumstances where AI use could plausibly lead to harm but does not document an actual incident.[AI generated]
AI principles
Privacy & data governanceFairnessTransparency & explainabilityAccountabilityRespect of human rightsDemocracy & human autonomy

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Business function:
Marketing and advertisement

AI system task:
Organisation/recommenders


Articles about this incident or hazard