AI-Generated Content Embeds Undisclosed Ads and Exposes Personal Data in China

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Investigations in China reveal that generative AI platforms are embedding undisclosed paid advertisements and personal information, such as phone numbers, within search results. This practice misleads users, violates consumer rights, and breaches privacy laws, as businesses exploit 'Generative Engine Optimization' (GEO) to manipulate AI-generated content for commercial gain.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves AI systems (generative AI platforms) whose outputs are deliberately manipulated through paid services to embed hidden advertisements without clear disclosure, misleading users and infringing on consumer rights and advertising laws. The presence of personal data exposure further adds to the harm. The AI system's use in this manner directly leads to violations of legal obligations and consumer rights, fulfilling the criteria for an AI Incident under violations of human rights and breach of applicable law. The article documents realized harm through misleading information and privacy breaches, not just potential harm, so it is not merely a hazard or complementary information.[AI generated]
AI principles
AccountabilityTransparency & explainabilityPrivacy & data governanceRespect of human rights

Industries
Media, social platforms, and marketing

Affected stakeholders
Consumers

Harm types
Human or fundamental rights

Severity
AI incident

Business function:
Marketing and advertisement

AI system task:
Content generation


Articles about this incident or hazard