NewsBreak's AI-Generated Misinformation Sparks Security Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

NewsBreak, a popular US news app with Chinese ties, is under scrutiny for using AI to generate false news stories, causing real-world harm. Incidents include false reports of shootings and incorrect food distribution times, leading to public confusion. US lawmakers are concerned about the app's Chinese origins and misinformation impact.[AI generated]

Why's our monitor labelling this an incident or hazard?

The app employs AI tools to fabricate or rewrite local news, leading to factual errors (e.g., fake shooting report, wrong food bank times) that misled readers and forced charities to turn people away. These incidents constitute misinformation harm to communities and reputational and operational damage to organizations, with the AI system’s outputs being the pivotal cause of these harms.[AI generated]
AI principles
AccountabilityTransparency & explainabilityDemocracy & human autonomyRobustness & digital securitySafety
Industries
Media, social platforms, and marketing
Affected stakeholders
General public
Harm types
PsychologicalPublic interest
Business function:
Other
AI system task:
Content generation
In other databases
Open in  AIID Logo

Articles about this incident or hazard