AI-Generated Illustrations in Chinese Science Book Cause Misinformation and Recall

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

China Agriculture Press used AI tools to generate illustrations for a marine science book series, resulting in scientifically inaccurate images like a two-headed shrimp and anthropomorphic fish. The errors led to public outcry, misinformation concerns, and a nationwide recall and removal of the books, highlighting risks of unvetted AI content in educational publishing.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system was explicitly used to generate images for a science book, and the resulting images contained serious factual errors that misrepresent biological facts. This misinformation harms the community by misleading readers and damaging the credibility of educational materials. The harm is realized and directly linked to the AI system's outputs and the lack of proper human oversight. Therefore, this event meets the criteria for an AI Incident due to harm to communities through misinformation and violation of the educational trust.[AI generated]
AI principles
AccountabilitySafety

Industries
Education and trainingMedia, social platforms, and marketing

Affected stakeholders
BusinessGeneral public

Harm types
ReputationalPublic interestEconomic/Property

Business function:
Research and development

AI system task:
Content generation


Articles about this incident or hazard