AI-Generated Spam and Academic Dishonesty Cause Harm Online and in Education

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Generative AI is being used to create low-quality spam content that misleads users on Google, including in health and technical advice, and contaminates training data. Separately, studies show students increasingly use AI chatbots to generate coursework, undermining academic integrity and harming educational standards.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of AI systems (chatbots) by students to generate coursework, which constitutes indirect harm to the educational community and academic integrity, a form of harm to communities and violation of ethical standards. The AI system's use has directly led to this harm as per the study's findings. Therefore, this qualifies as an AI Incident due to realized harm caused by AI use in academic dishonesty and its impact on education.[AI generated]
AI principles
AccountabilityFairnessHuman wellbeingRobustness & digital securitySafetyTransparency & explainabilityDemocracy & human autonomy
Industries
Media, social platforms, and marketingEducation and trainingHealthcare, drugs, and biotechnologyDigital security
Affected stakeholders
General public
Harm types
Physical (injury)ReputationalPublic interestEconomic/PropertyPsychological
Business function:
Marketing and advertisementResearch and developmentMonitoring and quality control
AI system task:
Content generationInteraction support/chatbots

Articles about this incident or hazard