AI Chatbots Impersonating Jesus Raise Concerns of Manipulation and Harm

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Multiple AI chatbots are impersonating Jesus Christ, offering spiritual guidance and confessions to users. Studies warn these bots, often run by for-profit companies, risk misleading or exploiting vulnerable individuals, potentially causing psychological harm and manipulating users for financial gain through ads and microtransactions.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI systems involved are chatbots using natural language generation to simulate Jesus Christ, which qualifies as AI systems. The event involves the use of these AI systems in a way that could plausibly lead to harm, such as misleading or exploiting vulnerable users, constituting potential psychological or emotional harm. Since no direct harm is reported but the potential for harm is credible and significant, this event fits the definition of an AI Hazard rather than an AI Incident. It is not merely complementary information because the focus is on the potential risks posed by these AI chatbots, not on responses or ecosystem updates.[AI generated]
AI principles
Transparency & explainabilityHuman wellbeingRespect of human rightsAccountabilitySafetyDemocracy & human autonomyPrivacy & data governance

Industries
Media, social platforms, and marketingConsumer services

Affected stakeholders
Consumers

Harm types
PsychologicalEconomic/Property

Business function:
Marketing and advertisementSales

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard