AI Chatbot Mimics Deceased Fiancée, Raising Ethical and Misinformation Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Joshua Barbeau used Project December, powered by OpenAI's GPT-3, to create a chatbot that convincingly mimicked his deceased fiancée. While no direct harm occurred, experts and creators warn that such AI technology could be misused for impersonation and large-scale misinformation, highlighting significant ethical and societal risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (GPT-3-based chatbot) is explicitly involved and has been used to recreate a deceased person’s persona, which is a direct use of AI technology. Although the article does not report actual harm caused by this specific use, it clearly states the creators' warnings about the technology's potential to be used maliciously for misinformation, impersonation, and fake content generation. This potential for harm is credible and significant, fitting the definition of an AI Hazard. Since no actual harm or incident is described as having occurred, and the main focus is on the potential dangers and societal implications, the event is best classified as an AI Hazard.[AI generated]
AI principles
AccountabilityTransparency & explainabilityPrivacy & data governanceRespect of human rightsHuman wellbeingDemocracy & human autonomy

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalPublic interest

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard