AI Chatbot Mimics Deceased Fiancée, Raising Ethical and Misinformation Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Joshua Barbeau used Project December, powered by OpenAI's GPT-3, to create a chatbot that convincingly mimicked his deceased fiancée. While no direct harm occurred, experts and creators warn that such AI technology could be misused for impersonation and large-scale misinformation, highlighting significant ethical and societal risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system (GPT-3-based chatbot) is explicitly involved and has been used to recreate a deceased person’s persona, which is a direct use of AI technology. Although the article does not report actual harm caused by this specific use, it clearly states the creators' warnings about the technology's potential to be used maliciously for misinformation, impersonation, and fake content generation. This potential for harm is credible and significant, fitting the definition of an AI Hazard. Since no actual harm or incident is described as having occurred, and the main focus is on the potential dangers and societal implications, the event is best classified as an AI Hazard.[AI generated]
AI principles
AccountabilityTransparency & explainabilityPrivacy & data governanceRespect of human rightsHuman wellbeingDemocracy & human autonomy

Industries
Consumer servicesMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
PsychologicalPublic interest

Severity
AI hazard

AI system task:
Interaction support/chatbotsContent generation


Articles about this incident or hazard

Thumbnail Image

A man used AI to bring back his deceased fiancé. But the creators of the tech warn it could be dangerous and used to spread misinformation.

2021-07-24
Yahoo News
Why's our monitor labelling this an incident or hazard?
The AI system (GPT-3-based chatbot) is explicitly involved and has been used to recreate a deceased person’s persona, which is a direct use of AI technology. Although the article does not report actual harm caused by this specific use, it clearly states the creators' warnings about the technology's potential to be used maliciously for misinformation, impersonation, and fake content generation. This potential for harm is credible and significant, fitting the definition of an AI Hazard. Since no actual harm or incident is described as having occurred, and the main focus is on the potential dangers and societal implications, the event is best classified as an AI Hazard.
Thumbnail Image

A man used AI to bring back his deceased fiancé. But the creators of the tech warn it could be dangerous and used to spread misinformation.

2021-07-24
Business Insider
Why's our monitor labelling this an incident or hazard?
The AI system is explicitly involved as it is used to create hyper-realistic chatbots. The article reports on the use of the AI system by an individual, but no direct harm or violation of rights is described from this use. However, the creators warn about the plausible future misuse of the technology to spread misinformation, which could lead to harm to communities and societal disruption. Since no actual harm has occurred yet, but there is a credible risk of future harm, this event qualifies as an AI Hazard rather than an AI Incident. The article also provides contextual information about the broader implications of such AI systems, but the main focus is on the potential dangers rather than a realized incident.
Thumbnail Image

Artificial Intelligence Chatbot Attempts to Mimic a Man's Deceased Fiancee -- But Creators Say it's Dangerous

2021-07-25
Tech Times
Why's our monitor labelling this an incident or hazard?
The article explicitly involves an AI system (GPT-3) used to generate human-like text mimicking a deceased individual, which fits the definition of an AI system. The event involves the use of this AI system and discusses the potential for harm, including misinformation and impersonation, which are recognized as significant harms to communities and individuals. However, the article does not document a specific incident of harm caused by this chatbot but rather focuses on the potential dangers and the creators' warnings and restrictions. This aligns with the definition of an AI Hazard, as the AI system's use could plausibly lead to harm, and the article emphasizes the risk and mitigation rather than a realized incident. Therefore, the classification is AI Hazard.
Thumbnail Image

Can AI safely recreate interactions with your deceased loved ones? | NewsBytes

2021-07-25
NewsBytes
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of AI systems (GPT-3 and GPT-2) to generate hyper-realistic chatbot interactions. It acknowledges the potential for misuse in large-scale misinformation campaigns and impersonation, which are credible risks. Since no actual harm has occurred but there is a plausible risk of harm from misuse, this fits the definition of an AI Hazard. The article also discusses societal responsibility and transparency but does not report any realized harm or incident.
Thumbnail Image

Canadian Writer Makes an AI Chatbot to 'Bring Back Dead Fiancee to Life'

2021-07-25
Science Times
Why's our monitor labelling this an incident or hazard?
The AI system (Project December using GPT-3) is explicitly mentioned and used to create a chatbot that simulates a deceased person. The article does not describe any realized harm such as injury, rights violations, or disruption caused by this chatbot interaction. Instead, it focuses on the potential for misuse of the technology, such as misinformation and impersonation, which are plausible future harms. Hence, the event fits the definition of an AI Hazard because it could plausibly lead to harm, but no harm has yet occurred. The article also includes broader societal commentary and warnings about AI misuse, reinforcing the hazard classification rather than an incident or complementary information.
Thumbnail Image

A man just used AI to bring back his deceased fiancé and the creators of the tech warn of the danger it poses

2021-07-26
End Time Headlines
Why's our monitor labelling this an incident or hazard?
The AI system (Project December using GPT-3) is explicitly involved in creating chatbots that emulate deceased persons. Although the personal use described does not directly cause harm, the creators' warnings about potential misuse for misinformation and impersonation indicate a plausible risk of significant harm in the future. Since no realized harm is reported, but credible future harm is identified, this fits the definition of an AI Hazard. The article also includes complementary information about other AI applications but the main focus is on the potential dangers of this chatbot technology.
Thumbnail Image

A man used AI to bring back his deceased fiancé. But the creators of the tech warn it could be dangerous and used to spread misinformation.

2021-07-24
Business Insider Nederland
Why's our monitor labelling this an incident or hazard?
The article explicitly involves an AI system (GPT-3-based chatbot) used to recreate a deceased person’s persona, which is a direct use of AI technology. There is no indication that this use caused injury, rights violations, or other harms. However, the creators and experts warn about the potential for this technology to be misused for mass misinformation and impersonation, which are credible risks that could lead to significant harm. The presence of these warnings and the discussion of societal implications align with the definition of an AI Hazard, as the event plausibly could lead to an AI Incident in the future. The article does not focus primarily on responses or governance measures, so it is not Complementary Information. It is not unrelated because it clearly involves AI and its societal risks.
Thumbnail Image

A man used AI to bring back his deceased fiancée.

2021-07-27
freedomsphoenix.com
Why's our monitor labelling this an incident or hazard?
The AI system is clearly involved as it is used to create a chatbot mimicking a deceased person. The use is described, but no harm or violation has occurred or is implied to have occurred. The concerns about misinformation are general and not specific to this incident. Therefore, this event does not meet the criteria for an AI Incident or AI Hazard. It is best classified as Complementary Information because it provides context and insight into AI applications and potential societal implications without describing a harm or credible risk of harm in this specific case.