Georgia Lawmakers Use Deepfake of Senator to Demonstrate AI Election Risks

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Georgia legislators created and presented an AI-generated deepfake video impersonating Senator Colton Moore and activist Mallory Staples without their consent to illustrate the dangers of political deepfakes. The incident spurred legislative efforts to criminalize deceptive AI use in election ads, highlighting risks of voter deception and election fraud.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves an AI system (deepfake generation technology) used to create a realistic but false video impersonating political figures. The use of this AI deepfake technology in political communication poses a credible risk of election interference and fraud, which are harms to the democratic process and communities. However, the article primarily discusses the legislative response to this risk and the demonstration of the technology's capabilities rather than reporting an actual incident of harm caused by AI deepfakes in an election. Therefore, this situation represents an AI Hazard, as the AI system's use could plausibly lead to significant harm (fraudulent election interference), but no specific harmful incident has yet occurred as described in the article.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityDemocracy & human autonomy

Industries
Media, social platforms, and marketingGovernment, security, and defence

Affected stakeholders
GovernmentCivil society

Harm types
ReputationalHuman or fundamental rights

AI system task:
Content generation


Articles about this incident or hazard