FBI Deploys AI-Powered Babel X for Mass Social Media Surveillance, Raising Privacy Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

The FBI has signed a $27 million contract for 5,000 licenses of Babel X, an AI-driven tool by Babel Street, to conduct large-scale surveillance and data mining across social media platforms. Civil liberties advocates warn this use of AI risks violating privacy and human rights through mass data collection and analysis.[AI generated]

Why's our monitor labelling this an incident or hazard?

The event involves the use of an AI system (Babel X) by the FBI to conduct large-scale social media surveillance. This use directly impacts privacy rights, a fundamental human right, and has been criticized for potentially causing harm through biased targeting of vulnerable groups. The harm is occurring or imminent due to the active contract and deployment, meeting the criteria for an AI Incident under violations of human rights and harm to communities. The concerns raised by experts and activists about bias and privacy infringement further support this classification.[AI generated]
AI principles
Privacy & data governanceRespect of human rightsTransparency & explainabilityAccountabilityDemocracy & human autonomyFairnessRobustness & digital securityHuman wellbeing

Industries
Government, security, and defenceDigital securityMedia, social platforms, and marketing

Affected stakeholders
General public

Harm types
Human or fundamental rightsPublic interest

Severity
AI incident

Business function:
Compliance and justiceMonitoring and quality control

AI system task:
Event/anomaly detectionOrganisation/recommendersReasoning with knowledge structures/planning


Articles about this incident or hazard

Thumbnail Image

FBI investing millions in software to monitor social media platforms

2022-04-06
TechRepublic
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI-enabled social media monitoring system by the FBI, which is a clear AI system involvement. The software's use is intended for surveillance and threat detection, which could plausibly lead to violations of privacy and civil liberties, constituting harm to human rights if misused. However, the article does not describe any actual harm or incidents caused by the software's deployment so far, only potential risks and concerns. Therefore, this event fits the definition of an AI Hazard, as the development and use of this AI system could plausibly lead to an AI Incident in the future, but no direct or indirect harm has yet been reported.
Thumbnail Image

The FBI Is Upping Its Social Media Surveillance Program

2022-04-07
Android Headlines
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (Babel X) by the FBI to conduct large-scale social media surveillance. This use directly impacts privacy rights, a fundamental human right, and has been criticized for potentially causing harm through biased targeting of vulnerable groups. The harm is occurring or imminent due to the active contract and deployment, meeting the criteria for an AI Incident under violations of human rights and harm to communities. The concerns raised by experts and activists about bias and privacy infringement further support this classification.
Thumbnail Image

The FBI Is Upping Its Social Media Surveillance Program (Chethan Rao/AndroidHeadlines.com)

2022-04-07
Tech Investor News
Why's our monitor labelling this an incident or hazard?
The event involves the use of an AI system (Babel X) for social media surveillance by a government agency. Although the article does not report any realized harm, the deployment of AI surveillance tools at this scale plausibly risks violations of privacy and human rights, which fits the definition of an AI Hazard. There is no indication that harm has already occurred, so it is not an AI Incident. The article focuses on the contract and potential consequences rather than responses or updates, so it is not Complementary Information.
Thumbnail Image

The FBI boosts its social media surveillance technology

2022-04-07
Reclaim The Net
Why's our monitor labelling this an incident or hazard?
The described tool, Babel X, is an AI system used for data analytics and surveillance, involving automated scraping and analysis of social media and communication platforms. Its use by the FBI for mass surveillance directly implicates potential violations of human rights, particularly privacy rights, and possibly breaches legal protections. The event involves the use of an AI system leading to harm in the form of rights violations, thus qualifying as an AI Incident under the framework.
Thumbnail Image

FBI Support for Spyware Alarms Privacy Advocates

2022-04-06
The Crime Report
Why's our monitor labelling this an incident or hazard?
The FBI's use of Babel X involves an AI system for social media monitoring and data analysis, which could plausibly lead to violations of privacy and civil liberties. However, the article does not describe any direct or indirect harm that has already occurred due to this AI system's use. The concerns are about potential misuse or overreach, making this a plausible risk rather than a realized incident. Therefore, this event fits the definition of an AI Hazard, as it could plausibly lead to an AI Incident involving violations of rights or harm to communities if misused or inadequately regulated.
Thumbnail Image

The FBI Boosts Its Social Media Surveillance Technology

2022-04-08
Nwo Report
Why's our monitor labelling this an incident or hazard?
The event explicitly involves an AI system (Babel X) used by the FBI for extensive social media and location data surveillance. The system's development and use directly lead to potential violations of human rights, specifically privacy rights, which are protected under applicable laws. The large-scale, continuous data harvesting and surveillance capabilities indicate realized harm or at least ongoing infringement risks. Therefore, this qualifies as an AI Incident rather than a hazard or complementary information. The involvement of AI in enabling mass surveillance and data mining that impacts fundamental rights justifies this classification.
Thumbnail Image

The FBI is investing millions in social media surveillance software

2022-04-05
Input
Why's our monitor labelling this an incident or hazard?
The event involves an AI system (Babel X) explicitly described as AI-powered software used for social media surveillance and pattern analysis. The FBI's use of this system to monitor large-scale social media activity and attempt to predict 'bad actors' is a use of AI that could plausibly lead to violations of privacy and biased targeting of vulnerable groups, as noted by experts and activists cited in the article. Although no specific harm has yet been reported, the potential for such harms is credible and significant, fitting the definition of an AI Hazard. There is no indication of an actual incident of harm occurring yet, so it is not classified as an AI Incident. The article is not merely complementary information since it focuses on the potential risks and implications of the AI system's deployment rather than just updates or responses. Hence, the classification is AI Hazard.
Thumbnail Image

FBI spends millions on social media tracking software. Investigation reveals yet another Pegasus spyware hack.

2022-04-06
The CyberWire
Why's our monitor labelling this an incident or hazard?
The FBI's Babel X software is an AI system used for social media monitoring with capabilities like sentiment analysis and predictive analytics, which have directly raised concerns about privacy violations and potential wrongful targeting, indicating realized harm to individuals' rights. The Pegasus spyware hack involved AI-enabled spyware used to hack a journalist's phone, a direct violation of privacy and human rights. Both cases involve AI systems whose development and use have directly or indirectly led to harms as defined (violations of rights and harm to communities). The article also discusses potential misuse and chilling effects, reinforcing the presence of harm. Hence, the classification as AI Incident is appropriate.