AI Used to Create Novel Viruses Raises Biosecurity Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers at Stanford, Harvard, MIT, and the Broad Institute used AI models Evo1 and Evo2 to design thousands of new bacteriophage virus genomes, synthesizing 16 functional viruses that effectively target E. coli. While intended for medical use, experts warn of potential misuse, highlighting significant biosecurity risks.[AI generated]

Why's our monitor labelling this an incident or hazard?

The AI system was used to develop new viral genomes, which were then synthesized and tested. Although the purpose is to combat antibiotic-resistant bacteria (a beneficial goal), the creation of novel viruses that do not exist in nature carries inherent risks of unintended consequences or misuse. No actual harm has been reported yet, so it is not an AI Incident. The plausible risk of harm from these AI-designed viruses justifies classification as an AI Hazard. The event is not Complementary Information because it reports a new development with potential risk, not a response or update to a prior incident. It is not Beneficial Use because the AI system itself is the source of potential harm, not solely a countermeasure to an external harm without introducing new risks.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
General public

Harm types
Physical (death)

Business function:
Research and development

AI system task:
Content generation


Articles about this incident or hazard