AI System Designs and Synthesizes Novel Viruses, Raising Biosecurity Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Researchers at Stanford University and the Arc Institute used an AI model, Evo, to design and synthesize 16 new bacteriophage viruses that do not exist in nature. While the breakthrough could aid medical advances, experts warn of significant biosecurity risks if similar AI tools are misused to create harmful pathogens.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes an AI system trained to generate viral genomes, resulting in the creation of viable new viruses that infect bacteria. This confirms the involvement of an AI system in the development and use stages. Although the viruses do not infect humans and no harm has been reported, the article highlights the potential for such AI technology to be misused to create harmful pathogens, which is a credible and plausible future harm. The event does not describe any realized injury, rights violation, or environmental harm, so it is not an AI Incident. The main narrative is not about responses or governance measures but about the AI system's capabilities and risks, so it is not Complementary Information. Hence, the event is best classified as an AI Hazard.[AI generated]
AI principles
SafetyRobustness & digital security

Industries
Healthcare, drugs, and biotechnology

Affected stakeholders
General public

Harm types
Physical (death)Physical (injury)

Business function:
Research and development

AI system task:
Content generationReasoning with knowledge structures/planning


Articles about this incident or hazard