Skip to content
Longterm Wiki
Back

Security challenges by AI-assisted protein design

web

Published in EMBO Reports, this paper is relevant to AI safety discussions around catastrophic biological risks and how AI capabilities in scientific domains require proactive governance before widespread misuse becomes feasible.

Metadata

Importance: 62/100journal articleanalysis

Summary

This paper examines the dual-use risks emerging from AI-powered protein design tools, analyzing how advances in computational biology could be exploited to engineer harmful biological agents. It discusses the biosecurity implications of democratized access to protein engineering capabilities and calls for governance frameworks to mitigate misuse.

Key Points

  • AI tools like AlphaFold and protein language models dramatically lower the barrier for designing novel proteins, including potentially dangerous ones.
  • The dual-use dilemma is acute: the same capabilities enabling medical breakthroughs could facilitate design of toxins or pathogen enhancements.
  • Existing biosecurity frameworks were not designed to address AI-accelerated biological design and may be insufficient.
  • The paper calls for interdisciplinary governance approaches combining biology, AI policy, and security expertise.
  • Screening and access-control mechanisms for AI protein design tools are proposed as near-term mitigation strategies.

Cited by 1 page

PageTypeQuality
Bioweapons RiskRisk91.0

Cached Content Preview

HTTP 200Fetched Apr 9, 202624 KB
Security challenges by AI-assisted protein design | EMBO Reports | Springer Nature Link 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 

 

 

 
 
 
 
 
 

 

 
 
 
 
 

 

 

 

 
 
 
 
 
 

 
 
 
 

 

 

 
 

 

 

 

 

 

 
 
 
 
 
 

 
 
 
 
 

 
 
 
 

 

 
 
 
 

 
 
 
 
 
 

 
 
 

 
 
 
 

 

 
 
 Skip to main content 

 
 
 
 
 
 Advertisement

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 EMBO Press journals have moved to Springer Nature Link. Learn more about website changes. 
 
 
 
 

 

 

 

 
 
 
 
 
 
 
 
 
 

 Security challenges by AI-assisted protein design

 The ability to design proteins in silico could pose a new threat for biosecurity and biosafety

 
 
 Science & Society

 
 
 Open access 
 

 
 

 
 Published: 26 March 2024 
 

 
 
 
 Volume 25 , pages 2168–2171, ( 2024 )
 

 
 Cite this article 
 

 

 
 
 
 You have full access to this open access article

 
 
 
 
 
 
 
 Download PDF 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Save article 
 
 
 
 
 View saved research 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 EMBO Reports 
 
 
 
 Aims and scope
 
 
 
 
 
 Submit manuscript
 
 
 
 
 
 
 
 
 

 

 
 
 
 
 
 
 
 Security challenges by AI-assisted protein design
 
 
 
 
 
 
 
 
 Download PDF 
 
 
 
 
 
 

 
 
 
 
 
 

 
 
 

 

 
 

 

 
 

 

 
 
 

 
 
 

 
 
 

 
 
 
 The COVID pandemic has, among other things, intensified the debate about biosecurity and biosafety, driven by concerns not only about naturally emerging diseases but also accidental releases of pathogens and nefarious uses of biotechnology. It has, for instance, inspired the Pathogens Project by the Bulletin of the Atomic Scientists, which published a report on alleviating biological threats posed by technical advances earlier this year ( https://thebulletin.org/pathogens-project/report-2024/?utm_source=Website&utm_medium=SitewideBanner&utm_campaign=SitwideBanner_02282023&utm_content=DisruptiveTechnologiesBio_PathogensProjectReport_02282023 ).

 One of those concerns regards the rapid progress both in protein design and synthesis, and potential nefarious uses of these technologies. This has led to a notable proposal in January 2024 for collecting and storing the underlying DNA sequence data of artificial proteins for screening purposes by David Baker and George Church, eminent researchers respectively in computational protein design and DNA synthesis (Baker and Church, 2024 ). Their concerns were especially raised by the rapid increase in power and accuracy of computational protein design resulting from incorporation of AI techniques and especially Generative AI (Gen AI).

 The real or potential threats being addressed by Baker and Church come under three headings, according to Nicole Wheeler, whose team develops computational screening tools for identifying DNA from emerging biological threats at the University of Birmingham in the UK. “The first is a potential improvement i

... (truncated, 24 KB total)
Resource ID: d265ec8357439b6b | Stable ID: MTM5YjQ1OD