A Rising Tide Threatens Barriers to Bioweapons

By Axby @ 2023-05-14T14:49 (+23)

Reading guide: Skip the bullet points to skim through

Aim

This article aims to synthesize various sources to inform an “inside view” on how likely is it that an individual, group, or country would be able to successfully start a pandemic given current and emerging technologies. 

Through this post, I hope to inform EAs' personal assessments of whether existing measures to prevent bioweapon development and use are sufficient, but leave open the question of whether existing measures to detect and respond to the outbreak would effectively limit casualties from such a scenario. 

The purpose of this piece is not to advance scientific knowledge, or advocate for certain policies. Instead, it is meant to empower non-technical EAs with a more empirically grounded sense of how important and urgent biosecurity is, in light of emerging technologies. I hope this post also contributes to discussions on how to consider and weigh various interventions, and serve as an entry-point for further research. The information here can also be used in conjunction with “outside view” priors to develop numerical estimates.  

I caveat that this is the perspective of someone who has zero technical expertise in biology, but I have tried to rely on credible secondary sources and sought out more experienced individuals, in forming my opinions that follow. 

Overall Assessment (epistemic status in italics)

While states generally seem unwilling to use bioweapons to inflict the maximum number of casualties possible, there are likely to be a few terrorist groups/individuals who would intend to do so if they possess the required capabilities. It is quite concerning that the barriers to starting a pandemic by weaponizing existing viruses already seem quite surmountable today for state or state-sponsored actors, and insider lone-wolf scientists who turn to terrorism (low ; why has there been no attempts to do so yet since the 2010s?).

At present, the barriers to engineering a pathogen with increased contagiousness, deadliness or antiviral immunity still seem quite insurmountable unless the bioweapons programme is a multi-year state-led/state-sponsored one (medium).

However, the publication of gain-of-function research, development of high-throughput automation of testing processes, and progress in understanding of genotype-phenotype relationships, could lower the barriers for engineering pandemics quite significantly in the coming years. Without appropriate regulatory intervention, these three scientific-technological developments are likely to continue to advance rapidly. 

Intention of State Actors

States seem somewhat unwilling to use bioweapons, especially contagious pathogens, on a large-scale. (I note that this section is currently underdeveloped and will incorporate additional research in due course)

Intention of Non-State Actors

There are very likely to be at least some terrorist groups or individuals that intend to use bioweapons for catastrophic outcomes.

Capability of State and Non-State Actors

Since the Cold War, state actors were already able to weaponize natural pathogens (though they found engineering pathogens challenging). 

Historically, Non-State Actors lacked capabilities to use bioweapons for mass destruction. 

Current Barriers and Affordances of Emerging Technologies (incl. Synthetic Biology) - as of 2018[2] 

The following section further examines the barriers to bioweapons within each stage of the pathogen synthesis process, and the (potential) affordances of synthetic biology which could enable malicious actors to surmount these barriers. The aim is to assess the level of expertise required to clear each stage, and whether synthetic biology would lower the barriers sufficiently for amateurs to do weaponize pathogens.

The main biotechnologies of concern in the near future (over the course of the next decade or so) are projected to be oligonucleotide synthesis, DNA assembly (assembling multiple smaller fragments of oligonucleotides into the desired larger sequence), and genetic modification (editing, deleting, and inserting desired sequences into targeted sites of a genome).[8]

DISCLAIMER: In view of the information hazards involved, readers are strongly discouraged from speculating publicly about novel ways to cause harm with biology, be it in the comments below or in your own threat assessments. Therefore, even as I recognize that convergent technologies could contribute significantly to the biosecurity risks, I have deliberately redacted several points on how various non-biological technologies (e.g. AI) might be used to circumvent barriers at each of these stages.

Design & testing

Design and testing is not required if the malicious actor intends to use one of the known pathogens. Engineering known viruses to become more contagious, deadly or immune to antivirals remains extremely challenging, essentially requiring a great deal of trial-and-error by experts. However, scientific and technological advances in the near future could make this more accessible to less sophisticated actors.

Production

Small-scale production and delivery could be sufficient for spreading contagious pathogens. The barriers seem high enough to prevent amateurs working from home from producing known pathogens even at a small scale, but graduate-level individuals may have sufficient expertise and equipment to do so.

Stability and Delivery

Since infectious pathogens could be delivered at small scales, much of the challenges of stability and delivery that have held back Aum Shinrikyo’s bioweapons programme may not apply if contagious pathogens were used.

Conclusion 

If my assessment is correct, it is quite concerning that at present there are likely to be States, Insider Lone Scientists and State-Sponsored terrorist groups/individuals that have both the capabilities and intention the capabilities to successfully start a pandemic with known pathogens.[6] The main barriers for non-state-sponsored/ supported actors seem to only be: access to university-level lab equipment while being able to do such work undetected, and the screening by gene synthesis companies. The lack of appropriate screening regulations, publication of new pandemic-capable viruses online, and the availability of tabletop DNA synthesis machines could therefore pose significant risks. While non-engineered pathogens are quite unlikely to pose an existential risk for humanity, they could still have potentially catastrophic impacts amounting to tens of millions of lives, and much more suffering e.g. COVID-19, Spanish Flu.

What might be even more concerning in the near future are pandemics engineered with increased virulence, transmissibility, antiviral immunity and environmental stability. At present, the barriers to engineering a pathogen still seem quite insurmountable unless the bioweapons programme is a multi-year state-led/state-sponsored one. Only state actors would probably be able to do so reliably at present, and there are significant barriers deterring state actors who wish to remain in the international system from deploying such weapons. I would revise this likelihood upwards if Russia is further excluded from the international system.

However, developments in understanding of genotype-phenotype relationships through gain-of-function research and development of high-throughput automation of testing processes, could lower the barriers for engineering pandemics quite significantly in the coming years. Without regulatory intervention, these scientific and technological developments are likely to continue to advance rapidly. Designing and synthesizing a novel virus from scratch is currently (as of 2018) not very feasible. However, the outcomes can potentially be much more catastrophic than the weaponization of existing viruses (perhaps just as catastrophic as modifying existing viruses).


Acknowledgements

I deeply appreciate the comments and patient guidance from Chris Bakerlee, Tessa Alexanian and Ryan Teo, especially regarding the potential info hazards of this piece. All mistakes and ultimate decision on the risk-benefit tradeoffs are my own.

 

Annex - Assessment of Info Hazards

Potency of Information: Depends on factors such as how many people the information may affect, how intensely each affected person would be affected, how long the effects would last, and so on.

Assessment: 

Counterfactual rarity: refers to the number of people who are likely to have already developed or learned this information (or similar information), or to develop or learn this information soon anyway.

Assessment: 

 

References

  1. ^
  2. ^

    National Academies of Sciences, Engineering, and Medicine 2018. Biodefense in the Age of Synthetic Biology. Washington, DC: The National Academies Press. https://doi.org/10.17226/24890.

  3. ^
  4. ^

    Richard Danzig, Marc Sageman, Terrance Leighton, Lloyd Hough, Hidemi Yuki, Rui Kotani and Zachary M. Hosford (2011). Aum Shinrikyo: Insights Into How Terrorists Develop Biological and Chemical Weapons. Center for a New American Security. 

  5. ^

    Zachary Kallenborn and Philipp C. Bleek, “Avatars of the Earth: Radical Environmentalism and Chemical, Biological, Radiological, and Nuclear (CBRN) Weapons,” Studies in Conflict & Terrorism 43:5 (2020): pp. 351381; Gary Ackerman, “Beyond Arson? A Threat Assessment of the Earth Liberation Front,” Terrorism and Political Violence 15:4 (2004): pp. 143170.

  6. ^

    Gary A. Ackerman, Zachery Kallenborn, and Philipp C. Bleek, 2022. Going Viral? Implications of COVID-19 for Bioterrorism. CTCSentinel Special Issue: The Biological Threat - Part Two. 

  7. ^

    Sonia Ben Ouagrham, 2014. Barriers to Bioweapons. Cornell Press. 

  8. ^

    Trump, B.D., Florin, MV., Perkins, E., Linkov, I. (2021). Biosecurity for Synthetic Biology and Emerging Biotechnologies: Critical Challenges for Governance. In: Trump, B.D., Florin, MV., Perkins, E., Linkov, I. (eds) Emerging Threats of Synthetic Biology and Biotechnology. NATO Science for Peace and Security Series C: Environmental Security. Springer, Dordrecht. https://doi.org/10.1007/978-94-024-2086-9_1

  9. ^

    Linster M, van Boheemen S, de Graaf M, Schrauwen EJA, Lexmond P, Mänz B, Bestebroer TM, Baumann J, van Riel D, Rimmelzwaan GF, Osterhaus ADME, Matrosovich M, Fouchier RAM, Herfst S. (2014). Identification, characterization, and natural selection of mutations driving airborne transmission of A/H5N1 virus. 157(2):329-339. 

  10. ^

    Justine Calma, “AI Suggested 40,000 new possible chemical Weapons in just Six Hours,” Verge, March 17, 2022.

  11. ^
  12. ^

    Tumpey TM, Basler CF, Aguilar PV, Zeng H, Solórzano A, Swayne DE, et al. Characterization of the reconstructed 1918 Spanish influenza pandemic virus. Science (2005) 310:77–80. doi:10.1126/science.1119392; Noyce et al. 2018

  13. ^
  14. ^