We don't know how concerned experts are about engineered pandemics

By James Brobin @ 2026-08-09T17:28 (+23)

Virology is a complex field that requires years of study to enter. As such, we should not expect that we can get a good sense of how concerning engineered pandemics are based on arguments alone. Instead, we should rely on the views of experts. Problematically, though, we don't have good enough data to know what experts actually think.

As far as I know, there have been three studies asking experts about their concern about engineered pandemics, but two of them have significantly biased methodologies, and the other one has a small sample size.

In this post, I go over how I found the surveys. Then I discuss the surveys themselves and why I think they’re biased. Then, I conclude by suggesting that someone should do a large non-biased survey.

Methodology

I found these studies by looking at Google, Google Scholar, and asking Chat-GPT.

Studies

Forecasting Research Institute’s 2023 Forecasting Existential Risks

The first study is the Forecasting Research Institute’s 2023 Forecasting Existential Risks survey. This study sought out participants based on their affiliation with organizations concerned about existential risk. It selected a sample of 80 experts on existential risks, 44% of whom had “spent more than 200 hours working directly on causes related to existential risk in the previous year” and 42% of whom “had attended an EA meetup.” Of these 80 experts, 12 were “graduate students with backgrounds in synthetic biology.”

When these graduate students were asked how likely they thought a catastrophic pandemic from engineered pathogens would be by 2100, they estimated 1.15% and then later updated to .8%. When asked how likely they thought extinction from an engineered pathogen would be by 2100, they estimated .7% then later updated to 1%.

I don’t think we should base our views to any significant degree on this survey since it had a very small sample size, the experts had not completed their education, and they were selected on the basis that they were already concerned about existential risks.

Forecasting Research Institute’s 2025 “Forecasting LLM-enabled Biorisk and the Efficacy of Safeguards”

The second study is Forecasting Research Institute’s 2025 “Forecasting LLM-enabled Biorisk and the Efficacy of Safeguards,” which examined how LLMs might increase the likelihood of a human-cased pandemic. This survey brought together 46 people “with expertise in biosecurity and/or wet lab biology.” 78% of these individuals had doctoral degrees. Their sampling approach was far less biased, selecting for participants based on their experience in biosecurity. They asked 1500 experts to participate in the survey, but only 46 completed it, giving a participation rate of 3%. They mention that the low participation rate may be due to the fact that they told participants to expect the survey “to take between 5 and 15 hours

These experts put a .3% chance of a human-cased biological catastrophe in 2028.

Given the extremely low participation rate and the fact that the survey focuses on what may be a fringe concern, I think we should not update significantly on these results.

Sabra et al.’s (2026) paper “Improving governance in the age of synthetic biology, artificial intelligence, and diverging threats” by 

The third study is Sabra et al.’s (2026) paper “Improving governance in the age of synthetic biology, artificial intelligence, and diverging threats.” In this survey, 25 highly experienced biosecurity experts were requested to participate. 13 of them did. Of these, 7 considered themselves to be highly knowledgeable about synthetic biology warfare agents.

Overall, the survey found that experts place significant concern on the threat from engineered pathogens, although their concern for natural pathogens was slightly higher

I think this survey had generally good design, although, obviously the sample size was quite small. That said, it still seems like a quality enough study to conclude that there is likely some concern about engineered pathogens among biosecurity experts. 

Conclusion

Overall, I think that only the last survey had sufficiently good design to draw any significant conclusions from it.

Given this lack of quality data, I think that someone should do a survey asking a wide number of biosecurity and virology experts to see how much of a concern engineered pandemics really represent within the field. They should ensure the survey is not biased by making sure that participants are not selected for based on their concern for engineered pandemics.

This is especially important given that Coefficient Giving has given over 290 million dollars in grants for biosecurity with a special concern for engineered pandemics. If it turns out that engineered pandemics are a relatively fringe concern, that could indicate that Coefficient Giving is seriously misallocating resources.


KyleM @ 2026-08-10T17:43 (+3)

This is obviously a thing we want to know, and someone probably should poll the same virologists repeatedly over time as well.

I wouldn’t expect virologists to do an especially good job of pricing in risk from AI. AI people are better calibrated on virology than virology people are on AI. Folks at the intersection of these 2 fields are extremely sparse, so we tend to go with the AI person who’s read a little virology as our preferred podcast guests. This introduces some systemic errors in the dialogue, which could be corrected by polling virologists. Wet lab biology tends to instill a kind of humility that working with computers or theory doesn’t provide.


I’d want to poll virologists on specific line items like risk from cloud labs, gene synthesis screening, feasibility of first-timers executing key lab techniques, etc. A single “fear of pandemic” metric isn’t the right level of detail.

Charlie_Guthmann @ 2026-08-10T18:01 (+2)

Agreed, I'd really want more like a RAND policy maker/rationalist to write out some theories of how people could do bio terrorism, and then grab the individual steps and ask viroligists. subject matter experts are usually quite myopic and can't see the bigger picture. 

https://dianzhuo-wang.github.io/ fwiw this guy seems like he might have an interesting perspective. 

James Brobin @ 2026-08-10T17:55 (+1)

Yeah, I agree that it's important to get more information than merely "fear of pandemic."

If you haven't already, I'd recommend reading Abi Olvera's series on this. She argues that AI people think about virology completely differently than virology people do. From the perspective she offers, engineered pandemics seem a lot less concerning than the AI community makes them out to be.

KyleM @ 2026-08-10T18:20 (+1)

I just checked it out! I have mixed feelings about that series. I think the sentiment is probably directionally correct, but I found myself disagreeing with a lot of the claims and the framing. It reads to me like a non-expert summarizing expert views, and garbling them in the process. It didn’t seem very “AGI-pilled” either, for lack of a better term.


We don’t have many high quality takes on this stuff written out in public, which is a problem. I think the infohazard argument against this stuff is weak.

James Brobin @ 2026-08-10T18:52 (+1)

I'm glad you looked at it!

Benevolent_Rain @ 2026-08-10T03:53 (+2)

Hi! What do you think about x-risk cause prioritization showing that regardless of whether the chance of a pandemic is 0.1% or 10%, the enormous size of the future makes this worthwhile anyway, especially given tractable solutions? Asking as I think the crux for working on biosec is less about how likely something is to happen, than what might happen. I am really happy with the recent clarification on E2H, but still feel like the low protection needed is under explained, meaning I think the lowest confidence from my point of view is whether current plans builds sufficient protection. That said, I would agree with "we don't know what protection level is required, but let's start building what we can, some protection is better than none".

James Brobin @ 2026-08-10T14:31 (+3)

Three things:

  1. I don't think we should take the enormous size of the future into account because I don't think we have sufficient knowledge about the future to have any good guesses on how large humanity will become or whether it will create a world that we would approve of. As such, I would measure the value of existential risk reduction much more conservatively, such as the number of humans over the next two hundred years who wouldn't be born.
  2. I find the chance of an existential risk from biorisks to be extremely low (I.e. 10^-7). This is because I think that, for a biorisk to be an existential risk, I think that it would have to make the surface of the Earth unlivable for an extended period of time. Otherwise, a significant number of humans will survive and be able to continue civilization. I find this unlikely to occur because, even if this is technically possible, it would be extraordinarily difficult. (That said, I haven't looked into mirror bacteria.)
  3. Even among people who are worried about engineered pandemics, virtually none of the are worried about existential risk. As such, if we're basing our view on other people's view, and (1) very few experts are concerned about engineered pandemics (2) very few of those experts are worried about existential risk (3) we have the prior that we should significantly discount fringe views because they're almost always wrong, then we can reasonably get to quite a low risk of engineered pandemics.

I definitely agree with the idea of doing a bit of a numbers game though. If the numbers suggest we should be really focused on biorisks over other concerns, I think it makes sense to allocate a lot of resources towards it.

Charlie_Guthmann @ 2026-08-10T17:35 (+4)

Re point 2, 

https://forum.effectivealtruism.org/posts/CxMusuX8E5hiTXEWX/fruit-picking-as-an-existential-risk

https://forum.effectivealtruism.org/posts/Nc9fCzjBKYDaDJGiX/what-is-the-likelihood-that-civilizational-collapse-would-1

you might want to read these, the short is that it's not obvious that if we collapse the modern economy that we can actually get back to interstellar, because we will have way less non renewables (phosphorus, oil/coal) at our disposal next time (don't totally agree, but worth considering). 

Point 1, strong agree esp w/ we don't know if per human (or human descendant) ev is positive or negative (relative to counterfactual, which could be nothing or aliens), wish this was more mainstream dogma here, not sure why longtermists think they can just not engage with this. 

Point 3, again I'll re route to my response to point 2. Covid (the virus) wasn't even that bad in a sense and it was still catastrophic (for how much it affected society). Imagine something slightly worse than covid + a record heat wave that causes a massive refugee crisis or + a war. I'm not so confident this wouldn't massively collapse the global economy, and then route back to the fruit picking, we might only get 1-3 tries to go interstellar, so collapsing the global economy prob not == death but would == reduced chance of becoming grabby, which is ~= death from POV of total utilitarian. 
 

Benevolent_Rain @ 2026-08-11T03:12 (+2)

1 - I think it is good to be sceptical about this. I guess you've read about Pascal's mugging and other related topics. I am happy you keep this debate alive as it's not really settled.

2 - Yeah look at mirror bacteria, which is just one example of engineered, environment-to-human threats (air turning toxic)

3 - I think this is a useful intuition, but it also has limits. That said, there are step changes in history, such as powered flight invented only after thousands of years of longing and attempts by humans. This is about step changes in technology. If you believe DNA is the code of life, it is not a large leap to believe we can create really bad stuff. And it has happened before, like the great oxygenation event that ~killed all previous biological life on earth.

But basically, please be skeptical - it is super healthy!

James Brobin @ 2026-08-11T17:07 (+1)

Ah, thank you!