Longterm cost-effectiveness of Founders Pledge's Climate Change Fund

By Vasco Grilo @ 2022-09-14T15:11 (+35)

Summary

ResultMean
Existential risk due to climate change (bp)1.00
Cumulative GHG emissions between 2020 and 2100 (Tt)3.76
Existential risk reduction caused by removing GHG emissions (bp/Tt)0.273
Cost-effectiveness of removing GHG emissions via CCF (t/$)2.34 k
Cost-effectiveness of CCF (bp/G$)0.640
Cost-effectiveness bar for reducing existentiat risk (bp/G$)2.17
Cost-effectiveness bar for removing GHG emissions (t/$)7.94 k

Acknowledgements

Thanks to Alexey Turchin, Anonymous Person, David Denkenberger, Johannes Ackva, Luke Kemp, and Nuño Sempere.

Introduction

Removing greenhouse gas (GHG) emissions decreases heat-related deaths: Bressler 2021 estimated the 2020 mortality cost of carbon to be 2.26*10^-4 life/t. However, most of the benefits of reducing GHG emissions respect the decrease in existential risk due to climate change. 

This analysis estimates the existential risk reduction caused by removing GHG emissions, and the cost-effectiveness of CCF, which is compared with an estimate for the cost-effectiveness bar for reducing existential risk. Nonetheless, it should be noted that, according to this comment from Johannes Ackva[2]:

The goal of the Climate [Change] Fund is to optimize spending that is not cause-neutral, to have as big as possible a positive impact given constraints, it is not intended or marketed as "the top bet on reducing existential risk" and we are careful to not crowd in resources that would otherwise go to areas we think of as higher marginal priority.

I encourage the readers to check this comment from Matt Lerner, FP's research director, to better understand FP's mission:

To be absolutely clear, FP's goal is to do the maximum possible amount of good, and to do so in a cause-neutral way.

Methodology

The (marginal) cost-effectiveness of CCF was estimated from the product between:

The assumption of current climate policies regarding the cumulative GHG emissions is consistent with the current Metaculus' cummunity prediction of 2.6 ºC for how much greater (in ˚C) will the average global temperature in 2100 be than the average global temperature in 1880. According to the Climate Action Tracker (CAT), current climate policies are predicted to result in a global warming between 2.5 ºC and 2.9 ºC (interval which contains 2.6 ºC). The modelling of the cumulative GHG emissions would ideally consider more scenarios. The exclusion of the emissions after 2100 until net zero, after which the existential risk due to climate change is arguably negligible, tends to overestimate the cost-effectiveness.

Existential risk due to climate change

The existential risk due to climate change was modelled as a beta distribution with:

This led to parameters alpha and beta having values of 1.73 and 17.3 k[6]

The distribution defined here should not be considered resilient. As discussed in Kemp 2022, bad-to-worst-case scenarios of climate change are underexplored.

Cumulative GHG emissions between 2020 and 2100

The cumulative GHG emissions between 2020 and 2100 assuming current climate policies were modelled as a lognormal distribution with 25th and 75th percentiles equal to 3.333 Tt and 4.136 Tt, which are the lower and upper estimates of CAT. This led to values in Tt for the mean and standard deviation of 3.73 and 0.595.

Cost to remove GHG emissions via CCF

The cost to remove GHG emissions via CCF was modelled as a lognormal distribution with 2.5th and 97.5th percentiles equal to the lower and upper bound of the 95 % confidence interval provided by Johannes Ackva (via personal communation): in $/t, 10^-4 to 10. These should be intended as informed guesses, not resilient estimates. FP is working to produce a more robust cost-effectiveness distribution.

The guesses were assumed to account for the value of removing emissions as a function of global warming. For example, assuming existential risk due to climate change increases quadratically with global warming, and that this increases linearly with cumulative emissions, removing 1 t at 4 ºC of global warming would be twice as valuable as removing 1 t at 2 ºC of global warming.

Results

The results are presented below for a Monte Carlo simulation with 10 M samples. I encourage the readers to make a copy of the Colab model, and select their preferred parameters. The model is fully commented (the inputs section is at the top), and could be run in 6 s for 10 M samples.

ResultMeanStandard deviation5th percentileMedian95th percentile
Existential risk due to climate change (bp)1.000.7600.1460.8152.48
Cumulative GHG emissions between 2020 and 2100 (Tt)3.760.6062.853.714.83
Existential risk reduction caused by removing GHG emissions (bp/Tt)0.2730.2150.03870.2190.691
Cost-effectiveness of removing GHG emissions via CCF (t/$)2.34 k90.0 k0.25231.63.97 k
Cost-effectiveness of CCF (bp/G$)0.64034.339.1 6.26 m0.953

Discussion

The mean cost-effectiveness of removing GHG emissions via CCF of 2.34 kt/$ appears to be an overestimate:

However, the estimated mean cost-effectiveness of CCF is still smaller than most of the cost-effectiveness bars for reducing existential risk. These are summarised in the table below, and were taken from the answers to this question from Linchuan Zhang[9], or provided via personal message[10].

AnswerCost-effectiveness bar (bp/G$)
Open Philanthropy (OP)0.05[11]
Anonymous Person1[12]
Oliver Habryka1
Linchuan Zhang3.33[13]
Simon Skade6
William Kiely10
Median2.17

The mean cost-effectiveness of CCF of 0.6 bp/G$ only exceeds OP's conservative (lower) bar. The median cost-effectiveness bar of 2.17 bp/G$ is equivalent to 7.94 kt/$ (= 2.17/0.273), which is 3 times (= 2.17/0.640) as high as the estimated cost-effectiveness of CCF, and 8 k times as high as 1 t/$. 

Assuming interventions funded by CCF are amongst the best opportunities to remove GHG emissions, the above suggests interventions to fight climate change are not amongst the most effective ways of reducing existential risk.

In addition, it should be noted there seem to be opportunities whose cost-effectiveness is above the bar of 2 bp/G$. Denkenberger 2021 and Denkerberger 2022 estimate the following 5th and 95th percentiles[14] (in bp/G$):

This conclusion would hardly change due to including effects of removing GHG emissions which do not lead to trajectory changes. For example, the direct benefits of reducing existential risk due to climate change which result from removing GHG emissions may well be over 100 k times as large as those from decreasing temperature-related mortality between 2020 and 2100, supposing:

  1. ^

    bp stands for basis point (0.01 pp), t for tonne of CO2e, k for thousand, G for billion, and T for trillion.

  2. ^

    Johannes leads FP's climate team, and is the first author of FP's latest climate report.

  3. ^

    In other words, the more GHG emissions are required to reach a given level of global warming, the smaller is their longterm impact.

  4. ^

    In the climate change problem profile from 80,000 Hours, Benjamin Hilton writes:

    That said, we [80,000 Hours] still think this risk is relatively low. If climate change poses something like a 1 in 1,000,000 risk of extinction by itself, our guess is that its contribution to other existential risks is at most a few orders of magnitude higher — so something like 1 in 10,000.

  5. ^

    John Halstead writes:

    With those caveats in my mind, my best guess estimate is that the indirect risk of existential catastrophe due to climate change is on the order of 1 in 100,000, and I struggle to get the risk above 1 in 1,000. Working directly on US-China, US-Russia, India-China, or India-Pakistan relations seems like a better way to reduce the risk of Great Power War than working on climate change.

  6. ^

    Based on the formulas for the mean () and mode () provided in Wikipedia, the parameters of the beta distribution are: .

  7. ^

    The cost-effectiveness estimates were calculated from the reciprocal of the point estimates or the geometric mean of the lower and upper bounds of the values in $/t presented in Gillingham 2018.

  8. ^

    CATF has received two grants from the CCF (see table here): 850 k$ in December 2020; and 2 M$ in November 2021.

  9. ^

    The estimates of Kirsten Horton and Nuño Sempere were not included, as they were seemingly supposed to be underestimates of their cost-effectiveness bars.

  10. ^

    Anonymous Person's estimate was the only provided via personal message.

  11. ^

    This refers to OP's longtermist projects, and is based on the estimate of "$200 trillion per world saved" provided by Ajeya Cotra in this section of episode 90 of The 80,000 Hours Podcast. It concerns "meta R&D to make responses to new pathogens faster", and "[Open Philanthropy] were aiming for this to be conservative", meaning the actual cost-effectiveness bar is higher.

  12. ^

    Geometric mean between the lower and upper bound provided. "I currently think it's probably somewhere between $1-100 trillion per existential catastrophe averted (I find this framing more intuitive than bp/G$)".

  13. ^

    This is the median cost-effectiveness bar provided by Linchuan. According to "[Linchuan's] very fragile thoughts as of 2021/11/27": "I feel pretty bullish and comfortable saying that we should fund interventions that we have resilient estimates of reducing x-risk ~0.01% at a cost of ~$100M" (10 bp/G$); "I think for time-sensitive grants of an otherwise similar nature, I'd also lean optimistic about grants costing ~$300M/0.01% of xrisk, but if it's not time-sensitive I'd like to see more estimates and research done first" (3.33 bp/G$); "for work where we currently estimate ~$1B/0.01% of xrisk, I'd weakly lean against funding them right now, but think research and seed funding into those interventions is warranted" (1 bp/G$).

  14. ^

    The quantiles are expressed in 1/$ in the articles, but in bp/G$ here. However, for loss of industry preparation and resilent foods, they do not apply (as accurately) to investments of 1 G$, as they were computed for investments between 30 M$ and 100 M$.


jackva @ 2022-09-14T17:07 (+28)

Thanks for this, Vasco!

I won't have time to dig into the details here, but wanted to clarify one thing on the top level conclusion which is that: 

(1) I agree that climate interventions are not the top intervention to reduce existential risk on the margin (I am also on the record saying that in the GWWC Climate write-up).

(2) Whenever I am asked about allocation of marginal resources (people or funding) between climate and longtermist priority areas, I tend to nudge people away from climate. 

The goal of the Climate Fund is to optimize spending that is not cause-neutral, to have as big as possible a positive impact given constraints, it is not intended or marketed as "the top bet on reducing existential risk" and we are careful to not crowd in resources that would otherwise go to areas we think of as higher marginal priority. 

Vasco Grilo @ 2022-09-14T18:18 (+3)

Thanks for clarifying, Johannes!

PS: I tried to convey that in the Introduction by saying that "mitigating existential risk as cost-effectively as possible does not correspond to FP's mission[2]".

PPS: I have now edited the Introduction to point to your and Matt' comments, and thus better describe FP's goals. I no longer mention that "mitigating existential risk as cost-effectively as possible does not correspond to FP's mission".

Matt_Lerner @ 2022-09-14T22:00 (+31)

(I am research director at FP)

Thanks for all of your work on this analysis, Vasco. We appreciate your thoroughness and your willingness to engage with us beforehand. The work is obviously methodologically sound and, as Johannes indicated, we generally agree that climate is not among the top bets for reducing existential risk.

I think that "mitigating existential risk as cost-effectively as possible" is entailed by the goal of doing as much good as possible in the world, which is why FP exists. To be absolutely clear, FP's goal is to do the maximum possible amount of good, and to do so in a cause-neutral way.

A common misconception about our research agenda is that it is driven by the interests of our members. This is most assuredly not the case. To some degree, member-driven research was a component of previous iterations of the research team, and our movement away from this is indeed a relatively recent change. There remain some exceptions, but as a general rule we do not devote research resources to any cause area or charity investigation unless we have a good reason to suspect it might be genuinely valuable from a strictly cause-neutral standpoint.

Still, FP does operate under some constraints, one of which is that many of our 1700 members are not cause-neutral. This is by design. We facilitate our members' charitable giving to all (legal and feasible) grantees in hopes that we can influence some portion of this money toward highly effective ends. This works. Since our members are often not EAs, such giving is strictly counterfactual: in the absence of FP's recommendations, it simply would not have been given to effective charities. 

Climate plays two roles in a portfolio that is constrained in this way. First, it introduces members who are not cause-neutral to our way of thinking about problems and solutions, which builds credibility and opens the door to further education on cause areas that might not immediately resonate with them (e.g. AI risk). This also works. Second, it reallocates non-cause-neutral funds to the most effective opportunities within a cause area in which the vast majority of philanthropic funds are, unfortunately, misspent. As I have tried to work out in my Shortform, this reallocation can be cost-effective under certain conditions even within otherwise unpromising cause areas (of which climate is not one).

Finally, I do want to emphasize that the Climate Fund does not serve a strictly instrumental role. We genuinely think that the climate grants we make and recommend are a comparatively cost-effective way to improve the value of the long-term future, though not the most cost-effective way. I don't see any particular tension in that: every EA charity evaluator (or grantmaker) recommends (or grants to) options across a wide range of cost-effectiveness. From our perspective, the Climate Fund is better than most things, but not as good as the best things.

Vasco Grilo @ 2022-09-15T08:48 (+3)

Thanks, Matt! I think the above is a very valuable explanation of FP's mission, and have edited the last 2 paragraphs of the Introduction to point to your and Johannes' comments.

Denkenberger @ 2022-09-18T03:27 (+3)

This is fantastic to finally have a cost-effectiveness model for the long-term future for climate change!

This conclusion would hardly change due to including effects of removing GHG emissions which do not lead to trajectory changes.

I do think that trajectory changes such as making it more likely that worse values end up in AI, perhaps caused by an abrupt climate change catastrophe triggering a cascade, could be a significant multiplier for cost-effectiveness. I don't think you clarified whether when you say tonnes of carbon whether you actually mean carbon (which academia typically uses), or CO2 (which industry/popular typically uses). I think it makes sense that you do cost-effectiveness, e.g. of CCF as (2 kt/$), because of issues dealing with uncertainty. But I think it's worth pointing out that this cost-effectiveness is around five orders of magnitude higher than typical climate actions, such as subsidizing renewable energy or electric vehicles (~$100/tC). For the cost-effectiveness bar (bp/G$) estimates, it seems to me that the people were answering a different question than Open Phil, where the former were referring to the bar now, and the latter was referring to the last dollar. I think the last dollar of Open Phil is more appropriate (especially because the last dollar of EA would be significantly lower cost effectiveness than this), and would allow climate change to be about two orders of magnitude less cost-effective and still meet the bar.

In addition, it should be noted there seem to be opportunities whose cost-effectiveness is above the bar of 2 bp/G$. Denkenberger 2021 and Denkerberger 2022 estimate the following 5th and 95th percentiles[14] (in bp/G$):

To be clear, these resilience cost-effectiveness estimates include not just the amelioration of climate catastrophes, but also nuclear and others (and they include trajectory changes).

Vasco Grilo @ 2022-09-18T10:01 (+1)

Thanks, David!

I don't think you clarified whether when you say tonnes of carbon whether you actually mean carbon (which academia typically uses), or CO2 (which industry/popular typically uses).

I meant tonnes of GHG, namely CO2e. I have now clarified this in the 1st footnote.

But I think it's worth pointing out that this cost-effectiveness is around five orders of magnitude higher than typical climate actions, such as subsidizing renewable energy or electric vehicles (~$100/tC).

I agree. The 1st bullet point of the Discussion now addresses this.

I think the last dollar of Open Phil is more appropriate (especially because the last dollar of EA would be significantly lower cost effectiveness than this), and would allow climate change to be about two orders of magnitude less cost-effective and still meet the bar.

I think the cost-effectiveness of the last dollar of OP's longtermist projects is similar to that of the last dollar of other organisations in the EA space funding longtermist projects, because I believe the money of OP and such organisations is fungible to a reasonable extent. I would say OP's estimate of 0.05 bp/G$ is lower than the others mostly because it is an underestimate.

Denkenberger @ 2022-09-18T16:32 (+3)

In that EA forum post in a comment, Linch says:

I'm asking to get a sense of what the current margin of funding looks like, as a way to help researchers and others prioritize our efforts. 

So I don't think they were answering for last dollar. I believe Open Phil said that it is willing to fund anything that meets its last dollar bar now, but their current bar could be higher now. I guess you could argue that there is uncertainty in what the last dollar bar will be, so we should stay at the current bar for the foreseeable future. However, if something is urgent, that is we could miss out on the X-risk reduction if we don't do it in the next few years, I think that we should be using the last bar for current decisions. The case of climate change is complicated because the impacts are mostly a century or so in the future, but you could argue that there are opportunities to decarbonize now that will be gone in the future because that carbon will already be emitted. I think the case is clearer for resilience to catastrophes that could happen in the next few years, such as nuclear war, that they are urgent. Another way to think about it is if you would eventually fund these things because they are above the last dollar bar, you get a better benefit to cost ratio by doing it now because you have more overall X-risk reduction (assuming the interventions are long lived).

Vasco Grilo @ 2023-06-29T06:17 (+2)

Here is a simple point estimate illustrating how one could get the cost-effectiveness of decreasing GHG emissions from a longtermist perspective: "cost-effectiveness of decreasing GHG (1 kt/$)"*"increase in the value of the future if all risk from climate change was eliminated (0.1 bp)"/"reduction in GHG emissions to eliminate roughly all risk from climate change (4 Tt)" = 0.025 bp/G$, which would be half of OP's conservative bar.

Vasco Grilo @ 2023-06-29T06:09 (+2)

I now think more global warming might be good to mitigate the food shocks caused by abrupt sunlight reduction scenarios.