Ambitious Impact’s cost-effectiveness estimates suggest the best interventions in animal welfare are much more cost-effective than the best in global health and development?
By Vasco Grilo🔸 @ 2024-10-11T16:32 (+25)
The views expressed here are my own, not those of my employers or reviewers of the draft.
I have collected Ambitious Impact’s (AIM’s) cost-effectiveness estimates of the animal welfare and global health and development interventions they recommended for Charity Entrepreneurship’s incubation programs until 2024. AIM’s original cost-effectiveness estimates of the animal welfare interventions are optimistic because they assume a welfare range conditional on sentience of 1, so I adjusted them based on Rethink Priorities’ median welfare ranges. In addition, I assumed an increase of 100 welfare points in humans (WPs) and 1 quality-adjusted life-year (QALY) are each equivalent to averting 1 disability-adjusted life-year[1] (DALY), and aggregated the main estimates of each report using the mean.
The table below contains the mean, geometric mean, 5th percentile, median, and 95th percentile cost-effectiveness of the animal welfare and global health and development interventions. All the 5 stats suggest the interventions in animal welfare are more cost-effective than those in global health and development. In particular, in terms of the 5th percentile, which is the stat I considered arguably best proxying AIM’s marginal cost-effectiveness in each area, animal welfare is 48.7 times as cost-effective as global health and development.
Statistic | Value for animal welfare (DALY/$) | Value for global health and development (DALY/$) | Ratio between the value for animal welfare and global health and development |
Mean | 0.204 | 0.0439 | 4.64 |
Geometric mean | 0.135 | 0.0104 | 12.9 |
5th percentile | 0.0411 | 8.44*10^-4 | 48.7 |
Median | 0.189 | 0.0104 | 18.1 |
95th percentile | 0.388 | 0.194 | 2.00 |
Joey Savoie (AIM’s CEO) noted:
[AIM’s] welfare points are far less certain estimates when compared to our global health [and development] estimates. This matters a lot, e.g., I would regress weaker CEAs [cost-effectiveness analyses] by over 1 order of magnitude [making them less than 10 % as large] even from the same organization [AIM?] using similar methods, and it could be 3+ orders of magnitude across different orgs and methods. AIM in general is pretty confident e.g. that our best animal charities are not 379x better than a top GiveWell charity even if a first pass CEA might suggest that.
I understand cost-effectiveness estimates across different areas are not directly comparable, even if they are unbiased, because the methodologies differ. However, I believe the large regressions to a lower cost-effectiveness Joey mentioned only apply given a strong (low uncertainty) prior that animal welfare interventions are much less cost-effective[2]. It is unclear to me why one would have such a strong prior, as cost-effectiveness is usually thought to vary significantly across cause areas. All in all, I would still say this post provides some evidence that the best interventions in animal welfare are much more cost-effective than the best in global health and development.
Thanks to Filip Murar, Morgan Fairless and Vicky Cox for feedback on the draft[3].
- ^
- ^
Based on inverse-variance weighting, the regressed cost-effectiveness would be the mean between the prior and estimated cost-effectiveness weighted by the reciprocal of their variance. For the regression to be large, the prior cost-effectiveness has to be much lower than the estimated one, and the variance (uncertainty) of the prior cost-effectiveness much smaller than that of the estimated one.
- ^
I listed the names alphabetically.
MichaelStJules @ 2024-10-11T19:00 (+11)
Does this account for probability of sentience and welfare ranges/moral weights?
Vasco Grilo🔸 @ 2024-10-11T19:54 (+3)
Good question, Michael! Strongly upvoted. Vicky commented the cost-effectiveness estimates in WPs/$ account for the probability of sentience. However, I now realise welfare ranges conditional on sentience were apparently not considered. I will ask Vicky about this. "Cross-animal applicability" was one of the goals of the WPs' system, and I assume cost-effectiveness estimates in WPs/$ were directly compared with each other, so I believe the welfare ranges conditional on sentience should have somehow been taken into account.
Vasco Grilo🔸 @ 2024-10-14T11:08 (+2)
However, I now realise welfare ranges conditional on sentience were apparently not considered. I will ask Vicky about this.
Vicky confirmed welfare ranges conditional on sentience were not considered. So AIM's cost-effectiveness estimates in WPs/$ are not comparable across species, and I guess ones with lower welfare ranges conditional on sentience were overrated in AIM's analyses (namely, weighted factor models).
I have updated the post adjusting AIM's estimates based on Rethink Priorities’ median welfare ranges. The conclusion qualitatively remains:
In particular, in terms of the 5th percentile, which is the stat I considered arguably best proxying AIM’s marginal cost-effectiveness in each area, animal welfare is 48.7 times as cost-effective as global health and development.