How to think about cost-effectiveness when the US government is paying?
By DirectedEvolution @ 2023-06-15T02:52 (+15)
I'm just looking for some opinions here prior to writing a longer analysis - feel free to chime in with your thoughts no matter your background! I'm at least as interested in the diversity of opinion as finding the best answer.
Question:
EAs who are into global health often compare proposed interventions to GiveWell's cost per life saved via Against Malaria Foundation ($4,500/life saved).
In the USA, dialysis and kidney transplants are both funded by the US government, and they are both very expensive. Kidney transplants are typically considered less expensive overall and lead to longer, healthier lives. The bottleneck is the supply of kidneys for transplant. One possible intervention is for a nonprofit advocacy group to focus on shifting the medical establishment to view payment for kidneys as an ethical option (I have much to say on this subject, but that's for another post).
If EA managed to effect this change, would we consider the QALYs/lives saved as being effectively "free," less the cost of operating the advocacy group, since the US government is already footing the bill of this form of medical care, and the cost of transplants + paying for kidney is likely to be cheaper than the cost of dialysis?
Right now, I estimate that if there was an unlimited supply of ethically sourced vended organs, perhaps 10,000 lives could be saved per year. If a charity could accomplish this on less than $45 million/year, then that would be on par with Against Malaria Foundation. This is what's motivating me to investigate this question, but I want to know what other EAs think about how to parse the cost-effectiveness question.
Thanks for your input!
Davidmanheim @ 2023-06-15T09:54 (+25)
To start, all of this is conceptually tricky, and you should talk to an economist or policy analyst with expertise in CBA if this ends up being a crux.
That said, in cost benefit/effectiveness analysis, the perspective EA usually takes is to consider public benefit per EA dollar spent, whereas policy analysts typically consider total social benefit per total dollar spent, which is slightly different. Either way, if government forces businesses to spend money, that's a cost to society, and if government spending replaces private spending, it's not a benefit. (EA funders should consider that as well - forcing others to spend money isn't a benefit.) Overall, the total public benefit perspective makes sense, because the costs and benefit to people and companies needs to be compared to the costs to government or to the EA funder.
In the case you're discussing, the cost to government is negative, so the Benefit-to-cost ratio is negative - which happens sometimes[1]. If we spend $1m to get the government to save $5m and create a benefit of $5m, we would have total social cost-benefit ratio of -0.8. It's good to note that, and then we also probably want to do the cost-benefit analysis from the perspective of EA spending, so it can be compared to other interventions, and we would say it cost $1m to generate $10m in total public benefit.
A key caveat for actual analysis, however, is that if we shift government spending, it might not save anything! For instance, if the budget for the government spending on healthcare is set by Congress, and not impacted by costs, then "saving" $5m in transplant costs is actually just shifting that spending to a different place - which has benefits, but it's hard to estimate them, so we often just assume the benefit from marginal spending is a wash, and call it savings. This is hard to justify, but doing anything else is often infeasible.
On the other hand, if the savings are real, there is another small but often important caveat, which is that we often want to account for the overhead and deadweight costs of taxation. It's plausible[2] that every dollar the government spends costs the economy $1.20. That is, if the government were to only get $1 in benefit for doing something, it's a net loss for the country because they damage the economy via taxes more than they benefit it. If that is the case, saving $5m in government spending might actually be worth $6m - and so it cost the EA funder $1m to generate $11m in benefit. But if you do this, be really careful to note exactly what you're doing - otherwise, it can be very misleading.
- ^
There are two ways this happens, and you need to know which it is - it's either really good, or really bad. If cost is negative but benefit is positive, as in the transplant case, it's great. If cost is positive but benefit is negative, it's very bad. If both are negative, it's easily compared to other positive numbers; spending $X less causes $Y in harm is equivalent to saying that we're currently spending $X to benefit, i.e. avoid the harm of, $Y, and consdiering if we should stop.
- ^
The 20% figure isn't sourced anywhere I've seen it used, but I have seen it used and mentioned more than once as the typical value for deadweight loss for taxation.
DirectedEvolution @ 2023-06-15T17:03 (+4)
This is excellent, thank you very much for writing this all out. I really appreciate it. I'll reply with questions if they come up.
Stan Pinsent @ 2023-06-16T12:53 (+1)
Nice question!
Firstly I would challenge your assumptions in using "lives saved" as currency in your very brief final estimate. Depending on your moral basis, the lives of people in need of a kidney transplant are probably less valuable than those typically saved by malaria interventions:
- they probably gain less extra lifetime
- they are probably more likely to have health problems that diminish their quality of life
- they probably have less productivity and more healthcare costs ahead of them for the previous two reasons
Consider using DALYs instead.
I think you are right to think about considering government funding. It seems plausible that transplants would save govt money compared to dialysis. But transplant recipients also live longer (that's the point of this) and will incur healthcare costs for a longer time.
If you do come up with a figure for "costs saved" you could try to convert govt spending into DALYs or similar. Some countries' healthcare systems evaluate treatments based on the cost per QALY (in the UK publicly-funded drugs are supposed to cost less than £30,000 per QALY). If you assume that any money the system saves is invested in DALYs at the threshold rate, converting is simple. I don't think this applies in the US, where costs are split between private and public sources in a confusing way.
All of this brings me back to broad agreement with your instinct to count the health gains as "free", because it's quite complicated to do otherwise. But I would caution about complexity. Objections to the buying/selling of organs are partly based on notions of sanctity that we might see as stupid (much like the fear of GM crops that is blocking Golden Rice) but also partly on valid concerns about the hard-to-predict secondary effects of an organ trade (exploitation, decreased concern for the poor who "can always sell a kidney if they are truly struggling").
DirectedEvolution @ 2023-06-16T15:14 (+3)
Thanks for your thoughts!
I agree that more refined metrics would allow a better comparison between deaths from malaria in Africa and deaths from kidney disease in America.
A typical story for the latter is “a Black man close to retirement suddenly develops the symptoms of end-stage kidney disease and is put on dialysis. If he receives a kidney, he lives until his late 70s-early 80s in health comparable to if he hadn’t experienced kidney failure. If not, he declines and dies a few years later.” Kidney transplants typically give about 15 years of extra life but only about a handful of extra QALYs compared to dialysis IIRC, and they are cheaper per QALY.
The tricky part is that GiveWell used their own idiosyncratic in-house version of “moral weights” to evaluate their charities, which precludes comparison using QALYs. Since some people do argue that “lives saved” is an appropriate way to compare interventions and critique QALYs/DALYs as ableist, I think it’s a relevant but not conclusive comparison.
You’re right to point out the carousel of ill-thought-out moral and practical objections to kidney sales that would have to be overcome (or put on firmer epistemic footing). Note that I don’t mean that all of these objections are wrong - just that their supporters have usually put in minimal real thought or research into them and tend to use them to justify a fundamentally emotional reaction. Janet Radcliffe Richards’ book “The Ethics of Transplants” is a great resource on this point (she’s an Oxford moral philosopher and EA). Overcoming with this feeling of repugnance - less widespread than you might think - to effect policy change is the main goal of the altruistic work I would be proposing.