Value of Life: VSL Estimates vs Community Perspective Evaluations

By Joel Tan🔸 @ 2022-09-06T14:35 (+53)

Summary

The value of life, which we need to know if we are to correctly prioritize between interventions, is poorly captured by value of statistical life (VSL) estimates, and instead is better captured by community perspective evaluations.

 

Value of Statistical Life Estimates

VSL estimates may involve stated preferences of survey respondents (i.e. from asking them their willingness to pay to avert some risk) or revealed preference (e.g. looking at how much people are willing to pay for airbags in cars, or at how much they need to be compensated to work in a riskier job). Regardless, the general idea behind the VSL approach is that we have the following implicit equation:

          Compensation needed = Probability of death * Badness of death

Hence, if we elicit the compensation needed, we can then just divide by the probability of death to get the badness of death. There are numerous flaws in this approach, however:

 

Problems leading to the misestimation of the compensation needed

 

Problems leading to the misestimation of the probability of death

 

Community Perspective Evaluations

An alternative approach to estimating the value of life, which the GiveWell-commissioned IDinsight survey pioneers, is the community perspective evaluation - asking survey respondents to take the perspective of a decision-maker for their community and choose between saving more lives or doubling income. And while there are worries about social desirability bias (i.e. people overstating how much they value life relative to income, so as to not appear cold and amoral), this can potentially be corrected for by applying a discount derived from past studies of social desirability bias in value self-reporting. This allows us to arrive at potentially more accurate moral weights, and this is the approach CEARCH itself takes. (Note: CEARCH is the cause prioritization research organization I work at; we came out from the recent Charity Entrepreneurship incubation round).

That said, there are also concerns over the SDB-corrected community perspective approach:

 

Assessment

Overall, the SDB-corrected community perspective is still preferable to the VSL approach, because on balance, the flaws in both approaches point towards a likely undervaluation of life relative to income. To the extent that the SBD-corrected community perspective yields higher values than the VSL approach, the former probably gets us closer than the latter to the true, average value of life.

 

Path Forward

I'm a very big fan of the GiveWell/IDinsight's moral weights research in Kenya and Ghana, and think that this is a very promising area of meta-research, which can help us better estimate the value of life and hence better direct scarce resources (e.g. I have always thought that we undervalued life-saving charities like AMF relative to income-raising ones like SCI).

CEARCH is considering funding more research on this, and would be keen to work with any other organizations interested in this matter. All feedback (positive or negative) on the value of such additional moral weights research is, of course, welcome!


 


Dan Stein @ 2022-09-06T21:23 (+5)

Hi Joel, thanks for this write-up and for the work you're doing on this. For some context, I'm the Chief Economist at IDinsight and worked on the GW-funded study you mentioned. 

A few comments: 

  1. Thanks for this work and these thoughts! I haven't dug into the math in detail, but I'm intrigued about systematically measuring and correcting for social desirability bias. But one question: are you arguing that SDB is more likely to be an issue in the community perspective than the individual perspective? I don't really see why this would be the case- i think SDB is likely to be present in all frames. 
  2. I'm a bit confused why you think the community perspective is more reliable than the individual perspective? It seems to me that your assumption that both methods are downward biased is pretty strong, and the conclusion that the larger of the two is "right" is not apparent. 
  3. IDinsight is quite interested in doing more work in this area. We are currently pursuing a couple of opportunities, and are interested in working with funders who want to do more work on measuring preferences and integrating them into their programs. We house this work under our Dignity Initiative, since we believe that understanding and respecting preferences are a key part of upholding the dignity of the populations we serve. If CEARCH is working on funding more work in this area, we should talk. 
  4. Open Phil is considering funding a large replication/expansion of our preference work, where we would use a number of new tools to minimize the biases pointed our in your article. If this goes forward, we'll have a lot more to say about this problem in the coming years! Assuming it does, we're always looking for more ideas and would be interested in brainstorming with CEARCH to add to our pile of ideas. 

     
Joel Tan @ 2022-09-07T03:58 (+4)

Hi Dan,

Some thoughts on the points you raised:

(1) On whether social desirability bias is an issue for VSL. My understanding is that the economics literature isn't concerned about this (nor was IDinsight, per the report) - which makes sense to me, because when people are asked to pay to avert small risks, they consider it a pragmatic decision rather than an explicitly moral one where they have to decide whether or not to let someone die for more money. The issue is hence less salient from a moral point of view, and less likely to trigger worries about how one appears to others (kind and compassionate, or cold and selfish). Just think of how much less salient refusing to pay to install a lifebuoy next to a pond is, vs refusing to jump in to save a drowning child right now, even if statistically the former nets out in expected value to the latter.

(2) If we think that both VSL and the community perspective are flawed attempts at getting the true value, and that both are downward biased (per the reasons discussed), then the higher SBD-corrected community perspective is probably a lower bound. In fact, my main worry is that there is significant downward bias - given the strong and very cogent moral reasoning expressed by respondents in the qualitative side of the survey ("life is priceless", "children have economic potential"), you could easily go up by one magnitude in trade-offs (i.e. 1 life to 100,000 cash transfers to double income) and still get a significant number of people going for that.

(3) & (4)  Will definitely be interested in talking to your colleague at the Dignity Initiative, and will drop you an email to discuss your potential work in replicating your preference work! Am excited about your ideas, and would be happy to contribute any way I can.

ColdButtonIssues @ 2022-09-06T17:43 (+4)

Thanks for the clear explanation of the downside of VSL- I learned a lot!

Joel Tan @ 2022-09-07T03:38 (+2)

Glad it was useful!