How meat-free meal selection varies with menu options: an exploration (edited)

By Sagar K Shah, Jacob_Peacock @ 2023-02-14T11:51 (+65)

This is a linkpost to https://rethinkpriorities.org/publications/meat-free-selection-and-menu-options

Non-technical summary

Summary

You can read the full post on the Rethink Priorities website, and also see the pre-print and code via the Open Science Framework..


Ula Zarosa @ 2023-02-16T12:30 (+3)

Hey, I wonder if there is a way to make this post, or posts like this, easier to read in the future. My friend suggested Chat GPT3, and it worked quite well, helping me understand what is written here. I wonder if maybe in future publications you can trial it out, and then do a little summary for people that don't work with scientific studies/ statistics/ whatever it is, that makes it hard to understand with a quick read. It's not a criticism, it's just a suggestion, but I think from now on I will use chat GPT3 as a helpful tool :) 

Sagar K Shah @ 2023-02-21T11:57 (+2)

Thanks for the helpful comment @Ula Zarosa .  I've now added a  shorter non-technical summary.  

Ula Zarosa @ 2023-02-21T12:00 (+2)

Looks amazing. Thank you so much! 

Jeff Kaufman @ 2023-02-14T22:00 (+3)

our reanalysis found meat-free meal selection odds were higher among menus with an extra meat-free option (odds ratio of 2.3, 90% CI [1.8 to 3.0]).

I'm not sure how to interpret the scale of this effect. To put this in context, what if we imagine people chose randomly from among the five options? Then we would expect 40% of people to choose meat-free options when it was two of five choices, and 60% when it was three of five. Did your reanalysis see a larger or smaller change than that?

Sagar K Shah @ 2023-02-15T14:03 (+5)

Thanks for the question @Jeff Kaufman .

The short answer is that our headline odds ratio (OR) on the number of meat-free meals was pretty close to one associated with your  random choice example.   But the absolute increase in meat-free meal selections arising from an extra veg option (around 12pp) was lower than in the random choice example (20pp).  That inconsistency reflects the high number of meat-free meal selections made by participants in the study even when there were only two  meat-free options.

Detail

In the random selection example you provided (meat-free selections increasing from 40% to 60%),  the OR would be 2.25:

That's just below our estimate for the OR (2.33) on the additional meat-free meal coefficient, but  well within the 90%  CI (1.81 to 2.99).

When interpreting results presented in odds ratio space, its important to bear in mind that  odds ratios don't translate linearly into pp changes - the starting odds/probability matters.   An OR of 2.25 is associated with a 20pp increase for a baseline probability of 40%, but only a 10pp increase for a baseline probability of 80%.

The last column of Table 10 in the full write-up on the RP website provides the results of a linear regression model, which is easier to interpret in probability space.  That model suggests 56% of meal selections were meat-free in a theoretical menu containing two (non-analogue) meat-free options,  and three (red) meat-based dishes.   Adding an additional (non-analogue) meat-free option would increase meat-free meal selection by 12pp (90% CI: 0.08 to 0.16).  That's quite a bit lower than the absolute increase in your random selection example (20pp).

So even though the results in odds ratio results were similar to one that might be expected under random selection, the absolute increase in number of meat-free meal selections was quite a bit lower.  That inconsistency arises because participants in the study were opting for a high number of meat-free meals even when there were only two meat-free options.

Jeff Kaufman @ 2023-02-15T14:26 (+2)

Thanks! Would interpreting this as "here was a group of people who, on average, preferred non-meat options, so giving them more non-meat options decreased how much meat they ate" be right?

Sagar K Shah @ 2023-02-15T16:02 (+3)

I don't think I would agree with that  as a general explanation of the results.... in order for us to get the results we did, you'd need some people who were selecting meat when there two veg options to select meat-free when there are three veg options.   The folks who always selected a meat-free dish (around 20% of respondents) don't drive variation in meat-free meal selection across different menu types, and so can't explain our results.  Same applies to those who always selected meat-based dishes.  Indeed the regression results on menu characteristics were identical when we excluded those respondents (see Table 10 of full-writeup).

But I think your quote above might be able to explain why the pp change in meat dishes chosen is lower than the change of menu options.  Would probably make a few changes though (completeness at the expense of brevity). 

 "When offered more non-meat menu options (20pp increase), survey respondents selected fewer meat-based dishes (12pp decrease).   Respondents, on average, selected a relatively low share of meat-based meals across the experiment.   This is one reason why the fall in the share of meat-dishes is smaller than the change in the share of menu options."

 

Jeff Kaufman @ 2023-02-15T01:36 (+2)

Maybe the odds ratio in my situation is 60%/40% = 1.5? If so, this is well below 2.3 and outside your 90% CI. That's quite a large effect!

Tristan Williams @ 2023-10-14T11:46 (+2)

One piece of context for background: what's the base rate for vegans in Germany? Or if you collected it, for the survey group?

Jacob_Peacock @ 2023-10-19T02:16 (+2)

This source suggests the rate of self-identified veganism in Germany is about 3% in 2022. (We did not do any data collection ourselves; this report is a re-analysis of existing data collected by Brachem et al.)