Corporate campaigns affect 9 to 120 years of chicken life per dollar spent

By saulius @ 2019-07-08T08:01 (+176)

Summary

In this article, I estimate how many chickens will be affected by corporate cage-free[1] and broiler welfare[2] commitments won by all charities, in all countries, during all the years between 2005 and the end of 2018. According to my estimate, for every dollar spent, 9 to 120 years of chicken life will be affected.

The estimate is summarized in the table below.[3] In the table, everything is expressed in my subjective 90% confidence intervals. Numbers in parentheses are means. M stands for million, and B stands for billion. The full estimation can be seen in the Guesstimate model. Numbers in the table may not add up because of the way Guesstimate works.

Table1

In addition to direct costs on corporate campaigns, the cost estimate includes the costs of undercover investigations about the living conditions of chickens, relevant research, and all administrative expenses associated with these activities. It doesn’t include the costs of legislative campaigns and future costs of ensuring compliance to commitments that are already made. Consequently, predictions of follow-through rates assume that the spending on ensuring compliance will not be substantial.

There are many ways this cost-effectiveness could be misleading. For example:

In the first appendix, I show that even under very pessimistic assumptions, fighting for welfare reforms has affected more than one chicken-year per dollar spent

In the second appendix, I discuss how the involvement of volunteers slightly skews this cost-effectiveness estimate. In short, volunteer time is a cost that is not accounted for.

In the third appendix, I review previous cost-effectiveness estimates of corporate campaigns by Capriati (2018), Bollard (2016), Dickens (2016), and Animal Charity Evaluators.

In the fourth appendix, I explain why I chose to estimate the cost-effectiveness of campaigns in all countries, during all the years between 2005 and the end of 2018, rather than focusing on a specific charity or year. In short, all efforts are interrelated. Efforts in one year can lead to victories in later years, and a single commitment can be influenced by multiple charities working in multiple countries.

This article is a project of Rethink Priorities. It contains a lot of details but I tried to make it easy to skim. The section I recommend reading the most is Ways this estimate could be misleading.

The number of chickens that should be affected

According to unpublished estimates by Lewis Bollard from the Open Philanthropy Project (OpenPhil), commitments that were made before the end of 2018 should affect at least:

He arrived at these figures by estimating numbers of animals used by many of the companies that made commitments. Estimates are very approximate because in most cases the number of animals used by a company was unavailable.[5] Also, many commitments were not included in the estimates, which suggest that the total number of animals who should be affected is higher. Bollard’s estimates include:

Total numbers of commitments here are taken from Chicken Watch. Note that some commitments can be very small (e.g., a single restaurant or a hotel). Most of the bigger commitments are included.

Based on this information, Bollard also gave his subjective 90% confidence intervals of numbers of animals used every year by companies that made commitments:

Complications with the estimate of the number of broilers

In some cases, the number of broilers affected by commitments was calculated by dividing the weight of chicken meat used by companies by the average meat weight per chicken (~2 kg). However, this might underestimate the number of chickens affected if a committed company uses only a part of a chicken (e.g., only wings).[6] In those cases, we might want to divide the weight of chicken meat used by the restaurant by the average weight of chicken wings, rather than the weight of all edible chicken parts. This would result in a higher estimate of broilers affected. On the other hand, this might cause an overlap between different commitments. Same higher welfare broilers might be used to supply two companies that use different body parts. Nevertheless, because of this consideration, I increase the upper bound of U.S. broilers that should be affected by broiler commitments every year from 800 million to 1.1 billion. That means that the 90% confidence interval is 200 million to 1.1 billion broilers.

Broiler commitments in other countries

In this section, I estimate that 90–240 million broilers should be affected by commitments outside of the U.S.

According to Chicken Watch, there were 17 broiler commitments in Europe made before the end of 2018. Ten of these commitments are by restaurants with about 1,000 locations combined,[7] most of which are in the U.K. The restaurant with the most locations (360 to 410) is Pret A Manger which seems somewhat similar to Panera Bread. Panera Bread has 2,129 locations and (according to CIWF) uses about 17 million chickens annually. It can be extrapolated that Pret A Manger commitment covers about 3 million broilers. Other bigger restaurant commitments are from Italian restaurants. Overall, I think that 5 to 17 million broilers are affected by these restaurants' commitments.

Other non-U.S. and non-Canada broiler commitments are:

The estimates I mentioned add up to 95–141 million. However, this doesn’t include Dr. Oetker and Danone commitments, and there is additional uncertainty about the exact number of chickens covered by some other commitments. Also, I did not estimate the size of commitments in Canada.

With all this information in mind, my subjective 90% confidence interval for the number of broilers used by companies that made broiler commitments in countries other than the U.S. is 90–240 million. This takes into account the complications that are explained in the previous section. Note that I skipped the 2 Sisters Food Group commitment because it was made by a producer. I discuss it in the Follow-through rate section.

Hens that would have been cage free without intervention

I estimated how many hens are used to produce eggs that companies that made commitments use. However, some of those companies (especially grocers) used some cage-free eggs before any campaigns happened. In this section, I estimate that 79–180 million hens that are covered by commitments would have been cage-free even if no cage-free campaigns or undercover investigations about hen conditions happened since 2005. This reduces the number of hens that should be affected by commitments to 240–390 million.

U.S.

Work by HSUS and other animal advocates has led to California and Washington state banning the sale and production of eggs from caged hens. Furthermore, Massachusetts passed a law that bans battery cages and establishes space requirements that make cage-free systems more appealing to producers. Finally, Oregon has very recently passed a bill banning the sale and production eggs from caged hens, although it only applies to egg producers with more than 3,000 hens. Even though corporate campaigns might have made passing these laws easier, I will exclude hens that are used to lay eggs that are consumed in these states from the estimation.

According to King (2019), in 2018, California’s population consumed 11.4 billion eggs — equivalent to the production of 39 million layers, which is about 12% of the U.S. commercial laying hen flock. Washington state, Massachusetts and Oregon have a combined population of about 18.6 million, which is about 5.7% of the U.S. population. If we assume that these states consume a similar number of eggs per capita as the rest of the U.S., we get that around 17.7% of U.S. eggs would be cage-free directly due to legislation.[10] It could be a little less if many egg producers in Oregon will keep less than 3,000 hens, as the law doesn’t apply to them.

Also, note that there were some cage-free eggs before the laws described above were passed and corporate campaigns began. This report contains USDA data of percentages of U.S. hens that were cage-free in different years:

Table2

It seems that there was a slight upwards trend before most of the cage-free campaigns started, although it could still have been influenced by undercover investigations and few early campaigns. Note that some of these eggs were sold in California, Washington state, Massachusetts and Oregon, and these eggs should not be double-counted. Also, these are the percentages of eggs produced in the U.S. rather than consumed, but U.S. egg imports and exports seem to be relatively minor, so we can assume that a similar percentage of consumed eggs were cage-free each year.

Based on all this information, I think that 18–26% of eggs in the U.S. would be cage-free without corporate campaigns. That means out of 210–270 million hens used by companies in the U.S. that made cage-free commitments, 160–210 million hens would be caged if corporate campaigns never happened.

Other countries

In the Bollard’s estimates, out of estimated 135.6 million hens that are covered by non-U.S. commitments, 59% are covered by global commitments. Other commitments are region specific, with most animals affected by commitments specific to France (11.4%), UK (5.8%), Brazil (5.5%), all Europe (4.1%), Spain (3.3%), Italy (2.8%), Mexico (2%), Germany (1.8%), Poland (1.1%), and Denmark (1.1%). Note that Bollard’s estimates don’t contain all cage-free commitments, and commitments from some regions could have been systematically excluded. Also, it only provides approximate estimations of hens affected. Nevertheless, I believe this is somewhat indicative of which countries will be affected by commitments the most.

Here are the percentages of cage-free eggs in 2013 and 2017 in these countries:

Table3

Sources for the values in the table: Windhorst (2017) (for 2013 values), European Commission (2019) (for 2017 value for the EU), Corbett (2018) (for all other 2017 values). In some cases, these percentages conflict with the data that Charity Entrepreneurship has collected, though I’m not sure why. However, we don’t need precise values for this estimation.

I think that numbers for 2013 are relevant because most of the commitments were secured before 2013, so it’s unlikely that those percentages were significantly influenced by corporate campaigns.

Note that these numbers only suggest what percentage of eggs used by committed companies would have been cage-free. For example, if France is 31% cage-free, that doesn’t mean that French companies that made pledges would have been 31% cage-free if they didn’t make commitments. For example, it could be that most of the commitments are from grocers that already used a higher percentage of cage-free eggs than the national average. Also, countries could have imported or exported some portion of used eggs.

Four out of the six biggest global cage-free commitments are made by German retailers, that operate mostly in Europe, and have about half of their stores in Germany.[11] Out of ~67 million hens that are covered by global commitments that are included in the Lewis Bollard spreadsheet, these four retailers cover ~40 million hens. This significantly reduces the number of hens that should benefit from global cage-free commitments because Germany is already over 90% cage-free and is committed to go fully cage-free by 2025.

I haven’t analyzed other big global commitments (PepsiCo, Unilever, Sodexo, Grupo Bimbo, Land O' Lakes, Kellogg's Company, Compass Group, Hormel Foods, Campbell Soup, JM Smucker Company, General Mills, Elior). At least some of these companies impact Asia and Africa, where the percentage of cage-free eggs is probably very low.

With all this information in mind, my subjective 90% confidence interval is that out of 100–300 million hens used by companies that made cage-free commitments in countries other than U.S., 20%–50% would have been cage-free without corporate campaigns. That means that non-U.S. corporate cage-free commitments should affect 63–210 million hens every year that would have been caged without the campaigns, assuming that all companies follow-through.

Total chickens affected

The table below summarises the estimations of animals affected by commitments every year:

Table4

Note that this excludes broilers who die before slaughter. According to the National Chicken Council, around 5% or U.S. broilers die before slaughter. Pre-slaughter mortality in other countries might be different. Furthermore, commitments should affect an additional 2 to 8 million broiler breeders who are alive during any given month.[12][13]

Follow-through rate

As I reviewed in Šimčikas (2019), there are many reasons to believe that some companies will fail to follow through with their commitments. In this section, I explain why I predict that the follow-through rate will be 48%–84% for cage-free commitments and 1%–94% for broiler welfare commitments.

Approaches in other estimates

First, I overview the values used in other estimates:

One problem with the approaches in these estimates is that the follow-through rate largely depends on how much effort and money will be spent on ensuring compliance. The right approach for animal activists could be to do everything we can to make sure that companies keep their promises.[14] Therefore, it could be that most of the costs associated with secured commitments will be spent in the future. However, it would be difficult to take these future costs into account because nobody knows what they will be. Consequently, similarly to estimates above, I decided to not take them into account. As a result, my estimates in this section assume that animal advocates won’t take any costly actions to ensure compliance, even though they probably will. This assumption makes this estimate less useful because it estimates how cost-effective past corporate campaigns were in a potential future that will probably not exist.

Also, note that some commitments can be partially implemented. This is especially likely for some global commitments, where some country branches don’t announce or even know about global commitments. To take chickens that will be affected by partially implemented commitments into account, instead of estimating the probability that companies will follow through, I estimate what percentage of chickens that are covered by commitments will actually be affected in the way that was promised. This is also done partly to avoid some mathematical complexity and ambiguity that I explain here.

Cage-free ask

The U.S.

The U.S. cage-free flock has already increased from just under 17 million (5.7% of all U.S. layers) at the beginning of 2016 to 66.7 million (19.8%) hens in the June of 2019.[15] For all cage-free pledges to be implemented, this number will have to rise to at least 210–270 million (62%–80%) by 2026. King (2019) claims that the U.S. cage-free production will need to grow three times faster to meet this goal.

In a survey of thirty-one egg producers, on average it was predicted that 43% of eggs would be cage-free in 2025, but answers ranged from 20% to 100% (see O'Keefe (2019)).[16] Many other relevant pieces of evidence are reviewed in Sarek (2019) and Šimčikas (2019). With all this in mind, my subjective 90% confidence interval for the follow-through rate of cage-free commitments in the U.S. is 33%–85%.

Other countries

As reviewed in the Hens that would have been cage free without intervention section, most of the hens covered by cage-free commitments in other countries seem to be in Europe. Looking at the 2018 European EggTrack report, it appears that most (but not all) European companies are on track to meet their commitments. There are also 76 commitments with due dates in the past, and only two of them do not have reported progress: Bennet and Dussman. It seems that all the other commitments included in the report were followed-through.

Based on my limited knowledge about the situation in Asia, South America, and Africa, the follow-through rate in these regions will probably be lower than in Europe.

Overall, I expect the follow-through rate of cage-free commitments outside of the U.S. to be 63%–90%.

Combined

In the Guesstimate model, I weight the predicted follow-through rates of cage-free commitments in the U.S. and Europe by how many hens they should affect, and estimate that the combined follow-through rate for all cage-free commitments is 48%–84%.

Broiler ask

It’s much less clear what will be the follow-through rate of broiler commitments. All the commitments have been won in the past few years, and to my knowledge, there hasn’t yet been any tracking of whether companies are on track to comply with their commitments.[17]

One risk is that broiler producers will fail to scale up the production of higher welfare broilers, and there will be no way for companies to comply at the deadline. Fortunately, some producers have committed to meeting the demand for higher welfare broilers. Graber and Keller (2018) lists 17 U.S. poultry producers and processors that made such commitments. One of them is Perdue. According to Thornton (2016), Perdue is the fourth biggest broiler producer in the U.S. Perdue’s commitment seems strong. The list also includes Wayne Farms, the sixth biggest broiler producer in the U.S. In Europe, there is a similar commitment by a producer 2 Sisters Food Group. Clements (2016) claims 2 Sisters Food Group slaughters 317 million birds annually, which suggests that it is capable of supplying to the demand that other European commitments created so far.

Despite this, based on conversations with some animal advocates, it seems likely that if animal advocates did no further actions to ensure compliance, only the most socially responsible companies would follow through because higher welfare broilers will probably be more expensive. Based on this, I created a custom probability distribution, with a mean value of 24%:

Graph1

Note that I only have a limited understanding of the situation with broiler commitments, and I am very much open to changing the distribution above if given feedback or relevant evidence. I expect the actual follow-through rate to be higher than this graph indicates because I expect animal advocates to do more work on ensuring compliance. However, this estimate assumes that they won't.

Mean Years of Impact

Assuming companies follow through their promises, how long should we expect those promises to have an effect? I think that this is one of the primary sources of uncertainty in this estimate. In this section, I explain why I chose to use a subjective 90% confidence interval of 4 to 36 years for this value. The reasoning in this section does little to reduce the uncertainty about what this value should be, so impatient readers might want to skip it.

Approaches in other estimates

First, I overview how other similar estimates dealt with this uncertainty:

Note that contrary to the estimate above, my estimate includes the costs for undercover investigations. It follows that the estimates above are dealing with a different counterfactual. That is, contrary to my estimate, they assume that undercover investigations still happened, which makes a "shift in consumer demand" a much more likely scenario.

My subjective 90% confidence interval

Usually, commitments start having an impact before the deadline because companies gradually increase the percentage of their products that are higher welfare. If a company has 10 years to meet the deadline, and during those 10 years, 50% of the products they use are higher welfare (as opposed to 0% before the commitment was made), then we could say that there were 5 years of impact before the deadline. This assumes that there was no other factor (like a legislative change) that would have caused the company to start a shift to higher welfare products in that time.[19]

There are a lot of ways that changes stop being in effect after being implemented:

The period of impact stops whenever one of these events happen. However, these events can also happen gradually. For example, if the number of chickens used by a company decreases by a half for reasons unrelated to the campaign, it still affects the other half. In this estimation, if at a given year a commitment is having half of the impact it has now, I would take it into account by increasing the mean years of impact by 0.5 years. It’s not intuitive, but I think different models would add complexity but would do little to decrease the uncertainty.

Similarly, the mean years of impact should be bigger if the production and consumption of eggs and chicken is increasing. Projections of poultry and egg production are reviewed in the 2018 issue of Poultry Trends. EU egg production is projected to increase by 6.2% between 2016 and 2026. U.S. egg consumption is projected to rise by 14.5% between 2017 and 2027. In developed countries, where all broiler commitments were won, poultry production is expected to increase by 12% by 2027. U.S. poultry production is expected to be about 13% higher in 2027 than it was in 2017. Overall, these trends significantly increase how many chickens we should expect to be affected, and that is taken into account in this estimation by slightly increasing the value of mean years of impact.

Overall, it’s difficult to make progress on the question of how many years commitments will have an impact, and a wide confidence interval has to be used as a result. My subjective 90% confidence interval which I use in the Guesstimate model is 4 to 36 years (the mean is 15 years). Note that I use a lognormal distribution because I think that a lesser number of years is more likely.

Costs

In this section, I estimate that the total spending related to corporate animal welfare campaigns between 2005 and 2018 is 54–120 million U.S. dollars, of which $16–$42 million is attributable broiler campaigns, and $36–$84 million to cage-free campaigns. I try to include not only direct costs of campaigns, but also spending on undercover investigations of broiler and hen living conditions in factory farms, past efforts to ensure compliance to commitments, relevant research, and all operational, office rental, travel, administrative, training, hiring, and managerial costs that are associated with these activities. You can see the full details estimation in the Guesstimate model.

First, I make educated guesses about the spending of all the biggest animal charities that work on corporate campaigns:

Using this information, in the Guesstimate model I put my subjective 90% confidence intervals of how much each organization spent on activities related to corporate campaigns for each year between 2005 and 2018. It required some guesswork, especially for years before 2012.

A significant part of the funding for corporate campaigns by these and other organizations comes from the Open Philanthropy Project (OpenPhil). I categorized all Farm Animal Welfare grants given by OpenPhil here. According to my estimate, OpenPhil gave grants totaling:

My subjective 90% confidence interval of the total amount granted by OpenPhil that was spent before the end of 2018 and is not included in the estimate above is $9.7–$14 million.

I think that now the estimate includes most of the spending on corporate campaigns, but it excludes some of the spending by organizations like RSPCA, Compassion Over Killing, Animals Australia, Humane Society International, Anima, and various members of the Open Wing Alliance. Note that some Open Wing Alliance members are funded through THL, and this funding is already included. Finally, some relevant work early on was also done by PETA. My subjective 90% confidence interval of spending that is still not included is $2.8–$10 million.

After summing all these numbers up in Guesstimate, I get that the total spending is $70–$100 million. After adjusting for inflation,[27] it’s $74–$110 million. However, I think that this confidence interval is too narrow because Guesstimate treats confidence intervals for each year as independent, but they are not. For example, if I underestimated how much HSUS spent on corporate campaigns in 2012, I most likely underestimated HSUS spending in 2013 as well. Furthermore, OpenPhil (2016) estimates that “about $2.5 million has been spent in total on corporate cage-free campaigns” until the article was written in 2016.[28] According to my estimation, $17 million to $38 million was spent on activities related to corporate campaigns between 2005 and 2015. Even though, contrary to the OpenPhil estimate, my estimate includes some related undercover investigations and other expenses, OpenPhil estimate makes me think that most likely I overestimated how much was spent in this period. To account for these considerations, I widen my confidence interval of the total spending on activities related to corporate campaigns to $54–$120 million.

I also asked Lewis Bollard to guess how much of the spending was related to broiler campaigns rather than cage-free campaigns each year. His educated guesses can be seen in the table below. I converted them all to subjective confidence intervals and estimated that the total spending on broiler campaigns is $16–$42 million. Note that I consider undercover investigations about broiler conditions to be relevant to broiler campaigns. If I didn’t, the spending on broiler campaigns before 2016 would be close to zero.

Table5

The mean of my 90% confidence intervals for 2005-2015 is higher than Bollard’s estimate because a significant portion of relevant spending in that time was on undercover investigations, and it seems that there was a similar number of investigations about hens and broilers, although I'm unsure.

Other costs that could be included

When doing cost-effectiveness estimates, it’s not trivial to determine which costs to take into account because so many outcomes are interdependent.[29] In this section, I explain why I decided to exclude some costs, how it could be argued that they should be included, and how would their inclusion change the cost-effectiveness estimate.

Future costs of ensuring compliance to commitments

In the Follow-through rate section , I mentioned that one disadvantage of this estimate is that it doesn’t take into account future costs that may have to be spent on ensuring compliance. Ways to ensure compliance are listed in Šimčikas (2019).

CIWF’s statement of transparency claims that:

After consultation with other farmed animal welfare organizations and experts, we decided that the cost and effort of obtaining an initial commitment comprises 50 percent of an organization’s overall cost. The remaining 50 percent of the cost is attributed to following up with a company in subsequent years to assure the details of the commitment are implemented and deadlines are met.

Note that in the citation above, the costs of obtaining commitments probably doesn’t include the costs of related activities like undercover investigations done in years prior. Nevertheless, if we assumed that ensuring the compliance to commitments that are already won will cost as much as was spent on all activities associated with corporate campaigns between 2005 and 2018 ($54M to $120M), we would need to divide the cost-effectiveness estimate by two. In my opinion, that wouldn’t change the conclusion that corporate campaigns are very cost-effective, but it’s possible that ensuring compliance will cost even more. Note that for the sake of simplicity and being conservative, I assumed that follow-through rates would remain the same.

Ballot initiatives and lobbying

I decided to exclude the costs and impact of legislative initiatives from the main estimation because I thought that their cost-effectiveness is a separate topic that should be addressed on its own. That would allow us to compare the cost-effectiveness of corporate campaigns and legislative initiatives. However, I'm unsure if excluding legislative costs was the right decision.

According to Josh Balk from HSUS, corporate and legal bans feed off each other in a positive way, and it was the combination of passing laws and working with corporate entities that has driven the issue forward. “Legislators want to know what corporations are doing, and corporations want to know what legislators are doing, so both types of effort help each other.” Hence, it could be argued that it doesn’t make sense to estimate the cost-effectiveness of corporate campaigns without including the costs of achieving relevant animal welfare laws.

There have been several relevant ballot initiatives in the U.S.:

According to ballotpedia.org data cited above, about $25.7 million was spent on these initiatives in total. Since my estimated spending on cage-free campaigns is $36–$84 million, including costs associated with these initiatives would significantly increase the costs and reduce the estimated cost-effectiveness. However, initiatives in California and Massachusetts also introduced legislation regarding calves and pigs. Hence it could be said that this spending is only partially relevant.

HSUS work also led to Washington banning the sale and production of eggs from caged hens, Oregon banning the sale and production of eggs from caged hens for egg producers with more than 3,000 hens, and Ohio placing a moratorium on building new battery cages. According to a private conversation with Lewis Bollard, the costs of victories in Washington and Ohio were low. Note that legislation that bans battery cages may also help cage-free commitments because enriched cages are more expensive, which makes it less profitable for producers to keep hens caged.

Another related effort by animal advocates was fighting The King Amendment (in 2013 and 2018) which would have preempted all meaningful state laws on the farm animal welfare. According to Bollard, it’s unclear how much was spent on this effort, but the total associated costs probably did not exceed $5 million and possibly were much lower. This suggests that taking these costs into account would only slightly decrease the estimated cost-effectiveness.

Finally, there was also some spending associated with fighting ag-gag laws (which seek to criminalize undercover investigations on factory farms), but it’s unclear if these efforts allowed any undercover investigations of hen or broiler conditions. Hence it could be argued that this spending is unrelated to cage-free and broiler welfare reforms.

I’m unsure how significant are the costs associated with legislative campaigns in other countries. In a 2017 conversation, Lewis Bollard claims that his “impression is that European animal welfare reforms have, in general, been driven more by the efforts of technocratic officials than by organized advocacy groups, with the exception of Compassion in World Farming (CIWF), which has contributed through organizing, lobbying, and petitioning.“ Currently, there is an ongoing legislative initiative by animal charities to end cages within the EU.

Supporting animal welfare movement

Some organizations don’t work on corporate campaigns directly, but support their work in other ways. For example:

Overall, while spending by such organizations could be relevant, only a fraction of their spending could be related to corporate campaigns, and I think that including such costs would only make a small difference on the final result.

Other

Other activities that are loosely related to corporate campaigns but not included in the costs estimate are:

Average lifespan

Broilers

According to the National Chicken Council, the mean slaughter age for broilers is 47 days in the U.S. According to the European Commission (2016), in the EU broilers are slaughtered at the average age of 42 days. In my the Guesstimate model, I use a 90% confidence interval of 43 to 48 days. The estimate is closer to the U.S. average because according to my estimate, most (53% to 90%) of the affected broilers are in the U.S. If we multiply this by the number of broilers affected per dollar (1.7 to 720), we get that 0.2 to 90 broiler-years are affected per dollar spent on broiler campaigns.

Hens

In the case of cage-free commitments, we estimated how many hens are affected at any point in time.[30] This means that to get the number of hen-years that were shifted from caged to cage-free systems, we only need to multiply the estimated number of hens affected every year by the predicted mean years of impact. To estimate how many hen lifetimes will be affected, we need to divide this result by the average time hens spend in cages. According to an Animal Charities Evaluators estimate, it is 1.27±0.14 years.

Note that this figure excludes the first 16 weeks of hen’s life during which they don’t lay eggs. CIWF claims in this period they “are normally raised at a growing site, typically a barn system although more farms are beginning to rear in the type of systems that the birds will eventually lay in.” If many hens are kept in systems they will eventually lay in, that increases the number of years affected by cage-free commitments because some hens will become cage-free during the first 16 weeks of their lives as well. However, I do not take that into account for the sake of simplicity, and because I think it would probably be challenging to find what percentage of hens this applies to.

Ways this estimate could be misleading

In this section, I list considerations that were not taken into account in the cost-effectiveness estimate but could impact our opinion about the cost-effectiveness of corporate campaigns. I skip factors that I already discussed in previous sections.

If a consideration should increase the cost-effectiveness corporate campaigns, I mark it with (+). If it decreases, I mark it with (-). If it’s unclear whether it increases or decreases cost-effectiveness, I mark it with (?). The number of symbols in the parentheses shows how important I consider the argument to be. For example, (+++) denotes considerations that I think greatly increase the cost-effectiveness, (++) denotes moderate increase, and (+) denotes a slight increase. Note that the strength of each consideration is based only on my subjective opinion.

Indirect effects

In the estimate, I only consider the direct short-term effects of corporate campaigns. However, they also have many indirect effects that could be more important:

Why cost-effectiveness in the future might be different

I estimated cost-effectiveness of past campaigns. There are many reasons why cost-effectiveness going forward might be different:

How this estimate could be incorrect

It’s unclear whether combined, these considerations should increase or decrease how cost-effective we should consider corporate campaigns to be. In total, there are 3 considerations that I marked as (+++), 3 as (++), 4 as (+), 3 as (- - -), 6 as (- -), and 8 as (-).

Other considerations

Conclusions

I estimated that for every dollar spent on cage-free and broiler corporate campaigns, 9 to 120 chicken years are affected. I am pleasantly surprised that such a big difference can be made at the cost of just one dollar. Consequently, I would strongly consider donating money to activities related to corporate campaigns. I don’t know of any other altruistic intervention that has this much impact per dollar spent at reasonable robustness of the evidence.

There are many ways this estimate could be misleading, but my intuition is that none of them would change the conclusion that these campaigns have a very big (and most likely positive) short-term impact relative to their costs. However, indirect effects on animal product consumption, moral circle expansion, and wild animal welfare could be more important than direct effects, and I am uncertain if they are positive. Perhaps these effects should be examined in further research.

Working on this estimate also made me appreciate the complexity of truly estimating the cost-effectiveness of anything. There are so many factors that I wouldn’t even know how to take into account.

Appendix 1: Pessimistic estimation

In this appendix, I will use very pessimistic assumptions to estimate the lower bound of chicken-years affected by corporate campaigns. For the main estimate, I used software called Guesstimate, where even the lower bound of the final result is influenced by more optimistic upper bounds of my subjective 90% confidence intervals for values like the follow-through rate and mean years of impact. In this appendix, I will see what happens if I don’t use Guesstimate, and simply use pessimistic point estimates for all the parameters. That is, I use lower bounds of my subjective 90% confidence intervals for the number of chickens covered, follow-through rate, and mean years of impact, and the upper bound of the estimated costs.

Table6

As can be seen in the table above, it is possible that relatively few broilers will be affected by commitments, and for this pessimistic estimation, their number can be rounded down to zero. However, even if I use the most pessimistic assumptions that I think could be reasonable, I get that cage-free campaigns affected 5.5 hen-years per dollar spent. If we take into account the costs of broiler campaigns and assume that they will help no animals at all, the number of hen-years affected per dollar goes down to 3.7. If we included the costs of ballot initiatives and lobbying in the U.S. (at most $40 million) and the budget of Animal Charity Evaluators ($2.1 million), the number would go down to 2.7 hen-years. If we assumed that another $200 million would be spent on ensuring compliance to commitments that are already won, and didn’t increase the follow-through rate accordingly, we would get that corporate campaigns affect 1.25 hen-years per dollar spent. In my opinion, that is still very cost-effective compared to most altruistic interventions. All calculations in this appendix can be seen here.

Appendix 2: Volunteers

I haven’t seen any cost-effectiveness taking into account volunteer time. I’m unsure about how to do it. To illustrate why we might want to take it into account in some way, imagine many volunteers collaborating to do corporate campaigns without any paid coordinators, and only having a small budget that is spent on snacks. If we estimated how many animals these volunteers affect per dollar spent, the number could be very high. However, the estimate wouldn’t be very meaningful. For example, we shouldn’t expect their impact to double if we double their funding for snacks. Theoretically, additional funding could even have no effect.

This hypothetical scenario is not necessarily far-fetched. Co-founder of Open Cages Dobrosława Gogłoza claims that Open Cages “initially operated entirely on a voluntary basis — I myself started working full-time in my own organization only in the 5th year of its operation.” Even though Open Cages now has many paid employees, volunteers participate in the organization on every level: as investigators, fundraisers, IT specialists, lawyers, graphic designers, corporate outreach specialists, lobbyists, campaign coordinators, volunteer coordinators, copywriters, film directors, event organizers, board members, etc.

I asked Jakub Stencel, who works at Open Cages, to estimate how much volunteer time is spent by volunteers in Poland. His subjective 90% confidence interval was that there are 50–70 volunteers who work 5–15 hours a week, and 180–230 volunteers who work 2–6 hours a week. That means that there are 610–2,430 volunteer hours spent every week, which is 15 to 61 full-time equivalents. I estimated this by simply dividing the number of hours per week by 40. For comparison, Dobrosława Gogłoza claims that Open Cages have 22 employees in Poland. If volunteers were paid Poland’s minimum wages, together they would be paid $105,000 to $423,000 per year. Note that not all volunteers work on tasks that are related to animal welfare corporate campaigns. For example, 15%–20% of volunteer time is spent on corporate campaigns to encourage companies to use vegan ingredients, increase the portfolio of plant-based options, and expand vegan options in menus.

Though volunteer time in Open Cages is significant, it may be an extreme example. To my knowledge, there is no other relevant organization that depends on volunteers to the same extent. But it seems that most animal charities that do corporate campaigns use volunteers for many important tasks like:

Note that it’s not at all clear that volunteer time should be treated as a cost. Volunteering can make people more engaged in animal issues which leads to contributions of other kinds, like eating a vegan diet, donating money to animal charities, encouraging friends to take action, and looking for employment opportunities within animal advocacy. It can also act as training for jobs within animal advocacy. Volunteering may also bring personal benefits, like giving opportunities to make friends and giving more sense of meaning to life. Volunteering at more complex tasks like marketing, communications, or IT, can also provide career experience, industry knowledge, and credentials like internships that can be put on their resumes.

Overall, my intuition is that this consideration should not change the conclusion that corporate campaigns have a very high short-term impact relative to their costs.

Appendix 3: Previous cost-effectiveness estimates

[C]onservatively assuming that the campaigns only accelerated pledges by five years, these campaigns will spare about 250 hens a year of cage confinement per dollar spent. And even if you add the $1.5 million disbursement for the first year of our three grants, and the ~$12.5 million (at most) spent both on Prop 2 in 2008 and all egg undercover investigations ever done in the U.S., these campaigns will still spare about 38 hens a year of cage confinement per dollar spent.

Appendix 4: Why I chose to estimate the cost-effectiveness for all charities, all countries, and all years?

Some of the estimates I reviewed in the previous appendix make cost-effectiveness estimates for one charity and one year. I decided to include all the years, all the charities, and all the countries in my estimate because otherwise, the result could be misleading. In this appendix, I explain why. Note that I’m uncertain if it was the right decision.

Why for all countries and all charities?

Why since for all years 2005?

If, for example, I would only estimate cost-effectiveness of cage-free commitments during 2016, when many companies committed to going cage-free, I would be at the risk of excluding much of the costs that were needed to prepare for these victories: setting up charities, doing undercover investigations, and trying to secure some initial key commitments. The resulting cost-effectiveness estimate would be too high, and may not be representative of cost-effectiveness we should expect in the future campaigns. For example, once we transition to a different ask (e.g., to improve farmed fish welfare), the costly work of securing key commitments has to be done again.

Any choice of year where to begin will be arbitrary.[37] I choose the year 2005 because according to Bollard (2017a) that is when “farm animals became a bigger focus for animal advocates” and some cage-free campaigns began. Furthermore, according to Chicken Track, 2005 was also the year of first corporate cage-free pledges.[38] Nevertheless, I believe that choosing a date that is as far back as 2005 is a conservative choice.

References

Andreyeva, T., Long, M. W., & Brownell, K. D. (2010). The impact of food prices on consumption: a systematic review of research on the price elasticity of demand for food. American journal of public health, 100(2), 216-222.

Animal Charity Evaluators. (2017a). When Will There Be Cost-competitive Cultured Animal Products?

Animal Charity Evaluators. (2017b). Response To A Recent Critique Of Our Research

Animal Charity Evaluators. (2018a). HSUS Farm Animal Protection Campaign

Animal Charity Evaluators. (2018b). Carbon And Water Footprints Of Diet Choices

Bollard, L. (2016). Initial Grants to Support Corporate Cage-Free Reforms.

Bollard, L. (2017a). Why Are the US Corporate Cage-Free Campaigns Succeeding?

Bollard, L. (2017b). Why This Could Be the Year of the Broiler Chicken

Bollard, L. (2018). How Can You Do The Most Good for Animals?

Burns, B. (2015). "An opiate to the conscience": welfarism as a step to animal liberation?

Capriati, M. (2018). Founders Pledge Cause Area Report - Animal Welfare.

Clements, M. (2016). The 5 largest poultry, egg producers in Europe

Corbett, J. (2018). What is the future of colony egg production in the UK?

Cotra, A. (2017). How Will Hen Welfare Be Impacted by the Transition to Cage-Free Housing? Note: the date and author are not mentioned in the report, but it is mentioned in a blog post announcing the report.

Dickens, M. (2016). A Complete Quantitative Model for Cause Selection

Elanco Animal Health. (2016). The sustainability impacts of slow-growing broiler production in

the US.

European Commission, Health and Food Safety. (2016). Use of slaughterhouse data to monitor welfare of broilers on farm

European Commission, Agriculture and Rural Development. (2019). EU Market Situation for Eggs. Committee for the Common Organisation of the Agricultural Markets 20 June 2019

Graber, R., Keller, J. (2018). Infographic: GAP broiler standard commitments

King, D. (2019). To meet cage-free pledges, industry will need to grow 3 times faster

OpenPhil (The Open Philanthropy Project). (2016). The Humane League — Corporate Cage-Free Campaigns

PETA. (2017). Why We Oppose California’s Farmed-Animal Initiative and You Should, Too

Sarek, K. (2019). 35 Independent Pieces of Evidence for Why New Corporate Campaigns Might (or Might Not) Work

Sentience Institute. (2018). Summary of Evidence for Foundational Questions in Effective Animal Advocacy

Sethu, H. (2018). How ranking of advocacy strategies can mislead

Shields, S., Shapiro, P., & Rowan, A. (2017). A decade of progress toward ending the intensive confinement of farm animals in the United States. Animals, 7(5), 40.

Šimčikas, S. (2019). Will companies meet their animal welfare commitments?

Stevenson, P. (2012). European Union legislation on the welfare of farm animals

Thornton, G. (2016). Top 10 US chicken producers grow in new directions

Watson, E. (2016). The US egg market is recovering well, but will avian flu have a longer-term impact on industrial egg use?

Windhorst, H. W. (2017). Housing systems in laying hen husbandry – second part.

Wrenn, C. L., & Johnson, R. (2013). A critique of single-issue campaigning and the importance of comprehensive abolitionist vegan advocacy. Food, Culture & Society, 16(4), 651-668.

Xin, H., Gates, R. S., Green, A. R., Mitloehner, F. M., Moore, P. A., & Wathes, C. M. (2011). Environmental impacts and sustainability of egg production systems. Poultry Science, 90(1), 263-277.

Credits

This article is a project of Rethink Priorities. If you like our work, please consider subscribing to our newsletter. You can see all our work to date here.

The article was written by Saulius Šimčikas. Thanks to Jamie Spurgeon, Marcus A. Davis, Kieran Greig, and Lewis Bollard for reviewing parts of this post and making valuable comments. Also, thank you to so many animal advocates who patiently answered all my questions when I was doing this research for this article.

Rethink Priorities Logo

Notes


  1. Cage-free campaigns request to keep egg-laying hens in cage-free systems rather than in battery cages or enriched cages. Cage-free systems include barns, aviaries, organic, and free-range systems. A comparison between different systems can be seen here. The effect of the transition to cage-free housing on hen welfare is analyzed in detail in Cotra (2017). ↩︎

  2. The changes for broilers that animal advocates ask for can be seen here. Bollard (2017b) explains a bit more about what these changes mean for broilers. ↩︎

  3. Explanation of some of the variables in the table:

    • Chickens covered by commitments - how many hens companies that made cage-free pledges use, and how many broilers companies that made broiler commitments use
    • Follow-through rate - what percentage of chickens covered by commitments will actually be affected.
    • Mean years of impact - A predicted number of years commitments have an effect, assuming they will be followed through

    In case the table is still unclear, here is a summary of the estimate in text form: I first estimate that 330–1,300 million broilers and 240–390 million hens should be affected by corporate cage-free and broiler commitments every year these policies have an effect, excluding estimated 79–180 million hens that are covered by commitments but would’ve been cage-free without the campaigns. However, I think that only 48%–85% of these hens, and 1–94% of broilers will be actually affected by these commitments, because not all companies will follow through. It’s very unclear for how long these policies will have an effect. I briefly overview all the ways commitments could stop being relevant (including legislative change, cultured eggs and chicken, bankruptcies, backslide due to economic incentives) and guess that on average, these commitments will have an effect for 4 to 36 years. This value is a bit higher due to the fact that the production of eggs and chicken is expected to grow. I then estimate that between 2005 and 2018, the total spending related to cage-free and broiler welfare corporate campaigns was $54–$120 million, of which about $16–$42 million was spent on broiler campaigns. Putting it all together, per every dollar spent on cage-free and broiler campaigns, 10–280 chickens will be affected. Combined, they will live 9.6 to 120 years, ignoring that lifespans of broilers will increase if slower-growing breeds will be used, and excluding the pullet phase of hen lives when they are in hatcheries where living conditions are not directly affected by cage-free promises. ↩︎

  4. This includes global cage-free commitments that may include the U.S., which causes some double-counting. This is taken into account by slightly decreasing the number of hens covered by global commitments. ↩︎

  5. For example, UK grocer Tesco claims to sell 1.4 billion eggs each year in about 3,500 stores. That means that on average, a Tesco store sells about 400,000 eggs each year. Iceland is another UK grocer with about 850 stores. Assuming that Iceland also sells about 400,000 eggs per store per year, we can estimate that Iceland sells about 340 million eggs. One hen lays about 270 eggs per year, so we can estimate that Iceland’s cage-free commitment will affect about 1.26 million hens per year. This is approximate because it’s possible that Iceland sells more (or less) eggs per store per year. In some other cases, estimates are even more approximate. For example, the number of hens used by a manufacturer PepsiCo was extrapolated from the number of hens used by General Mills US (another manufacturer), using revenue figures. Since these manufacturers produce different products, it's possible that the estimate is very inaccurate. ↩︎

  6. Note that companies that only use one part of a chicken may have less leverage over the producers (relative to the number of chickens that should be affected) than companies that buy all parts of chickens from them. ↩︎

  7. Numbers of locations of restaurants that made broiler welfare commitments in Europe:

    • ASK Italian: 112 in the UK,
    • Coco di Mama: 22 in London
    • Zizzi: 140 in the UK and Ireland
    • Pret A Manger: 360 in the U.K, less than 50 in France in 2017
    • Prezzo: 208 in the UK and Ireland
    • Carluccio's: 77 in the UK
    • Paradiset: 3 stores in Sweden
    • Kalf & Hansen: 3 in Sweden
    • Icha Icha: 3 in Sweden
    • Bastard Burgers: 21 in Sweden, another 6 planned
    ↩︎
  8. Based on Rabobank World Poultry Map 2018, I estimated that in 2017, the U.S. consumed 48 kg of poultry per capita, while the EU consumed 22 kg, more than two times less. However, the consumption differs substantially by country within the EU. For example, AHDB (2018) claims that the UK consumed 37.3 kg of poultry per capita in 2016. Note that poultry includes turkey and ducks, not just broilers, although most of the poultry consumption in the U.S. and the EU seems to be broilers. ↩︎

  9. According to ChickenTrack, their commitment applies to the whole of Europe, but the commitment itself seems to only talk about the U.K. Marks & Spencer has 1035 stores in the U.K. and 428 internationally. ↩︎

  10. This doesn’t include eggs that are exported from California, Washington state, Massachusetts and Oregon. According to the California's Department of Food and Agriculture, the state exported only $4 million worth of eggs in 2017, which should affect less than a million hens (perhaps much less). Even if exports in other states that have cage-free laws are significant, I’d expect them to decrease after the law comes into force, as financial incentives would probably cause producers in these states to move to other states with no cage-free law, or cater to a cage-free demand that would have been met by other producers anyway. However, to account for the possibility that this reasoning is incorrect, the upper bound of my subjective 90% confidence interval of the number of hens that would be cage-free without corporate campaigns is a little bit higher. ↩︎

  11. The big German grocers that made global cage-free commitments are:

    • Rewe: according to to their website, in 2016, REWE Group operated 14,728 stores in 19 European countries, of which 10,178 stores were in Germany.
    • Lidl operates in 27 European countries, U.S., Singapore and Hong Kong. According to Wikipedia, around 3,300 of over 10,000 Lidl stores are in Germany.
    • Aldi Süd: according to Wikipedia, Aldi Süd operates about 6,200 stores, of which 1,886 are in Germany, 1,873 in the U.S., 775 in the UK, 527 in Australia, and 1,110 in other European countries.
    • Kaufland: according to Wikipedia, Kaufland operates in Germany (650 out of 1,200 stores), the Czech Republic, Slovakia, Poland, Romania, Bulgaria and Croatia
    ↩︎
  12. According to Sethu (2014), in 2013, there were 52.2 million broiler breeders alive during any given month. According to a USDA fact sheet, in 2014, the U.S. poultry industry produced 8.54 billion broilers. Assuming that a similar number of broilers was slaughtered in both years, we can estimate that for every 0.33 to 1.3 billion broilers slaughtered there are 2 to 8 million broiler breeders alive during any given month. ↩︎

  13. Note that broiler breeders might be the worst kept animals in the farming industry. This is very speculative, but it’s possible that slower growing breeds will help them the most because they will have to be starved less to maintain an acceptable weight. If this is true, animal organizations could consider talking about broiler breeders more when campaigning for the broiler ask because their conditions might concern the public who may not even know about the horrible conditions in which they are raised. Note that broiler breeders are not mentioned in the broiler ask, so the use of the higher welfare (and probably slower growing) breeds might be the only requirement of the ask that affects them. ↩︎

  14. For example, use ballot initiatives to pass laws like California's Proposition 12, despite their high costs. If such measures are not taken, companies could not only ignore their current commitments, but it could threaten the legitimacy of all future corporate animal welfare commitments as everyone would see such commitments as meaningless. ↩︎

  15. Assuming that most of this growth is due to corporate campaigns, nearly 50 million hens were already affected, which is about 27% of the 160-210 million hens that are covered by U.S. cage-free commitments. However, some of this growth was probably due to legislation. ↩︎

  16. I think that the 20% low is unreasonable because 19.8% layers are already cage-free and the percentage should rise due to California’s Proposition 12 and the commitments. I think that the 100% high is also not very realistic because King (2019) claims that to meet cage-free pledges in the U.S., the cage-free production will need to grow three times faster, but even if that happen, only about 70% of U.S. hens would be cage-free. ↩︎

  17. Tracking the progress towards broiler commitments is planned in the future though. See ChickenTrack. ↩︎

  18. Other approaches to dealing with the uncertainty of how many years commitments will have an effect include:

    • CIWF USA’s Cost Effectiveness Estimate Statement of Transparency cites Bollard (2016) and ACE and also assumes that changes will have an effect for five years after a commitment is implemented. It also adds some additional years of impact based on the number of years between making the commitment and the deadline.
    • Dickens (2016) uses a 90% confidence interval of 5-10 years and also discusses using a confidence interval of 3-10 years. It also cites Bollard (2016) as the source.
    • Capriati (2018) estimate does not have a direct equivalent to years of impact expected. Instead, it estimates the number of years THL moves the policy forward by. It assigns the value to this variable based on how important was THL’s role in bringing policies about. By analyzing six randomly selected campaigns, it concludes that on average THL’s cage-free and broiler campaigns moved policies forward by one year, and chick culling campaign brought policy forward by six months.

    Note that the question is not unique to animal welfare commitments. It’s possible that there are more thought-out methodologies of estimating how long corporate commitments of other kinds have an effect. However, I haven’t seen any. ↩︎

  19. See CIWF USA’s Cost Effectiveness Estimate Statement of Transparency for more reasoning along these lines. ↩︎

  20. Another source says that it will cost U.S. companies more than $4 billion. According to United Egg Producers, it will cost more than $10 billion to go cage-free. Note that United Egg Producers is an egg interest group so they may be incentivized to overestimate this figure. ↩︎

  21. Around $5.8 million in 2017, $9.4 million in 2016, $8.6 million in 2015, $9.4 million in 2014, $12.9 million in 2013, and $19.2 million in 2013. ↩︎

  22. Also note that in 2016, HSUS received two grants for corporate outreach from OpenPhil, totalling at $1.5 million. ↩︎

  23. Bollard (2018) assumed that in 2017 HSUS total spending related to farm animals was $15 million (⅛ of their budget), even though FAPC’s budget in 2017 was only $4 million (including activities unrelated to corporate campaigns, like institutional meat reduction program). The estimate by Lewis is so much bigger because it includes admin and fundraising costs. Similarly, in 2016 review, ACE pointed out that they “have very little sense how much HSUS spends on farmed animal issues outside the FAPC’s budget.” ↩︎

  24. $160,036 in 2013, $322,677 in 2014, $211,659 in 2015, and $465,226 in 2016. ↩︎

  25. Animal Equality’s spending on investigations was about $920,000 in 2018, $998,000 in 2017, $820,000 in 2016, $230,969 in 2015, and $104,610 in 2013. I guessed that in 2014 they spent $200,000. ↩︎

  26. I think so because Animal Equality spent relatively little money on corporate outreach and investigations in 2013, and their budget was small in prior years. According to the 2014 ACE review, “they have operated on a very limited budget in past years (though this increased substantially in the two last years to $300,000/year)”. ↩︎

  27. I used CPI Inflation Calculator from the U.S. Department of Labour website to compare the value of the U.S. dollar in January of each year to the value of the U.S. dollar in January 2019. Note that some of the spending was not in U.S. dollars, so this is only partially accurate. ↩︎

  28. Bollard (2016) has some more details about that. It claims that $2.5 million was spent in the last few years, which suggests that not much money was spent before. ↩︎

  29. To explain why, imagine a cost-profit analysis of selling vegan cakes. When calculating the total cost, you could include the costs of:

    • selling cakes,
    • producing cakes,
    • creating a recipe,
    • buying equipment to make cakes,
    • acquiring skills needed to make cakes,
    • creating a demand for cakes (e.g., advertising).

    Which costs to include is determined by where you are in the process. If you already have a lot of cakes made, and you are thinking whether to throw them away or to set up a market stall and spend your day selling them, it would be a mistake to take the cost of producing those cakes into a consideration, at least from the point of view of maximizing the profit. On the other hand, if you don’t have the skills or equipment to make cakes, it would be a mistake to exclude these costs from your cost-profit analysis. ↩︎

  30. For example, if the size of a commitment was estimated using the number of eggs used by a company, it was divided by the average number of eggs hens lay per year (~270), rather than per lifetime. That means that we can estimate the number of hen-years affected by simply multiplying the number of hens affected per year by Mean Years of Impact. ↩︎

  31. I am very uncertain about how significant this effect is. Note that the issue was known when deciding on the ask and it was decided that it’s worth making the trade-off. Elanco Animal Health (2016) claims that the grow out time for slower growing breeds is 58 days, versus 44 days for conventional breeds. Furthermore, prime meat (breasts, wings, thighs, and legs) yield for slower growing breeds is 48%, versus 55% for conventional breeds. It follows that if slower growing breeds were adopted, 51% more broilers would need to be alive at any point in time to produce the same amount of prime meat. However, I haven’t found the source for the claims by Elanco Animal Health (2016), and I am not sure how much to trust them. It’s possible Elanco was funded by the animal industry to write the report. An older Poultry World study indicates that slow- and fast-growing broilers are slaughtered at near the same weight and yield very similar proportions of prime meat. Overall, the answer probably depends a lot on which higher-welfare breeds will be used. That is not currently known in the U.S. because U.S. companies are committing to use GAP-approved breeds, but GAP has not yet approved breeds, as they are waiting for the results of a study. ↩︎

  32. For example, Lusk (2018) analyzed the market impacts of switching to slower growing broiler breeds. It concluded that “under the most likely scenario, we calculate that converting to slower growth breeds would increase retail chicken prices by 1.17% and reduce the amount of retail chicken sold by 0.91%, resulting in losses in producer profits of $3.5 billion/year.” It also claims that production costs would increase by about 14%. According to Elanco Animal Health (2016), using slower growing breeds would increase the market price per bird by a whopping 49%. I’m unsure of why these two sources provide such different numbers. Note that if the costs of complying with other requirements in the broiler ask were included (regarding stocking density, lighting, air quality, etc.), production costs would probably increase more. There is disagreement about how much cage-free reforms will increase the price of eggs. The effects that food prices have on chicken and egg consumption are analyzed in Andreyeva et al. (2010). Note that reduction in animal product prices could help to establish plant-based alternatives, cultured animal products, and other innovations could further decrease animal product consumption in the longer term. ↩︎

  33. The source for the chart is All of Our World in Data which used 2017 FAO data. ↩︎

  34. For example, producers could be reluctant to replace housing systems if they anticipate that soon they will have to be abandoned due to competition from cultured meat and eggs. ↩︎

  35. Achieving the commitment seems to have required little resources from animal welfare organizations, so it would have increased the estimated cost-effectiveness. The commitment is discussed in more depth Capriati (2018). According to the report, it could spare suffering for 260 million chicks each year, but the suffering for each chick is brief, and there is only a 30% probability that United Egg Producers will follow through this commitment. ↩︎

  36. ACE and Capriati (2018) estimate the impact of one charity that played a role in securing commitments together with other organizations by assigning a proportional responsibility. But this is very subjective. It could also lead to misleading conclusions. Imagine a hypothetical scenario where two charities are needed: charity A that secures corporate commitments to use higher welfare broiler breeds, and charity B that develops higher welfare breeds that could be used. We decide that each of these charities should get half of the credit for the change that we want to happen, and estimate that charity A will help many more animals in expectation per dollar spent. It would be a mistake to use this information to conclude that we should put all the funding into charity A securing commitments because its work may be useless if charity B does not succeed in developing broiler breeds. Note that this scenario is purely hypothetical, as currently relatively little resources are allocated to the research of the best asks. ↩︎

  37. It’s unclear which choice of the starting year is the best. It could be argued that even campaigns against animal experimentation in the U.S. in the 1970s should be included in the estimate because they helped to make the U.S. society more concerned about animal welfare, which makes it easier to achieve corporate commitments today. Including costs of activities that created such public concern is not needed when estimating the effectiveness of the U.S. cage-free and broiler campaigns, because these costs are already in the past and won’t need to be expended again when transitioning to new asks. However, they may be somewhat relevant when considering the costs of expanding to other countries where the public is not yet concerned about animals. ↩︎

  38. Note that in 2005 there was already a lot of progress in some countries. For example, the EU passed a law phasing out the use of barren battery cages in 1999 and banned the construction of new gestation crates in 2003. Progress in the U.S. is summarized by Shields et al. (2017). It includes a gestation crate ban in Florida (2002) and various campaigns against other cruel practices (e.g., animal experimentation) that probably made the concern for animal welfare more common. ↩︎


Nix_Goldowsky-Dill @ 2019-07-22T11:13 (+11)

First of all, great model and write-up.

One of my the biggest take aways from looking at your model was the importance of the Mean Years of Impact parameter. Looking at guesstimate's sensitivity analysis the r^2 value is about 0.75 [1], meaning approximately ~75% of the variance in the bottom line result is due to the variance estimating Mean Years of Impact.

Your choice of SCI is also significantly more optimistic than the figures that ACE or Lewis Bollard use. ACE seems to use a log-normal distribution with SCI 1.6 to 13 [2]. Using this in your model gives a bottom-line estimate of 16 (4.2 to 43) years of life affected per dollar. Simply using Bollard's estimate of 5 years (with no uncertainty) gives 14 (7.5 to 24) years of life affected.

You note above that you are estimating different things from both ACE and Bollard, as your counterfactual is for a world without undercover investigations. This does explain some of the discrepancy, but even so the estimates seem quite far apart. This suggests it's worth doing more research into the parameter and both your model and ACE's model should be more uncertain about it.

Additionally, I'd like to see reports like this contain a short display of which input parameters have the largest effect with the result. I think it can be the important information for seeing how robust the result is!


[1] The exact r^2 value changes on refresh and if I'm reading from the small graph or the large graph after hovering over, but it's consistently around 0.7-0.8. More simulation samples in would likely be necessary to compute the exact figure.

[2] The exact parameter ACE uses points to a link I don't have view permission for, but this distribution replicates the graph.

saulius @ 2019-07-23T19:10 (+7)

TL;DR: Nobody seems to know what the value of mean years of impact should be, and I don't see how this uncertainty could be reduced. I think that indirect effects are more important and it would be better to research them.

Good points and I'm happy you brought it up.

Firstly, I know you know this, but Lewis wrote that in his view, "the assumption that these campaigns only accelerated pledges by five years is very conservative." It makes sense to use a conservative value when doing a point estimate like he did. And I did use a similar value (4 years) in my conservative estimate in Appendix 1. ACE did not really describe their choice for the value so I didn't pay much attention to it. There's also Capriati (2018) which assumed that THL's cage-free and broiler campaigns moved policies forward by only one year (I just added the description. But this assumes that other organizations would have still done everything they did. And even then, I don't think it is reasonable.

To be honest, I think that nobody has a clue about what value to use here. Hence, everybody uses random conservative values in order for the end result to be more believable, because the estimated cost-effectiveness of campaigns is unbelievably high even with a conservative values. I did that to a degree as well. I asked some people who work on corporate campaigns what value would they use for mean years of impact. They thought that my range was reasonable, but I think they would have said that about many different ranges because it's difficult to think about. Only one person was able to say what range for mean years of impact would they use without looking at my range, and they said 40 to 100 years. If I weren't anchored by other estimates and didn't want to be a bit conservative to be more convincing to skeptics, I think I would have chosen a higher value as well, especially for the upper bound. In general, my impression is that all these "estimates" (including mine) are basically guesses that look more legitimate than they should because they are surrounded by neatly formatted text. We just can't predict the future.

I also don't see how to do more research on this topic. Perhaps seeing how long corporate commitments in other domains lasted could give a little bit information on that but only a little bit because situations are so different. If you have any ideas, I'd be interested to hear them.

But I'm uncertain if it's worthwhile to put more effort into cost-effectiveness estimates of corporate campaigns. I don't know what decisions depend on whether it's 7.5-24 years or 9-120 years. I think it would be more decision-relevant to research indirect effects, or in which regions corporate campaigns are more cost-effective, or how corporate campaigns compare with legislative campaigns for welfare reforms.

your model and ACE's model should be more uncertain about it.

I use a subjective confidence interval of 4 to 36 years with a log-normal distribution, so it's already very uncertain. Perhaps I should have used a flatter custom distribution, but after experimenting, it seems that it wouldn't change the answer much.

Additionally, I'd like to see reports like this contain a short display of which input parameters have the largest effect with the result. I think it can be the important information for seeing how robust the result is!

Interesting, I will consider it. Do you know of any report that I could use as an example of how to write such a thing?

John_Maxwell_IV @ 2019-07-09T04:08 (+11)

With regard to the follow-through rate... my assumption is that improving welfare will raise costs, and higher costs will cause customers to switch providers. Are you at all worried about companies that follow through going out of business?

I wonder if companies that follow through would be interested in sponsoring legislation that forces their competitors to also improve welfare? That could help solve this problem maybe?

In any case, this might be an argument for people interested in farm animal welfare to concentrate their efforts on improving welfare for one animal product in one country at a time. (Or, if you're acting as an individual, try to figure out which animal product is currently getting the most pressure from activists and add to that pressure through your individual actions.) If a particular market is an oligopoly, and all the firms in the oligopoly can be persuaded to raise welfare standards simultaneously, it seems like they face less risk of going out of business. (Note that what's important is the animal product, not the animal itself. My guess is that eggs are an easier target than chicken meat, for instance, because if you target chicken meat, people will probably substitute chicken meat with beef & pork to some degree as chicken prices rise, putting the chicken companies at risk. Additionally it might make sense to concentrate on particular industries, e.g. hotels, high-end restaurants, fast food restaurants, etc. Presumably McDonald's is more worried about being undercut by Burger King than Marriot. I think this could be considered a prisoner's dilemma for the companies from a game theory point of view, so ideally there is some enforcement mechanism for cooperation, i.e. contracts that companies sign such that they have to give their competitors $ if they don't follow through on their commitments. It might be worth studying the parallels to cartel formation in oligopolistic competition.)

Ramiro @ 2020-01-24T17:20 (+8)

I wonder if companies could be held liable for something like misleading advertisement in case of voluntarily failing to fulfill their commitments. I googled it a little bit; there's a growing concern about legally enforcing CSR commitments, but I still can't make my mind on this possibility (and its desirability: could it backfire?)


saulius @ 2019-07-10T17:27 (+5)

my assumption is that improving welfare will raise costs, and higher costs will cause customers to switch providers. Are you at all worried about companies that follow through going out of business?

The value of Mean years of impact is smaller because I considered companies going bankrupt, but I didn’t think about them being more likely to go bankrupt (or decrease their market share) because of commitments. Note that companies that don’t follow-through (or don’t commit in the first place) will eventually have to face campaigns from animal advocates, which also puts them at a disadvantage. It’s not like animal advocates stop once half of a country is using higher welfare products. However, if a period between campaigns against different competitors is long, this can be a concern. I haven’t heard of anyone complaining about this though.

I wonder if companies that follow-through would be interested in sponsoring legislation that forces their competitors to also improve welfare? That could help solve this problem maybe?

I actually asked someone about this. They said that companies that made commitments stop campaigning against such legislation, but they haven’t heard about food companies sponsoring such legislation. I imagine that it would only make sense for very big food companies and I’m unsure if any company is big enough.

In any case, this might be an argument for people interested in farm animal welfare to concentrate their efforts on improving welfare for one animal product in one country at a time.

Animal activists are focusing on one issue at the time and indeed, Bollard (2017a) claims that this as one of the primary reasons why corporate campaigns are so successful. But we have enough resources to do it in multiple countries at the same time. Also, animal advocates that live in different countries can’t all work on one country at a time, they are better at achieving success in their own country.

people will probably substitute chicken meat with beef & pork to some degree as chicken prices rise

Good point. One could argue that this still would be a win from an animal welfare perspective (although a smaller one) because chicken requires many more hours of suffering per calorie than beef or pork (see http://ethical.diet/) and because broilers arguably live in worse conditions. On the other hand, cows and pigs are more complex animals. Also, maybe some people would substitute chicken with fish, which could be even worse. Thinking about this also makes me less excited about campaigns/legislation against veal crates and gestation crates for pigs because they might increase the consumption of chicken. I don’t know how much these reforms increase prices though.

Additionally it might make sense to concentrate on particular industries, e.g., hotels, high-end restaurants, fast food restaurants, etc. Presumably, McDonald’s is more worried about being undercut by Burger King than Marriot.

Also a good point. I don’t know if animal advocates do that.

utilitarian01 @ 2019-07-08T19:21 (+11)

Even at worst that's still 4 years of suffering averted per $, insane cost-effectiveness.

Jross @ 2019-07-08T20:40 (+9)

Very impressive and comprehensive work! Thank you for doing all of this research and the clear and well organized write-up.

The years of life affected is a great number to have, but as you note, how positive the effects are is less clear.

That said, just based on the cost effectiveness, it seems that even small welfare increases from these commitments results in a lot of reduced direct suffering.

Vasco Grilo🔸 @ 2024-11-12T16:17 (+4)

Hi Saulius,

What are your current best guesses for the expected chicken-years improved per $ for broiler welfare and cage-free campaigns funded in 2024? Open Philanthropy thinks “the marginal FAW [farmed animal welfare] funding opportunity is ~1/5th as cost-effective as the average from Saulius’ analysis [this post]”, which suggests broiler welfare and cage-free campaigns improve 3.00 (= 15*1/5) and 10.8 chicken-year/$ (= 54*1/5).

saulius @ 2024-11-13T21:15 (+6)

Hey Vasco. I don't know. I don't have a birds eye view of the movement right now the way Open Philanthropy does. It depends on the region and the campaign a lot. I think I underestimated mean years of impact in this post which would balance things out a bit. I also never checked whether my guesses about implementation rates in this post are correct.

I imagine that a significant portion of work being done now is on ensuring that commitments are implemented. And any estimates the cost-effectiveness of implementation work are going to be a lot more subjective. Like we could show people graphs like this

and as if they look accurate (this graph is just for illustration purposes). But the people we'd be asking would probably mostly be the people working on these campaigns, which introduces bias.

It's not the first time you are asking about this. Perhaps you would be interested in creating a new cost-effectiveness estimate with my help? I've done multiple related projects and I have a bunch of theoretical thoughts on how to do a new estimate, but I don't want to do it by myself. Like it would involve asking many animal advocates for opinions which causes me a lot of social anxiety, even though everyone I talked to about these sorts of things seemed lovely and friendly. It's the sort of thing that I'd only consider doing if EA Animal Welfare Fund or Open Philanthropy funded it, because they would be the primary users of such research, and if they wouldn't want to pay for it, then it's probably not worth doing. But uh, even if they did, I'm still unsure if that would be the most action-guiding project. But just wanted to throw this idea out there in case you or someone else is interested.

Vasco Grilo🔸 @ 2024-11-14T14:19 (+2)

Thanks, Saulius!

But the people we'd be asking would probably mostly be the people working on these campaigns, which introduces bias.

Agreed. Ideally, one would use a less subjective methodology.

It's not the first time you are asking about this. Perhaps you would be interested in creating a new cost-effectiveness estimate with my help?

Ah, I was just asking because I will publish a quick cost-effectiveness effectiveness estimate of corporate campaigns for chicken welfare in the next few weeks, but I am currently not planning to start a longer project. Thanks anyway for throwing the idea out there!

Like it would involve asking many animal advocates for opinions which causes me a lot of social anxiety, even though everyone I talked to about these sorts of things seemed lovely and friendly.

Maybe running surveys would be a way of partially mitigating the social anxiety.

saulius @ 2024-11-15T07:16 (+4)

Great! Feel free to let me know if me reviewing your estimate would be useful, no worries if not :)

Vasco Grilo🔸 @ 2024-11-22T14:39 (+1)

Thanks for the offer, Saulius! Here is the draft.

Vasco Grilo🔸 @ 2024-11-29T16:36 (+1)

Published.

Peter Wildeford @ 2022-01-15T19:51 (+3)

Corporate campaigns have been a large part of the "effective animal advocacy" movement since they exploded in funding and effort in 2015. Given the prominence, it was strongly worth investigating whether corporate campaigns were worth the prior investment and - more importantly - would be worth the continued marginal investment into the future. This review established that corporate campaigns actually seem to have been a strong success.

I also think this post demonstrates a strong and thoughtful approach to cost-effectiveness estimation that served as a template for many later analyses.

I'm not exactly certain what changed within corporate campaign strategy as a result of this analysis but I do know that multiple organizations took notice of this analysis pretty seriously. Though mostly the post endorsed people continuing to do what they were doing and I think that's what happened.

I think some increased sensitivity and work to ensuring companies keep their pledges resulted from this work and from https://forum.effectivealtruism.org/posts/XdekdWJWkkhur9gvr/will-companies-meet-their-animal-welfare-commitments

Disclaimer: I am co-CEO at Rethink Priorities and supervised some of this work, but I am writing this review in a personal capacity as a personal reflection. I did not share this review with anyone at RP, so it's quite possible other people might disagree and I may be wrong here, so do not take this as an official RP position.

MichaelStJules @ 2019-09-07T23:56 (+3)
According to ballotpedia.org data cited above, about $25.7 million was spent on these initiatives in total. Since my estimated spending on cage-free campaigns is $36–$84 million, including costs associated with these initiatives would significantly increase the costs and reduce the estimated cost-effectiveness.

If you included their costs, wouldn't you also want to include their impacts? As you wrote earlier, it's probably best to analyze the cost-effectiveness of ballot initiatives separately.

saulius @ 2019-09-09T14:17 (+3)

You are right. I’ve just deleted the phrase “and reduce the estimated cost-effectiveness” from the article.

Also note that while I did exclude the costs of ballot initiatives in the main estimation, I did include their costs but not impact in a pessimistic estimation in Appendix 1. That’s because including the impact of ballot initiatives would have obscured the point I wanted to make in that appendix.

MichaelStJules @ 2019-09-07T22:22 (+3)
Despite this, based on conversations with some animal advocates, it seems likely that if animal advocates did no further actions to ensure compliance, only the most socially responsible companies would follow through because higher welfare broilers will probably be more expensive. Based on this, I created a custom probability distribution, with a mean value of 24%:
(...)
I expect the actual follow-through rate to be higher than this graph indicates because I expect animal advocates to do more work on ensuring compliance. However, this estimate assumes that they won't.

Tracking the progress towards broiler commitments is planned in the future though. See ChickenTrack.

Does your distribution assume ChickenTrack will be abandoned, or assume it will be used like EggTrack has been, or is uncertainty in this captured in the distribution?

There's also Chicken Watch, but I'm not sure if they'll be tracking actual progress towards pledges, or just the pledges themselves.

saulius @ 2019-09-09T14:31 (+3)

When making the distribution, I imagined that these projects would continue, despite the fact that I didn't include their future costs. However, if I recall correctly, until recently, there was only one employee working on EggTrack, so I don't expect these costs to be very high. Hence, I think that for the purpose of this very rough estimate, these future costs can be ignored. I think that this is outweighed by the fact that the estimate includes some of the costs, but none of the benefits of corporate campaigns that were ongoing as of the end of 2018.

Jamie_Harris @ 2019-07-20T08:56 (+3)

I'm a big fan of this report and will probably recommend it to interested people as the best of the cost-effectiveness models I have seen on corporate welfare commitments.

I'm very glad for the"Ways this estimate could be misleading" section. I think its very important to make these wider considerations clear; they have not been so clear in previous cost-effectiveness estimates. I also like that you make it clear how you think that these considerations weigh up with the pluses and minuses system.

It's great that this information on various uncertainties is included and yet you are still able to provide a useable estimate of cost-effectiveness (that excludes these indirect effects). I would probably lean towards making this result less prominent in the write-up, e.g. not including it in the title. I do think that, despite your clarity on the uncertainties, it is easy for readers to pick up and focus on the final estimate and then disregard the rest of the post.

saulius @ 2019-07-20T15:06 (+7)

Glad you liked it :) I added a sentence about indirect effects in the first paragraph. I see your point about the title but I chose to leave it as it is because:

  1. I think that people don’t expect cost-effectiveness estimates to take all the indirect effects into account anyway. That said, I am afraid of it being misinterpreted as an estimate of what an additional donated dollar would achieve.
  2. However, anyone who would make important decisions based on this estimate would hopefully read more than just the title anyway.
  3. I wanted to grab the attention of some EAs who would not consider helping welfare reforms otherwise (and hence wouldn’t open an article called “Cost-effectiveness estimate of corporate animal welfare campaigns”).
  4. I wanted the result to be prominently featured because I'd rather the common knowledge within EA would be "it affects 9-120 years per dollar but there are many complications and indirect effects" rather than "it's unclear what the cost-effectiveness is". The former at least let’s people compare the scale of the effects with other interventions.
  5. I don’t want to change the title now because it could confuse some forum readers into thinking this is a new article, and make the article more difficult to find for readers who remember the old title.
Vasco Grilo @ 2024-03-22T15:20 (+2)

Hi Saulius,

Do you know about any plans (from you or someone else) to publish an updated version of this analysis (e.g. maybe the analysis you did respecting the period from 2016 to 2020)? Corporate campaigns for chicken welfare are plausibly the most cost-effective way of increasing nearterm welfare, so I think it is important to have updated values which could be used as a benchmark to assess other interventions.

saulius @ 2024-03-22T16:55 (+4)

Also, perhaps it's a bit weird to use it as a benchmark because it's the consumers who pay most of the cost for chicken welfare reforms (and, to a lesser extent, farmers, retailers, and sometimes governments). So the comparison with something like AMF is not very clean. Corporate campaigns are a bit more similar to lobbying governments to distribute bednets. Ugh, I notice that I'm a bit confused about this right now.

Vasco Grilo @ 2024-03-23T11:07 (+3)

Nice point. I suspect your confusion comes from wondering whether the cost to the consumers and others should be considered as part of the cost or harms of the intervention. My understanding is that cost-effectiveness analyses only include in the cost of the intervention money coming from the people making the decision about whether to fund the intervention, so I would consider the cost to the consumers as part of the harms of the intervention. I also believe this would only minorly decrease the cost-effectiveness:

  • I would say the benefits to the chickens are way larger than the harms linked to having to buy marginally more expenside chicken meat and eggs (or no longer being able to buy these).
  • I assume there may also be beneficial health and economic effects to humans due to decreased consumption of chicken meat and eggs, depending on what foods are consumed instead.
saulius @ 2024-03-22T16:53 (+4)

I'd say there's about 30% probability I will do it in the next two years. I've just started a project for Open Philanthropy about estimating what should be the speed-up values in cost-effectiveness estimates for corporate and legislative welfare reforms, as that is the most uncertain aspect of these estimates. Open Philanthropy is the main target audience for this type of stuff and I don't think that putting the rest of the numbers together for a cost-effectiveness estimate would influence them much. I'm unsure if another cost-effectiveness estimate is what's needed to finally attract other large-scale donors to fund welfare reforms. People who care about cost-effectiveness have gotten the message I think. A new estimate would probably output a similar number because reforms have probably gotten less effective, but I now think that I underestimated cost-effectiveness in this report.

Vasco Grilo @ 2024-03-22T21:24 (+4)

Thanks for the reply!

I've just started a project for Open Philanthropy about estimating what should be the speed-up values in cost-effectiveness estimates for corporate and legislative welfare reforms, as that is the most uncertain aspect of these estimates.

Cool! I am looking forward to the results.

I'm unsure if another cost-effectiveness estimate is what's needed to finally attract other large-scale donors to fund welfare reforms.

I was thinking that it could still be useful to inform Open Philanthropy's allocation between animal and human welfare interventions in their global health and wellbeing portfolio.

MichaelStJules @ 2019-09-07T17:31 (+1)

Do you think the follow-through rate, mean years of impact or average lifespan and number of chickens might differ substantially in predictable ways based on company characteristics? E.g. are larger companies or fast-food chains more or less likely to follow through than smaller companies or other types of companies? Do you think this would have much impact on your estimate?

I have some intuitions going both ways here. I'd expect it to be more difficult for larger companies to make proportional (rather than absolute) progress because they require more chicken meat or eggs, and consumers might be more willing to look the other way if they fail because of their popularity, but the bad PR could also mean a huge loss, too. Is there a broad perception that McDonalds is basically pretty evil? How much do people actually care, given how popular it remains?

Charity Entrepreneurship did some analysis on cage-free progress, broken down for a few companies in EggTrack: https://forum.effectivealtruism.org/posts/WvgrGLDBko6rZ5qax/did-corporate-campaigns-in-the-us-have-any-counterfactual

saulius @ 2019-09-09T14:53 (+3)

I do think that the follow-through rate for different sectors and countries will be predictably different. I don't think that making a more detailed model to take this into account would have much impact on the final result.