Vote Pairing is a Cost-Effective Political Intervention

By Ben_West🔸 @ 2017-02-26T13:54 (+19)

Summary

Vote pairing is a practice whereby individuals agree to swap votes. Wikipedia summarizes it as:

In United States presidential elections, vote pairing usually comes in the form of voters from "safe" states, or non-swing states, voting for third-party candidates, and voters from swing states voting for their second-preference candidate. This form of vote pairing encourages third-party support while minimizing the risk that the more favored major-party candidate will lose electoral votes in the nationwide election (i.e., the "spoiler effect"). In the 2016 United States presidential election, this has usually manifested in the form of supporters in swing states of Libertarian candidate Gary Johnson and Green Party candidate Jill Stein swapping votes with supporters in blue states of Democratic candidate Hillary Clinton.

The practice’s legality has been upheld by the Ninth Circuit Court of Appeals, and large numbers of swaps occurred during the 2000 and 2016 elections.

Tens of thousands of people have participated in swaps, but I am not aware of any estimates of the cost effectiveness of this practice. This post provides information on the cost effectiveness, based on my work with a vote pairing website, Make Mine Count (MMC).

Note: for simplicity, this article talks about how to increase the number of votes to a major party candidate via vote pairing, but it does not consider the value of that increase. In 2016 vote pairing helped the Democrats, but I expect that the effectiveness should be similar if/when the tables are turned and vote pairing benefits Republicans.

Rather than talking about “Candidate A” and “Candidate B” I use the names “Clinton” and “Trump”, but this article should not be construed as arguing whether Clinton or Trump was a better candidate.

Key Results

• I personally averaged ~10 swing state voters per hour of work, which is 30 times more effective than going door to door.

• I estimate that MMC increased Hillary Clinton’s chance of winning by about one in 210,000. (For comparison purposes, the average voter has a one in 60 million chance of changing the election outcome.) If other vote pairing websites had similar success rates, in aggregate vote pairing increased Clinton’s chance of winning by one in 15,000.

• The site overall averaged ~2 swing state voters per hour of work, which is 6 times more effective than going door to door.

• Vote pairing could plausibly have changed the outcome of the 2000 US presidential election, if pairing had happened in 2000 at the same rate that it happened in 2016.

• Vote pairing seems to be more cost-effective than making calls, going door to door, or other standard forms of changing election outcomes, provided you are in the very special circumstances which make it effective.

In this article, I discuss the benefits that MMC provided, estimates of the cost, estimates of what my counterfactual impact was, and guidance on what we should have done better.

Overview of Make Mine Count

I became interested in vote trading several months before the 2016 US presidential election. At the time there were two major vote pairing platforms: Make Mine Count and #NeverTrump.² I volunteered my time over a couple months to make improvements to the MMC platform.

The platform worked as follows: users would sign up, listing their state and candidate preference. Clinton voters in safe states would be paired with third-party voters in swing states, and they would be connected through a secure, private messaging system. After being connected, they would message each other to ensure that both wanted to be paired, after which they would each vote for the other’s candidate.

Results

Out of the 2319 people who created an account, 610 were matched and I estimate that a total of 132 votes were cast for Clinton in swing states.

This breaks down as follows:

• 2,319 users created an account

• Of these, 153 were Clinton voters in swing states and 507 were non-Clinton voters in safe states, making them ineligible to be paired. This leaves 1,659 users who were eligible for a match.

• Of these, 600 were matched. This was due to a surplus of Clinton voters in safe states (more on this later)

• Of that 600, 472 sent or received at least one message, and 362 sent and received one message. Presumably some fraction of people who didn’t message each other still went through with the swap (e.g. because they called each other instead of using the messaging feature), but I think this is small and will assume that only these 362 considered having a swap.

• From a random sampling of 100 anonymized messages, approximately 86% of people who signed up were interested in actually going through with the swap. Most of the 14% who signed up but did not want to use the platform were people who had signed up but forgotten about it, and early voted, making them ineligible to swap. In my sample of 100, there were also 2 people who did not seem to understand the platform (they used it to try to convince their match to vote for Jill Stein instead of swapping) and 1 person who was a Trump troll (promised to swap but reneged). There were also a few who signed up as third-party supporters, but decided to vote for Clinton.

• A swap needs both parties to be interested, and therefore .862 = 73% of matches resulted in a swap.

• This leaves us with an estimated 264 legitimate swaps, of which half were votes for Clinton, i.e. 132 votes for Clinton in a swing state were cast as a result of the MMC platform.

Additionally, because MMC had a surplus of Clinton voters, we sent these voters a recommendation to use a different site (Trump Traders (TT)) which had a surplus of third-party voters. 75 of these users made a TT account and, since these users were highly motivated, a large fraction of them presumably went through with a swap, but I do not have access to that data. [TT did not return my request to share data for this article.]

Impact Analysis

Because of the nuances of the Electoral College, votes in some states are much more likely to swing the election than others. FiveThirtyEight compiled a “voter power index” (VPI), which compares the relative power of the vote. A VPI of 1 means that a voter in that state has an average chance of swinging the election (~1 in 60 million). A VPI of 2 means that a voter in that state has twice the average chance (~2 in 60 million) etc.

The VPI of each state fluctuated throughout the campaign, and for simplicity I used the most recent numbers (calculated November 7, 2016). Obviously, vote pairing is more valuable when the campaign is close and less valuable when it’s a sure thing, so depending on which numbers you use and when you calculated those numbers, you will get different estimated impacts. I also assumed independence (i.e. one voter with a VPI of 2 is as good as two voters with a VPI of 1) – this is slightly untrue, but I don’t think it makes a big difference at the scales I am talking about in this document.

The total impact was 4.7e-6 ~= one in 210,000. Another website (Trump Traders) advertised 45,000 users but was only two-thirds as effective on a per-user basis as MMC.⁴ If they had success rates similar to ours, they would’ve influenced Clinton’s chances by about one in 16,000.⁵ I was not able to find numbers for #NeverTrump, but it seems plausible that all the sites combined increased Clinton’s odds by about one in 15,000.

Costs

• Steve, the primary developer of MMC, estimates that he spent 40 hours writing code and an additional 40 hours thinking about the site.

• Steve spent $310 for hosting and miscellaneous costs.

• Two separate groups bought ads for MMC for $500 each

• I spent seven hours of my time working on the MMC site.

The total cost was 50-90 hours of labor plus $1,310 in hard costs.

Counterfactual impact

It seems unlikely that very many people would have paired with someone on their own, without a vote pairing site existing. Therefore, the counterfactual is mostly about what fraction of these people would have otherwise used a different site.

Counterfactuals are always very hard, but we can create some bounds:

• Of the ~800 unmatched Clinton voters we emailed recommending that they sign up for TT, 75 did. They would not have signed up for TT if they had already signed up for another site, so at least 10% of the votes were counterfactually valid.

• Of the 100 users I examined, only one said that they had signed up for another site and were therefore not going through with the swap. This gives an upper bound of 99%.

My guess is that it’s more towards the upper side (10% is a very high click through rate for any email).

Personal Counterfactual Impact

“I am not a member of any organized party – I am a Democrat” – Will Rogers

One general problem I found is that people wanted to create their own vote pairing websites instead of working together – this is obviously inefficient due to the network effects required for vote pairing to work, but I wasn’t able to make that argument successfully.

There were 4 vote pairing websites I had some contact with, but the only time I was ever able to successfully convince people to not duplicate work was when I sent some of our (MMC) users to a different site. (No one seemed interested in “sharing” in the true sense of the word. Neither Trump Traders nor #NeverTrump responded to my request to share data for this article, for example.)

In terms of things I personally can claim credit for:

1. Created Facebook integration for the site, and some general site cleanliness stuff (e.g. the social media “share” buttons did not work when I first started). 36 votes were using Facebook integration, and Facebook was the vast majority of our user traffic (70%). I will give myself 25% of the 132 MMC Clinton votes for this (= 33 Clinton swing state votes).

2. Coordinated referring voters from MMC to TT. It seems extremely unlikely to me that anyone else would’ve done this if I had not, and therefore I will give myself all of the 75 referred people (= 37 Clinton swing state votes [TT paired 2 Clinton voters with every third-party voter]).

3. I posted on my Facebook, which got 3 accounts in TT (= 2 Clinton swing state votes)

This implies that I got 72 Clinton votes with my 7 hours of work. This is incredibly high – 20-30 times higher than “traditional” outreach like going door-to-door (which I also did).⁶

Note that almost all of this impact is due to the fact that I was willing to join someone else’s project instead of starting my own. Starting a new vote pairing website is inherently much less cost-effective because of the setup costs and time and the fact that it is splitting apart the voter pool, making it more difficult for people to be matched.

Linchuan’s impact

As an example of what a small amount of highly targeted advertising can do, Linchuan Zhang posted on his Facebook that Trump Traders needed more Clinton voters, and that one post resulted in 24 TT accounts (= 12 Clinton swing state votes). It probably took him less than 15 minutes to write this post, which means that it was about 100 times as productive as going door-to-door.

Things to do differently

1. There was a ton of unnecessary and duplicated work because so many people decided to create their own products instead of working together. I’m not sure how to solve this.

2. We decided to wait until close to the election in order to match people up so that we could accurately determine which states were “in play”. This resulted in a lot of people forgetting that they had signed up (or assuming the site didn’t work). We should have had more frequent touch points, or matched people sooner.

3. Many people seem to be concerned about fraud (i.e. someone would promise to trade with them but would secretly vote for Trump). This isn’t a very legitimate concern – the entire premise of vote pairing is that Clinton votes in blue states are worthless, so Trump advocates would have nothing to gain by doing this⁷ – but I would guess that it turned a significant number of people off the idea. We should have done a better job of countering this claim.

4. I did not invest very much time into promoting the site, largely because I was unclear about how effective it would be. I think I probably could have gotten on local news or other media if I had really tried. Fortunately, now that this document exists (and if it’s shared widely), people working on vote pairing in 2020 will better understand its effectiveness.

Summary

In the 2000 presidential election, Gore lost Florida by 537 votes. More than 5000 votes were swapped in Florida alone in the 2016 election,⁸ indicating that the outcome of the 2000 presidential election could reasonably have been changed if vote pairing happened in 2000 at the same rate that it happened in 2016.

Vote pairing seems to “punch above its weight” in terms of effectiveness, but will only be useful when there are large numbers of people who want to vote for a third-party candidate. Furthermore, creating a new vote pairing site from scratch is likely to be much less effective than the numbers listed here, and is possibly less effective than traditional GOTV activities.

If the 2020 election is as high-stakes as the 2016 one, and I am similarly positioned to how I was in 2016, I will very likely work on voter pairing again.

Acknowledgments

I would like to thank Steve Hull for creating MMC, open-sourcing it and sharing anonymized data; Linchuan Zhang for talking about the election and vote pairing with me; the Trump Traders team for accepting referred users and sharing conversion rates; Rob Wiblin, Gina Stuessy and Linchuan Zhang  for reading drafts of this article; and Rob Wiblin for the general motivation for becoming involved in the campaign.

Footnotes

1. https://www.stat.berkeley.edu/~aldous/157/Papers/vote.pdf
2. Several other sites, like Balanced Rebellion and VotePact existed, but these were focused on electing third-party candidates
3. The observant reader will note that some of these states have a VPI less than 1, which indicates that they probably should not have been swapped. We used Princeton Election Consortium data to determine swing states which, in retrospect, was a bad idea. The inaccuracy of these forecasts led to PEC’s creator eating a bug on live TV.
4. They matched 2 Clinton voters to one third party voter
5. (45,000/2,319)*(2/3)/(210,000)
6. See this table from Get Out The Vote. I personally was able to contact many fewer people per hour than GOTV claims is average when going door to door or calling people (meaning that vote pairing was even more cost-effective in comparison).
7. A Trump advocate might be able to get some benefit by lying, because they would prevent a legitimate pair from happening, but this is not a reason to not sign up because the worst case scenario is exactly the same as the scenario under which you don’t sign up (i.e. the swap is wasted)
8. https://www.facebook.com/trumptraders/photos/a.750408771766492.1073741828.742762899197746/757681704372532/?type=3&theater