Request for Feedback: Researching global poverty interventions with the intention of founding a charity.

By Denise_Melchin @ 2015-05-06T10:22 (+19)

I intend to initiate a project that looks for highly effective global poverty interventions that are not currently being carried out. The aim of this research is to be able to found a charity that is good enough to be recommended by GiveWell.

Please criticise this idea.

We think it is a good idea to check whether the EA community sees problems with this idea. Many eyes see more than a dozen. We want this idea to be thrown away if it’s not good or improved if it is improve-worthy. Please criticise it if you feel that the idea of founding a charity is not great, or if you think our plan to get there (set out in the rest of this post) is not great, then criticise that.

The idea:

Sam Hilton, some others and I have recently expressed interest in founding a charity that is good enough to be recommended by GW.

Our reasons:

We think that this project has high expected utility.

There is a small chance that we could find a highly effective intervention and could create a charity that is better than any of the existing top recommended GW charities.

More likely we think that as the EA community grows then the room for more funding for GiveWell's current top recommended charities will shrink. Even if it is relatively easy for GiveWell's current top charities to expand to other countries and they may find that the effectiveness of their interventions is lower in those countries. (Details on SCI’s funding gap can be found here. AMF has previously lost its top spot due to limited room for more funding. We are assuming that GiveDirectly has a larger room for funding but is slightly less effective than AMF and SCI and DtW.)

We recognise the existence of organisations that scale up effective interventions, such as Evidence Action, but believe that there is a benefit to even more work in this area.

Step one – research:

We want some research into which global poverty interventions are potentially highly promising. We want to look for interventions that have some evidence behind them but where there is no charity working in this area (or no good effectiveness focused charity in that area, or no charity solely in that area).

We want to compile a public list of promising interventions. This list should be a tool that anyone keen to start a global poverty charity can look at and choose an intervention to start. It should list promising global poverty interventions some analysis and comparison of the different ideas. It should include both promising ideas that could be better than GW’s top recommended charities, as well as a no-go list of promising sounding ideas that can be dismissed as not worth starting following some initial research.

We envisage the process of generating ideas to fill out the list to be primarily through talking to existing research organisations in this area (beginning with GiveWell and including GW, GWWC, JPAL, IPA, DCP, Evidence Action, Centre for Global Development, Copenhagen Consensus, and so on) and asking if they have come across any promising high impact interventions.

Once a list of intervention ideas is compiled the next step would be to do further analysis of each intervention. This could be carried out by talking to the aforementioned organisations again in more detail, talking to experts in the fields and doing literature reviews.

We are currently looking to provide funding for GWWC to take on an intern to do this research.

Step two – more research:

The list is complete, so we choose an intervention to start. If the intervention is not currently supported by a large body of research then we want to fund/carry out a randomized controlled trial to test whether it’s worth pursuing this intervention.

Step three – found a new charity

How hard can it be ...?

So before you close this page, give us your feedback, even if it is just a score out of 10 in the comments below for how much you like this idea. We would appreciate it. It would take you only 30 seconds. ;-) If, rather than in the comments below, you would rather provide feedback privately and/or anonymously then you can do so using this feedback form.

If you want to take a look at our (slightly chaotic) notes, you can do so here.


undefined @ 2015-05-08T17:55 (+6)

Hi Denise,

I'm keen for more people to try this. It does seem like there's a real gap here - there's funders who will fund if you meet clear criteria but few people (it seems) explicitly trying to make them. GiveWell has said as much before.

http://blog.givewell.org/2013/03/21/trying-and-failing-to-find-more-funding-gaps-for-delivering-proven-cost-effective-interventions/

We wrote about it on 80,000 Hours here:

https://80000hours.org/career-guide/top-careers/profiles/founding-effective-global-poverty-non-profits/

A few notes:

More comments:

It's harder than it looks because when interventions are clearly proven, they're often implemented by government's instead. Small charities like SCI need to "get in" when the evidence is emerging but not settled, hoping to accelerate the time when the intervention is fully tested then scaled by governments. This means it's a difficult judgement call about which interventions to focus on. I think this is why usually GiveWell charities have been founded by experts in their areas (with the exception of AMF) - these were the people able to see the gaps and execute them ahead of others. If this is true, then the first step might be to go and get a Masters in development economics.

It also seems like it's very hard to run these types of charities and convince others to give you money. The leaders of all the GiveWell recommended charities usually strike me as extremely able. GiveDirectly were Economics PhDs at MIT and Harvard; Alan Fenwick is an Professor; Rob Mather was a successful consultant, and so on. With the aid of the EA community, it may be easier to succeed than in the past, but I'm not sure.

I'm really interested in any progress you make on this project, so please keep me in the loop. In particular, if you prepare a list of interventions or form a group of people interested in doing this, I'd happily add it to our career profile.

Best,

Ben

undefined @ 2015-06-26T07:58 (+5)

Hi all,

we've put this on hold for now.

After talking to GiveWell, they have decided to take it on themselves. :-)

We'll check back when they are done with their research and look whether there's anything we'd still like to add, but this will take at least a few months.

undefined @ 2015-06-26T08:46 (+1)

Good outcome!

undefined @ 2015-05-06T13:26 (+4)

Slow Thoughts:

One of the easiest things would be a charity using already tested effective methods but in different locations. For example GiveDirectly works in Kenya and Uganda, but I don't think they have projects in India and Nigeria where there are larger populations and potentially more chance to scale up and influence policy.

It may also help to have competition for the effective charities rather than just saying there is only one for each cause whether that be cash transfers, malaria, SCI.

undefined @ 2015-05-06T16:02 (+4)

One of the easiest things would be a charity using already tested effective methods but in different locations. For example GiveDirectly works in Kenya and Uganda, but I don't think they have projects in India and Nigeria where there are larger populations and potentially more chance to scale up and influence policy.

This is largely because Kenya and Uganda have much, much better mobile money systems than India or Nigeria. Overhead in the latter two countries would be significantly higher.

undefined @ 2015-05-06T19:17 (+3)

+1 to the importance of geography. The deworming RCTs, though highly effective, were location-dependent. I imagine the same goes for other interventions for global poverty/global health.

Peter McIntyre @ 2015-05-06T23:19 (+3)

Thanks for posting this. I think explicitly asking for critical feedback is very useful.

If the intervention is not currently supported by a large body of research then we want to fund/carry out a randomized controlled trial to test whether it’s worth pursuing this intervention.

RCTs are seriously expensive, would take years to get meaningful data, would need to be replicated as well before you could put much faith in it, and it wouldn't align with the core skillset I'd imagine you'd need to be starting an organisation (so you'd need to outsource it, which would increase the costs even more). As Ryan said, it might be more useful to useful to aim to be recommended by OPP, or search for another kind of EA market inefficiency. Your other ideas of finding supportable but neglected interventions and doing them sounds pretty useful though.

undefined @ 2015-05-26T15:15 (+1)

Thank you for pointing this out. I had expected them to be a lot cheaper. If GiveWell, as Ben said, has decided against funding RCTs, I'm not very likely to be convinced of their usefulness either.

undefined @ 2015-05-13T14:26 (+1)

But all those costs of RCTs are clearly worth it. Expensive? If your intervention is vaguely promising then EAs will throw enough money at you to get started. Time? Better get started now. Replication? More cost, EAs will fund. Outsource? Higher quality, EAs will fund.

undefined @ 2015-05-14T22:43 (+3)

I think GiveWell has considered funding RCTs for promising interventions and decided against it. They easily cost millions of dollars, take several years, and the evidence provided is often quite weak. Best to focus on the existing evidence-base from academia first, then move on to new RCTs when that's all exhausted (ideally through partnerships with academics, which I think is what DMI did).

undefined @ 2015-05-06T10:45 (+3)

Quick thoughts:

I see two gaps that you might be addressing:

(1) The interventions with the highest potential aren't the ones which get properly evaluated by RCTs (or there isn't enough of this).

(2) The interventions with very good evidence from RCTs aren't implemented by charities or aren't scaled up appropriately.

I'm not certain whether either of these is a genuine gap, but they could be very valuable to address if they are. I'd love to see attention on figuring that out and choosing what to work on accordingly.

undefined @ 2015-05-06T17:57 (+4)

There are already mechanisms working at each stage of this process. Trying to improve the system at one of these points sounds valuable. I have initial concerns about over-reach in trying to do all of it at once.

One of the mechanisms working at one stage of this process is "people start charities because they learn about an under-implemented effective intervention." You can "improve the system" by having there be more people who do this, i.e. by being one of those people. This isn't doing a bunch of things at once, this is being one of the stages in the process.

(2) The interventions with very good evidence from RCTs aren't implemented by charities or aren't scaled up appropriately.

It's pretty clear that this is true; for instance, GiveWell has a number of priority interventions that they do not currently recommend any charities in.

undefined @ 2015-05-06T19:51 (+1)

One of the mechanisms working at one stage of this process is "people start charities because they learn about an under-implemented effective intervention." You can "improve the system" by having there be more people who do this, i.e. by being one of those people. This isn't doing a bunch of things at once, this is being one of the stages in the process.

Absolutely agree with this -- this was the major method of improving the system I had in mind (perhaps could have stood to be clearer about that).

It's pretty clear that this is true; for instance, GiveWell has a number of priority interventions that they do not currently recommend any charities in.

I think this is a helpful data point but it doesn't follow from this. GiveWell has had finite resources and has only been able to evaluate a certain number of charities. Additionally they have (with good reasons) strong desires for transparency in charities that they recommend. Both of these mean that there is quite a space of possibility for these interventions to be well-executed and scaled by existing charities. However, I'd ask GiveWell!

undefined @ 2015-05-06T17:55 (+1)

No obligation to explain, but I'd love to know the reason for the downvote. I think downvotes are a useful source of feedback, and usually when I get one if I re-read my comment I can make an educated guess why. Here I'm not sure!

undefined @ 2015-05-07T03:53 (+1)

Your comment now seems to be at 100% positive, so maybe they downvoted you by accident and subsequently reversed it.

undefined @ 2015-05-07T23:08 (+2)

I think that many EA's could be interested in volunteering on this type of project especially in step 1 & 2. Although coordinating a large amount of volunteers is likely to be quite time consuming.

undefined @ 2015-05-26T15:25 (+1)

We considered this as well, but ultimately decided that it would be easier for one person to dig into this issue deeply than many more shallowly.

undefined @ 2015-05-06T11:06 (+2)

My immediate thoughts:

undefined @ 2015-05-06T17:58 (+5)

GiveWell's research is on their intervention reports page. Notably, they have a few reports on interventions which state "promising evidence of effectiveness" but no top charity implements them. You might be able to contact GW for more info on what organizations they wish existed, or what gaps they see.

undefined @ 2015-06-23T03:56 (+1)

I've been thinking about this for some time, and decided to make an account to post this idea I have. I'd like to hear what the rest of the community thinks before I invest more in this:

Posttraumatic mental illness happens in the ‘developing world’ such as in Jamkhed, a rural community with arguably the best health infrastructure in the ‘rural world’, but effective criminal justice reform](http://www.givewell.org/labs/causes/criminal-justice-reform) is a hard problem and (humanitarian posttraumatic support is complicated by paternalistic traditional practices.

However, evidence-based treatment guidelines are available and though some resources are available for post-conflict conditions, there are no known efforts for provision of post-traumatic services to service communities outside of the West where there are high rates of domestic violence and crime PTSD.

The purpose of Posttraumatic Outreach ('PO') is to start a effective non-profits this gap, starting by piloting the provision of provide cost-effective, widely available psychoeducational material to promote self-directed posttraumatic treatment for rural communities in Jamkhed.

The design of the self-administered TF-CBT handbook is to help victimisable populations vanguard or intervene in their own and the members of their community’s post-traumatic mental health.

If you are interested in getting involved please say so! We will operate independently of any other organisation and are organised solely at this place of posting at the time of writing. I can also be contacted privately on posttraumaticoutreach@gmail.com and at the time of writing, there is no one else working on this.

I am particularly interested in critiques on whether this project is a worthwhile direction of EA efforts relative to other projects, particularly those on impact.io

Thanks! Oh, in case you don't know: Trauma-Focused Cognitive Behavioral Therapy (TF-CBT) for psychopathology

undefined @ 2015-05-09T08:58 (+1)

Sorry for not having responded to any of this yet, will take me another couple of days at least.