Which EA organisations' research has been useful to you?
By weeatquince @ 2020-11-11T09:39 (+33)
I am trying to decide where to donate this year. I am mostly interested in funding cause prioritisation research. I am not sure how best to evaluate the EA research organisations that are out there. As someone who is at the frontline of trying to turn EA ideas into policy change I have my own thoughts on what research I have found most useful (will share in the answers section below). And so I thought it might be useful to ask others for their views on which research is most used.
So curious to know:
Which EA organisations' research has been useful to you?
Note: For the sake of simplicity:
- I am not that interested in if folk have used 80000 Hours's research for career decisions or GiveWell's or Animal Charity Evaluator's research for donation decisions, etc. [Edit: but if you have used other research for career or donation decisions do share]
- I have asked about "EA organisations" specifically (although if other orgs do good research too feel free to flag it)
- I am looking for positive stories (Negative comments, Eg: I read all their research and it was no use, are acceptable but not the main aim)
I sometimes worry that the feedback loop from do useful research all the way down to see a significant change in the world is very long and opaque. If people have general thoughts on this feedback loop or on evaluating research organisations do share.
Also this may be a nice way to signpost particularly useful pieces of research.
MichaelStJules @ 2020-11-13T21:17 (+19)
For donation decisions last year, especially for corporate campaigns for animal welfare, ACE, Founders Pledge, Rethink Priorities, Charity Entrepreneurship and Open Phil. I wrote up my donation plan last year here (which I ended up following pretty closely).
For career decisions, all of the above and also Humane League Labs. I'm currently an animal welfare research intern at Charity Entrepreneurship, I'm working on an econ project for them, I applied for positions/internships at some of the other orgs, and am studying econometrics. I think I'm most interested in doing research similar to HLL (and this and this), i.e. rigorous intervention research. I discussed my plans a bit here, too.
I also think Rethink Priorities' research on sentience and moral weight is important, I hope to see more research in this direction, and their sentience research was a factor in my donating to them last year. I take invertebrate welfare more seriously now and I'm slightly more careful with them when I encounter them in my daily life, but this hasn't really affected any other important decisions yet. Seeing this research, CRS's and GPI's has also gotten me thinking more about doing a PhD in philosophy (or economics), although I'd rather start working at an EA org instead, and I'm still pretty set on more applied econ/stats animal welfare research for now.
If you're interested in funding research like Charity Entrepreneurship has done, besides them, also consider their incubated charities. I think Animal Ask Institute will do research similar to Rethink Priorities' and Charity Entrepreneurship's animal welfare research.
When I asked, I was told you can also earmark donations to THL for Humane League Labs, but only donations over USD $15K. Maybe you can pool with others.
weeatquince @ 2020-11-11T09:42 (+18)
What I use research for: I advocate for Future Generations policy within the UK Parliament. This involves using cause priotisation research to decide where to focus my time and attention and using research on policy and governance to decide what to advocate for.
Most useful:
- CSER: Overall CSER do more UK / EU policy related research work than other EA long-termism groups. Eg: on longterm policy making, on risk prevention policy, on defence procurement and AI. Also generally good to talk to on policy matters. Note I may be bias as I am a CSER Research Affiliate.
Next most useful:
- FHI: Work relevant to biosecurity policy like this. Some stuff on risk prevention eg The Precipice book and this survey.
Honourable mentions:
- Global Priorities Project: this summary paper on x-risks
- AllFed: this paper on food risks
- OpenPhil: this and this table on policy priorities
- EA Forum: general useful tool for feedback and new ideas.
- Useful background newsletters from CSET, on EuropeanAI and the x-risk.net newsletter (which led me to this interesting paper on Existential security)
Not as known in EA but a shout outs are deserved to:
- The Institute for Government
- Roman Krznaric’s book The Good Ancestor
- The School of International Futures
- The Society for Decision Making Under Deep Uncertainty.
MichaelStJules @ 2020-11-13T05:08 (+10)
How do you define "useful" if you're excluding impacts on both donation and career decisions? It seems like all that's left is what particular problems you work on directly, to the exclusion of career decisions. Like someone is already doing research or direct work, and their priotities are informed by research? E.g. animal charities deemphasized leafleting, 80,000 Hours shifted focus to longtermism, Rethink Priorities' research on sentience and moral weight builds on existing research, etc.. Maybe someone set on founding a new EA charity decides which to start based on research (like Charity Entrepreneurship's), or is that a career decisions?
weeatquince @ 2020-11-13T09:05 (+4)
Hi Michael.
No I am super interested in what research has guided peoples' career decisions and donation decisions.
I just thought for simplicity that not worth having lots of people say "80K affected my career decisions" as I think there is already very good evidence of this, or having lots of people say that "GiveWell affected my donation decisions" as there is similarly good evidence for this. But if GiveWell research (or any non career org) affected your career decisions or if say Open Philanthropy research (or any non charity evaluator) affected your donation decisions then I am keen to hear it.
Added an edit for clarity. Thank you for the question.
BrianTan @ 2020-11-17T15:08 (+9)
I have found Charity Entrepreneurship's research useful for identifying high-impact charity ideas that people in the Philippines could potentially start. Their top charity ideas and cause area research also help me identify and research potentially pressing problems in the Philippines that people could contribute to.
Founders Pledge's research is also useful, and I especially like their climate change and mental health reports. I believe both charities still have room for more funding.
MichaelA @ 2020-11-24T00:33 (+7)
I sometimes worry that the feedback loop from do useful research all the way down to see a significant change in the world is very long and opaque. If people have general thoughts on this feedback loop or on evaluating research organisations do share.
Here are some posts I've found useful in relation to that or similar matters:
- Do research organisations make theory of change diagrams? Should they? (and the answers and comments there)
- Rethink Priorities Impact Survey
- Should surveys about the quality/impact of research outputs be more common?
- (this is one I wrote, rather than one I "found useful", though I found the process of thinking and writing about this topic useful)
- Can we intentionally improve the world? Planners vs. Hayekians
- AI Governance: Opportunity and Theory of Impact
Also relevant, but a bit more tangentially:
- Rethink Priorities 2019 Impact and Strategy
- Identifying Plausible Paths to Impact and their Strategic Implications
- Effective Altruism Foundation: Plans for 2020
weeatquince @ 2020-11-25T10:26 (+11)
Thank you all super interesting reading.
FWIW as a donor I would be very wary of giving to a research organisation without a theory of change and/or strategic plan and an idea of how to measure impact (surveys or otherwise). Someone saying such work was not needed would be a massive red flag to me. Like if a global health charity says we don’t need to measure impact we know we are doing good – maybe that global health charity is the most effective global health charity in the world but it is not going to be able to convince me of that fact.
MichaelA @ 2020-11-25T12:23 (+6)
I'd also be wary of that, and I tentatively think that many research orgs should probably move towards doing more explicit thinking about their theory of change / strategic plan and impact/progress assessment, and providing somewhat more public info about this. (The fact and way that Rethink Priorities does this stuff was one of the things that made me excited about getting a job with them [though this comment is just my personal opinion, as with most/all of my comments].)
That said, I get the impression that your version of these stances might be a bit stronger than mine, or a bit different.
One thing that feels worth stating explicitly is that me not having seen an org's theory of change / strategic plan / approach to impact assessment doesn't necessarily mean they don't have these things. They might have fair reasons for not making these things public.
And I'm also potentially ok with an org not having explicitly written these things down, if they've had thorough discussions, have a shared understanding, regularly check in about these things, etc. (This might apply especially to smaller and newer orgs.)
(I'm not sure whether you'd disagree with these things - they just felt worth stating explicitly. I'm also uncertain about my views on these matters, and want to think more about them over the coming year.)
weeatquince @ 2020-11-13T09:18 (+7)
UPDATE COMMENT:
I am currently leaning towards donating to somewhere like Charity Entrepreneurship where there is a clear path from research to real world output. I am sure the academic research has real world implications but I find it hard to judge this mechanism, and there is a limit to how much capacity I have to investigate that topic.
Alternatively, given that I have such limits to my capacity for donation decisions I may just donate to the EA Infrastructure Fund.
I would be persuaded to donate elsewhere if this post, or other steps I take to investigate this topic, shows that the work of EA aligned research organisations was leading to real world outcomes.
Peter_Hurford @ 2020-11-16T23:50 (+9)
I'm optimistic that we at Rethink Priorities will be able to convince you that we have a "clear path from research to real world output" if you give us a chance over the next few weeks
weeatquince @ 2020-11-17T13:28 (+5)
Hi Peter, super keen to hear your thoughts and plans and evaluations and always happy to talk through. (FWIW I currently plan to donate £4-6k early Dec.)
BrianTan @ 2020-11-13T14:48 (+7)
I have found Charity Entrepreneurship's research useful for identifying high-impact charity ideas that people in the Philippines could potentially start. Their top charity ideas and cause area research also help me identify and research potentially pressing problems in the Philippines that people could contribute to.
Founders Pledge's research is also useful, and I especially like their climate change and mental health reports. I believe both charities still have room for more funding.
weeatquince @ 2020-11-17T13:32 (+2)
Dear Brian, thank you for the really helpful reply. That's good info and really useful. (Also FWIW I suggest posting it as an answer to the main question above rather than in the comments as it would be more visible there).