Please Take the 2018 Effective Altruism Survey!

By Tee @ 2018-04-25T17:48 (+22)

The 2018 EA Survey has just been released! We hope that as many of you as possible take it via this link.

 

The survey takes about 10-20 minutes to complete, depending on how extensively you answer the questions.

The annual EA Survey is conducted by Rethink Charity, with support and assistance from several EA community organizations intending to help the community better understand our actions, values, demographics, and ideas. You can find the most popular post from the 2017 EA Survey here.

All results will be aggregated, anonymized, and made available to members of the EA community, so we can better share useful knowledge among each other. Within the survey, you’ll have the option to publicly share selected information about yourself in several EA venues, if you opt in.

If you know anyone else who might be interested in completing the survey, we’d encourage you to pass along this direct link or share this post!


HenryStanley @ 2018-04-25T20:33 (+17)

Probably too late to change it, but for the question "how did you hear about this survey?", the EA Forum isn't mentioned :P

undefined @ 2018-04-26T18:02 (+3)

Oh, no one reads this. We're all bots.

undefined @ 2018-04-26T07:47 (+16)

Thanks for doing this!

Under "Have you received career coaching from 80,000 Hours?" there are 3 options: "I have received career coaching", "I have not received career coaching, but would like to", and "None of the Above". I think if "None of the Above" was replaced by "I have not received career coaching, and would not like to" then you'd more accurately measure people in that category.

IMO the EA survey is a super powerful tool that's currently underused. Here's an idea bank for future surveys:

undefined @ 2018-05-03T04:53 (+2)

Ask people which causes they've changed their minds about and why.

I second this. Specifically, I think people should be asked what their preferred cause area was when they first got involved in EA. This would allow us to know the proportion of long term future people who first got involved in EA through global health, which is information that would be useful for a number of different reasons.

undefined @ 2018-09-20T04:21 (+12)

The results from the 2018 Survey are about to be posted in the next day. I'll need enough upvotes to post and then we'll be sharing out: -Methodology -Demographics of the EA Survey -Community Demographics & Characteristics

undefined @ 2018-04-25T20:19 (+12)

I was planning to give some feedback on the 2017 survey instrument after the last post in that series, which I had assumed would finish before the 2018 survey was released. Since my assumption was wrong (sorry!), I'll just post my feedback here to be considered for the 2019 survey:

  1. One major aspect of EA is the regularly produced online content on this forum and elsewhere. It might be useful to ask about the average number of hours a week people spend reading EA content as that could help people evaluate the value of producing online content.

  2. You could also ask people whether they've attended an EA Global conference. The responses could be used as a proxy to distinguish more involved and less involved EAs, which could be used in analyzing other issues like cause area preferences.

  3. For the question about career path, you could add advocacy as a fourth option. (80,000 Hours treats it as one of the four broad options.)

  4. For the same reasons that race was included in the 2017 survey, it could be useful to ask about parental education (as a proxy for socioeconomic background).

  5. You could ask people how many of their acquaintances they have seriously attempted to persuade to join EA and how many of those did join. This could provide useful data on the effectiveness of personal outreach.

  6. Another question that may be worth asking: "Have you ever seriously considered leaving EA?" For those that answer yes, you could ask them for their reasons.

  7. I think it could be useful to have data on the percent of EAs who are living organ donors and the percent of EAs who intend to become living organ donors. The major downside is that it may cause people to think that being a living organ donor is part of EA.

  8. Borrowing from Peter Singer, I propose asking: "Has effective altruism given you a greater sense of meaning and purpose in your life?"

  9. You could also ask about systemic change: "How much do you think the EA community currently focuses on systemic change (on a scale of 1 to 10)?" and "How much do you think the EA community should focus on systemic change (on a scale of 1 to 10)?" You could include a box for people to explain their answers.

  10. Lastly, you could ask questions about values. A) "Do you believe that preventing the suffering of a person living in your own country is more important than preventing an equal amount of suffering of a person living in a different country? Assume that there is no instrumental value to preventing the suffering of either and that in both cases the suffering is being prevented by means other than preventing existence or causing death." B) "Do you believe that preventing the suffering of a human is more important than preventing an equal amount of suffering of a non-human animal? Assume that there is no instrumental value to preventing the suffering of either and that in both cases the suffering is being prevented by means other than preventing existence or causing death." C) "Do you believe that preventing the suffering of a person living in the present is more important than preventing an equal amount of suffering of a person living several centuries from now? Assume that there is no instrumental value to preventing the suffering of either and that in both cases the suffering is being prevented by means other than preventing existence or causing death." D) "Do you believe that it is bad if a person who would live a happy life is not brought into existence?"

undefined @ 2018-04-25T21:13 (+2)

Thanks for the feedback. We can definitely consider a lot of these for the 2019 Survey. :)

undefined @ 2018-04-25T21:12 (+2)

after the last post in that series, which I had assumed would finish before the 2018 survey was released

Yeah, this is a very fair assumption to make, but our publication kinda fell apart with the December holidays (we're an all volunteer team). This year we're intending to plan out our analysis publication with a lot more dedication and organization.

undefined @ 2018-04-25T19:36 (+11)

The EA community climate survey linked in the EA survey has some methodological problems. When academics study sexual harassment and assault, it's generally agreed upon that one should describe specific acts (e.g. "has anyone ever made you have vaginal, oral, or anal sex against your will using force or a threat of force?") rather than vague terms like harassment or assault. People typically disagree on what harassment and assault mean, and many people choose not to conceptualize their experiences as harassment or assault. (This is particularly true for men, since many people believe that men by definition can't be victims of sexual harassment or assault.) Similarly, few people will admit to perpetrating harassment or assault, but more people will admit to (for example) touching someone on the breasts, buttocks, or genitals against their will.

I'd also suggest using a content warning before asking people about potentially traumatic experiences.

undefined @ 2018-04-25T20:02 (+7)

I didn't notice the community survey until I saw your comment. I had to retake the survey (answering "no my answers are not accurate") to get to it.

I think there will be selection bias when the survey is optional and difficult to access like this.

undefined @ 2018-04-26T18:06 (+1)

Yeah, I'd make it more visible, and flag it more earlier - it's a good idea which could use more responses.

undefined @ 2018-04-28T23:02 (+1)

Right now 10% of people taking the EA Survey are also taking the anonymous survey, which is not unreasonable. After the main survey marketing is over, we may follow up and market the anonymous survey further.

undefined @ 2018-04-26T14:24 (+1)

I didn't see it either.

undefined @ 2018-04-25T21:23 (+5)

Thanks. We've never run an anonymous feedback survey before or a survey about sexual assault, so we're definitely open to any suggestions. We did work with Kathy some on this and we also drew some from the SlateStarCodex Survey.

undefined @ 2018-04-29T11:16 (+1)

I suppose question 56 is meant to measure something like "inclination to deliberate", but 3 out of 5 questions are materialistic contexts (shopping, dining) that EA's might not think much about, even if a lot of other contexts would trigger a lot of deliberation. Especially for dining there are often just a few vegetarian and even fewer vegan options on the menu, so that item especially doesn't capture the intended concept I'm afraid.

undefined @ 2018-04-28T15:59 (+1)

For the (bonus) question on comparing impact of an "average" charity with the best one, it would probably be worth specifying whether we mean mean or median, as I know some people here expect (I think myself included) a very significant difference between mean and median.

undefined @ 2018-06-06T00:57 (+1)

It could also be useful to specify a few other things about the question, such as whether charities saving future lives are legitimate to include in the calculation and whether the language about helping the world's poorest people was specifically intending to restrict the set to global poverty charities.

undefined @ 2018-04-26T02:29 (+1)

11) Do you know of a local EA group?

I know of a local EA group near me

I do not know of a local EA group near me

-> -> I know there is no local EA group near me.

undefined @ 2018-04-25T23:38 (+1)

Given the number of 80k recommendations about policy careers, I was surprised "policy" wasn't a broad career option.