Apply for Red Team Challenge [May 7 - June 4]

By Cillian_ @ 2022-03-18T18:53 (+92)

Summary

Red Team Challenge is a programme that calls small teams together to "red team" important ideas within effective altruism. The inaugural challenge will run from May 7 - June 4 2022.

This programme will provide training in “red teaming” best practices and then pair small teams of 2-4 people together to critique a particular claim and publish the results. It was directly inspired by this post (so please shower them in counterfactual karma).

There are three distinct parts:

Our goal is to help aspiring researchers test their fit and hone their reasoning ability while producing a concrete output which is useful to the EA community at large.

Express interest in joining the judging panel here.

Apply here by 15th April.

What is “red teaming”?

A red team is an independent group that challenges a particular organisation, idea or claim in order to improve it. Red teaming is the practice of using red teams.

Within effective altruism, "red teaming" refers to attempts to identify problems or errors in popular or prestigious views held by members of this community, such as views about the value of different causes or organizations. Related concepts include minimal-trust investigations, epistemic spot-checks, and hypothetical apostasy

Red Team Challenge seeks to promote this practice within effective altruism. This will help break up groupthink, identify ways in which the EA community could be erring, and generally foster strong epistemic norms.

Goal

The goal of this programme is for participants to:

Structure of the programme

The program has three discrete parts:

Who should apply

Anyone who’s interested. 

Whether you’re deeply familiar with effective altruism, have just finished reading Doing Good Better, currently work as a researcher, or have never used Google before, this programme is open to everyone.

However, we’ve specifically designed this programme for with the following group in mind:

Apply now

To apply for Red Team Challenge, please fill out this short application form by 15th April.

If you’re interested in helping judge the red teams which are produced, please fill out this short expression of interest form.


EdoArad @ 2022-03-19T06:00 (+9)

This is brilliant! Sounds like a lot of fun and a great learning opportunity.

Before I pass this on to my local group, I want to ask - is it possible to apply as a team? I imagine that this might make it more appealing to some people to register with teammates they already know and share the same language.

Cillian Crosson @ 2022-03-19T08:11 (+8)

Yep, it's possible to apply as a team (of up to 4 people). Though we expect that most people will apply as individuals and that we'll assign them to a team.

It's also possible to apply with an idea that you'd like to red team. Though, again, we expect most people to apply without an idea and will provide a suggested list for participants.

Simon_Grimm @ 2022-03-20T11:25 (+8)

Noting my excitement that you picked up on the idea and will actually make this happen!

The structure you lay out sounds good.

Regarding the winning team, will there be financial rewards? I’d give it >70% that someone would fund at least a ~$1000 award for the best team.

Cillian Crosson @ 2022-03-20T21:07 (+3)

Thanks Simon! Currently, we don't plan to provide a financial reward to the winning team (though I must admit, we haven't given this much thought). It's a good point though & we'll consider it further in the coming weeks. 

If anyone reading this is interested in funding an award for the winning team, please do get in touch.

RomeoStevens @ 2022-04-02T16:39 (+4)

Potentially of use in running a short workshop is the effectiveness of pedagogical techniques. From engaging with the literature on such, the highest quality systematic review I could find pointed to four techniques as showing robust effect size across many contexts and instantiations. They are

  1. Deliberate practice
  2. Cuing elaboration of context
  3. Regular low stakes quizzing
  4. Teaching the material to others
SeanEngelhart @ 2022-03-20T12:03 (+3)

This sounds awesome! Thank you for running it! Do you expect to have additional runs of this in the future?

Cillian Crosson @ 2022-03-20T21:02 (+2)

I imagine we'll continue to run Red Team Challenge somewhere between 1-4 times per year moving forward (though this largely depends on how well the first iteration goes).

SeanEngelhart @ 2022-03-22T17:09 (+1)

Do you have any examples of suggested ideas to red team? No worries if not - - just wanted to get a sense of what the suggested list will be like.

Kaleem @ 2022-03-20T15:40 (+1)

I'm not sure if this is just happening for me, but the form seems to have some glitchy parameters that make it impossible to submit, such as a 'character count which needs to be bellow 0' for question 12, and question 7 doesn't tell you why you can't submit the answer even when it is below 300 words.

Cillian Crosson @ 2022-03-20T21:01 (+1)

Thanks for flagging this Kaleem, it should now be fixed. Let me know if you're still having issues :)

Kaleem @ 2022-03-20T21:19 (+1)

It's fixed - thanks !