Student competition for drafting a treaty on moratorium of large-scale AI capabilities R&D

By Nayanika @ 2023-04-24T13:15 (+36)

Campaign for AI safety has announced a competition for the drafting of an international treaty on moratorium of large-scale AI capabilities research and development.

The competition is open to all students of law, philosophy, and other relevant disciplines. The competition is organized by the Campaign for AI Safety, an Australian unincorporated association of people who are concerned about the risks of AI.

Competition brief: The goal of the competition is to create a draft treaty document that is based on and inspired by the suggestions of the articlePausing AI Developments Isn’t Enough. We Need to Shut it All Down, including the provisions on:

Prizes: The winner will receive a prize of AUD 4000. The runner-up will receive a prize of AUD 1000. The third place will receive a prize of AUD 500.

How to participate: 

1)Read the competition brief above. 

2)Draft a treaty: The treaty should be in English and should be no longer than 10 pages. The treaty should be submitted in Word format. 

3)Submit your draft: Please e-mail your draft to nayanika.kundu@campaignforaisafety.org. Please include your name, university, and country in the e-mail. 

4)Wait for the results: The results will be announced on 1 Aug 2023 (subject to extension). Judging criteria 

The judges will evaluate the drafts based on the following criteria:

Panel of judges: We are currently assembling a panel of judges. If you are a public law professor, please e-mail us to express your interest in judging the competition.


harfe @ 2023-04-25T09:58 (+2)

Prohibition of training ML models (or combinations of models) with more than 500 million parameters.

For comparison, this is smaller than GPT-2.

The goal of the competition is to operationalize the suggestions of the article Pausing AI Developments Isn’t Enough. We Need to Shut it All Down, including the provisions on:

This sounds a bit like the list is of things that Eliezer suggests, but actually his article makes no mention of quantum computers.

Nayanika @ 2023-04-26T07:14 (+1)

Hi Harfe, it is inspired by his article, not an actual list from him.

Heramb Podar @ 2023-04-25T08:07 (+2)

operationalize in what context or format?

Nayanika @ 2023-04-26T07:13 (+1)

Hi Heramb! Thanks for bringing this up. Here's Nik Samoylov's (the contest organizer) reply - What I meant is to take it from an idea and make it into a concrete draft legal document. P.S: The post has been updated!