NIST staffers revolt against expected appointment of ‘effective altruist’ AI researcher to US AI Safety Institute

By Phib @ 2024-03-08T17:47 (+39)

This is a linkpost to https://venturebeat.com/ai/nist-staffers-revolt-against-potential-appointment-of-effective-altruist-ai-researcher-to-us-ai-safety-institute/

“The appointment of Christiano, which was said to come directly from Secretary of Commerce Gina Raimondo (NIST is an agency under the US Department of Commerce) has sparked outrage among NIST employees who fear that Christiano’s association with EA and longtermism could compromise the institute’s objectivity and integrity.”

“The AISI was established in November 2023 to “support the responsibilities assigned to the Department of Commerce” under the AI Executive Order. Earlier today, US Senate Majority Leader Chuck Schumer (D-NY) announced that the NIST will receive up to $10 million to establish the US AI Safety Institute.”


Robi Rahman @ 2024-03-08T23:10 (+48)

I don't really see anything in the article to support the headline claim, and the anonymous sources don't actually work at NIST, do they?

SiebeRozendal @ 2024-03-09T07:32 (+6)

The National Institute of Standards and Technology (NIST) is facing an internal crisis as staff members and scientists have threatened to resign over the anticipated appointment of Paul Christiano to a crucial, though non-political, position at the agency’s newly-formed US AI Safety Institute (AISI), according to at least two sources with direct knowledge of the situation, who asked to remain anonymous.

I don't know, threatening to resign is a pretty concrete thing and I don't find "revolt" such an exaggeration. You can doubt the sources and wish for more concrete evidence (a letter?), but I'd still put >50% that it's broadly correct

EDIT: okay there's a clear ambiguity about how many people are threatening to resign, in a way that if it's only 1 or 2, it's clearly misleading.

Phib @ 2024-03-08T23:42 (+6)

Agreed, the evidence is solely, "according to at least two sources with direct knowledge of the situation, who asked to remain anonymous."

Rebecca @ 2024-03-09T09:37 (+4)

That is still consistent with them working at NIST

Jeff Kaufman @ 2024-03-11T02:09 (+10)

I think the argument is that if they did work at NIST then the article would have included that, so we can infer the very likely don't?

Rebecca @ 2024-03-13T16:36 (+2)

Perhaps I am overestimating how worried a source might be that their organisation traces a leak back to them if it's known that someone from within the organisation provided it.

David Mathers @ 2024-03-08T18:02 (+32)

Not exactly a great sign about EA's reputation!

JWS @ 2024-03-08T21:17 (+9)

Not sure I understand the disagree-voters here, it seems that some NIST staffers are upset about the EA connection, and not just a perception that the appointment has been rushed through

(edit: unless you think that the reporting is just unrealiable?)

SiebeRozendal @ 2024-03-09T07:35 (+6)

Yeah agree, though the disagreement is also specific to views on AI x-risk, which I view as very different from reputation

EffectiveAdvocate @ 2024-03-09T10:02 (+18)

This story is interesting; however, I must admit, I am most surprised by the "up to $10 million" figure. I had assumed the US would allocate significantly more funds for this. For comparison:

What am I overlooking?

metachirality @ 2024-03-08T19:46 (+8)

Does anyone know the precise number of people who are threatening to resign?

Will Aldred @ 2024-03-08T20:26 (+8)

Hard to tell from the information given. Two sources saying an unknown number of people are threatening to resign could just mean that two people are disgruntled and might themselves resign.

Chris Leong @ 2024-03-09T00:13 (+18)

Update: https://twitter.com/dkaushik96/status/1766108613431427445?s=20

Rebecca @ 2024-03-09T09:40 (+3)

Is Paul “supremely qualified” regarding CBRNs?

Also what’s the difference between a political and non political position?

Ben_West @ 2024-03-12T01:52 (+4)

I think the tweet is referring to political appointments. I think the tweet is implying that the position must not be extremely influential, because the most influential positions are politically appointed. (And, if this were a political appointment, we would know about it because of various disclosure requirements for those positions.)

DrGunn @ 2024-04-17T00:51 (+2)

FWIW: