Lightcone Infrastructure/LessWrong is looking for funding

By Habryka @ 2023-06-14T04:45 (+65)

This is a crosspost, probably from LessWrong. Try viewing it there.

null
pseudonym @ 2023-06-14T13:04 (+25)

Are you happy to share a rough breakdown for what you plan to spend the $3-6M?

Habryka @ 2023-06-14T18:04 (+27)

I wrote a bunch of comments over on the LessWrong side going into detail on various aspects of our plans for the future, including spending plans, so probably good to check those out (e.g. this comment). 

To give a very rough high-level overview over how I expect this money to be spent: 

  • ~$1.7M for interest payments and Rose Garden Inn upkeep, which includes running an office space, hosting a lot of events, running a lot of events ourselves, and providing space for visiting scholars to sleep and work
  • ~$1.5M for core salaries. We are likely to reshuffle our internal team structure a bit, but at least right now around 50% of those salaries go to the LessWrong team, and the other half goes to the campus team. I expect we will probably focus more on online things in the next year, so assume that more of that will go into things like developing LessWrong and the AI Alignment Forum.
  • $0 - $4M in FTX clawbacks. We sure got a bunch of money from FTX and at some point the creditors will probably come asking for it. I currently think we morally owe back around $1.5M, though there is some messy game theory here that makes me a bit more confused about that number, and legally it's very unclear how much we owe back.
  • $500k on some projects in the reference class of printing LessWrong books, running a big AI Alignment conference, paying research prizes, paying for whistleblowers and investigations into potential bad actors in AI Alignment/EA/Rationality/X-Risk. I don't have super specific plans here, it's just on the order of what we've spent in the past on some set of projects like this.
Robi Rahman @ 2023-06-14T21:29 (+15)

I currently think we morally owe back around $1.5M

This might be morally accurate, but perhaps you shouldn't be saying it online in case it emboldens people to sue you looking to claw back lots of money related to this case? I'm wondering if there's a group of attorneys analogous to ambulance-chasers but for the FTX scandal.

Habryka @ 2023-06-14T22:28 (+12)

Yeah, I thought about my policy here for a few hours and talked to some of the relevant stakeholders about the tradeoffs here (like our fiscal sponsor CFAR) and made a conscious decision to talk about this specific thing. 

I currently think the incentives don't really change that much, and I am willing to not pay that money back if someone is trying to do something extortive, though yeah, even the game theory of talking about this stuff feels kind of messy and makes me sad.

Jason @ 2023-06-15T00:15 (+16)

I appreciate Lightcone's willingness to mention its potential legal and ethical clawback exposure to prospective donors. (At the same time, I recognize there could potentially be valid reasons for other organizations not to do so in certain circumstances.) 

plex @ 2023-06-14T23:38 (+3)

running a big AI Alignment conference

Would you like the domain aisafety.global for this? It's one of the ones I collected on ea.domains which I'm hoping someone will make use of one day.

Habryka @ 2023-06-14T23:42 (+4)

Possibly! I'll reach out if our plans for this ever materialize, I was mostly just trying to give an example of a thing we've considered.

Vasco Grilo @ 2023-06-15T14:47 (+23)

Hi Habryka,

I do think we work on projects that have a decent chance of reducing existential risk and generally making humanity's future go a lot better, though this kind of stuff sure is hard to tell.

Is there any impact/cost-effectiveness analysis of your past work one can check?

JoshuaBlake @ 2023-06-14T10:50 (+19)

What's the counterfactual impact of that $3-6M? Would you have to cut some of the activities you mentioned without it? Is this money to expand to be activities? Something else?

Habryka @ 2023-06-14T23:45 (+19)

What's the counterfactual impact of that $3-6M? Would you have to cut some of the activities you mentioned without it? Is this money to expand to be activities? Something else?

At least this year, this is quite hard to answer, because really the majority of this money would go to paying off things like interest on our loan, and not-going-bankrupt when the FTX creditors start knocking.

If we end up with a very substantial funding shortfall, my guess is this would mostly cause us to focus on renting out the Rose Garden Inn more to somehow make enough funds to cover our obligations. In the worst case we would default on our loan and sell the Rose Garden Inn property, though that would be a pretty protracted affair that would really hurt. 

It does really feel a bit like this year marginal funding is more directly funging against something like "probability of the continued existence of Lightcone Infrastructure at all" instead of some specific programs, because of the way our liabilities are structured and past commitments we've made.