Some Comments on the Recent FTX TIME Article

By Ben_West🔸 @ 2023-03-20T17:36 (+302)

Background

  1. Alameda Research (AR) was a cryptocurrency hedge fund started in late 2017.
  2. In early 2018, approximately half the employees quit, including myself and Naia Bouscal, the main person mentioned in the TIME article. At the time, I had considered AR to have failed, and I think even the people who stayed would have agreed that it had not achieved what it had wanted to.
  3. Later in 2018, some of the remaining AR staff started working on a cryptocurrency exchange named FTX. FTX grew to become a multibillion-dollar company.
  4. In late 2022, FTX collapsed. It has since been alleged that FTX defrauded their investors by misrepresenting the relationship between AR and FTX,[1] and that this effectively led to them stealing customer deposits.[2] 
  5. The recent TIME article doesn’t make a very precise argument; here is my attempt at steelmanning/clarifying a major argument made in that article, which I will then respond to:
    1. Some EAs worked at AR before FTX started
    2. Even though those EAs (including myself) quit before FTX was founded and therefore could not have had any first-hand knowledge of this improper relationship between AR and FTX, they knew things (like information about Sam’s character) which would have enabled them to predict that something bad would happen[3]
    3. This information was passed on to “EA leaders”, who did not take enough preventative action and are therefore (partly) responsible for FTX’s collapse

Personal Background

I worked at Alameda Research (AR) for about three months in early 2018. I was not involved in stealing FTX customer funds, and hopefully people trust me about that claim, if only because I quit before FTX was founded.

To make my COI clear: I left the company I founded to join AR; doing so was very costly to me; AR crashed and burned within a few months of me joining; I blamed this crashing and burning largely on Sam.

People who know I had a bad experience at AR are sometimes surprised that I’m not on the “obviously Sam was obviously 100% evil” bandwagon. I’ve been wanting to write something but found it hard because there weren’t specific things I could react to, it was just some vague difference in vibes.

So I appreciate the TIME article sharing some specific things that “EA Leaders” allegedly knew which the author suggests should have caused them to predict FTX’s fraud.

My Experience at AR at a High Level

I thought Sam was a bad CEO. I think he literally never prepared for a single one-on-one we had, his habit of playing video games instead of talking to you was “quirky” when he was a billionaire but aggravating when he was my manager, and my recollection is that Alameda made less money in the time I was there than if it had just simply bought and held bitcoin.

But my opinion of Sam overall was more positive than the sense I get from the statements in the TIME article. (This is not very surprising, given that the TIME article consists of statements that were probably intentionally selected to be the worst possible thing the journalist could find someone to say about Sam.)

It's hard to convey nuance in these posts, and I'm sure someone is going to interpret me as trying to defend Sam here. This is not what I’m trying to do, but I do think it’s worth trying to share my reflections to help others refine their models.

Adding my personal experience to supplement some statements from the article

But one of the people who did warn others about Bankman-Fried says that he openly wielded this power when challenged. “It was like, ‘I could destroy you,’” this person says. “Will and Holden would believe me over you. No one is going to believe you.”

I don’t want to speak for this person, but my own experience was pretty different. For example: Sam was fine with me telling prospective AR employees why I thought they shouldn’t join (and in fact I did do this),[4] and my severance agreement didn’t have any sort of non-disparagement clause. This comment says that none of the people who left had a non-disparagement clause, which seems like an obvious thing a person would do if they wanted to use force to prevent disparagement.[5]

Early Alameda executives also believed he had reneged on an equity arrangement that would have left Bankman-Fried with 40% control of the firm, according to a document reviewed by TIME.

I assume this is referring to an agreement between Sam and Tara,  the cofounders of AR. My understanding of what happened is different, but someone told me that my understanding is incorrect. So I’m not sure what actually happened here, but I am 80%+ confident that the story is more complicated than the TIME article implies.

I can share what I do know about, which is my own equity arrangement:

  1. When I joined AR, Sam and I discussed an equity amount.
  2. I quit before any paperwork could be signed memorializing this though. (I was only at AR for about three months.)
  3. Obviously since no paperwork was signed, there was no clause which covered this scenario. Most startups have a one year vesting cliff, meaning that the employee loses 100% of their equity if they quit within the first year.
  4. I expect most startup CEOs would have said something like “hey, we didn’t actually agree to anything here, and even if we did it probably would have had a clause meaning that you don’t get any equity after quitting so soon, so I’m giving you nothing.”
  5. Instead, AR gave me a cash payment which was equal to the equity amount we informally agreed times the most recent company valuation (although the valuation of AR at the time was low).
  6. I considered this fair, maybe even more fair than what the average startup would have done.

"We didn’t know how much money we actually had. We didn’t have a clear accounting record of all the trades we’d done,” Bouscal says.

I agree that AR had bad accounting as a startup, and I agree with the implication that it was possible to predict that this would be correlated with AR/FTX having bad accounting as a mature company —  I think this is a big area where I plausibly could have made a better prediction.

That being said, I still feel confused and surprised about how bad FTX’s accounting actually was. Sam’s reports make it seem like they just were not tracking asset values at all? And somehow they were doing this while having audited financials, passing due diligence from major investors, etc.? And Sam was supposedly a great fundraiser but was circulating a balance sheet with a $8B line item for “hidden poorly labeled account”? I would find it pretty helpful for someone to explain what actually happened here because this violates my models of how the world works.

(One obvious explanation is that people often cover up fraud by claiming it was simply incompetence, and maybe FTX is exaggerating its level of accounting incompetence for this reason. I don’t fully buy this story though.[6])

Next Steps

As mentioned, I had and still have a lot of negative feelings about Sam. But at least on a couple specific points, my experience was different from the source(s) of this article in a way that paints a less clear story of Sam’s character.

It might turn out that people were aware of stronger warning signs than those listed in the TIME article. It might also be the case that individuals could be better at predicting risk. But even if those things could have theoretically worked in the FTX case, protecting ourselves solely through better noticing "warning signs" feels fragile.

Instead, I would prefer due diligence processes which are not entirely reliant upon warning signs being triggered and evaluated until something like certainty is achieved.

In a future post, I would like to describe examples of due diligence processes that run "by default" and are less reliant upon warning signs being triggered.

Note: these are my ideas, not my employer’s. There are a bunch of people who I’ve talked about these ideas with and I am grateful to all of them, but special thanks on this post to Lizka Vaintrob, Jonas Vollmer, and Lacey Walker.

  1. ^

     There are some additional charges, but my understanding is that the biggest ones stem from this misrepresentation.

  2. ^

     I’ve mostly seen this claim in popular media where it isn’t very precisely defined, but I think the precise version of the claim is that allowing AR to maintain a negative balance effectively let them use customer deposits as collateral, which is effectively stealing them. I’m not entirely sure though.

  3. ^

     Note that there are valid additional criticisms to be made here, notably that FTX leadership were involved in EA. But I don’t think the article is making these criticisms, and I want to keep this post targeted to this particular article.

  4. ^

     Or at least I’m not aware of any way I’ve suffered retribution as a result. Presumably he wasn’t super thrilled with me telling his prospective employees not to join.

  5. ^

     Though obviously there are reasons you still might not have the clause even if you wanted to prevent disparagement, e.g. you thought having the clause would itself be a cause for disparagement.

  6. ^

     For example, FTX’s new CEO has slammed their accounting practices, and I don’t understand why he would be incentivized to lie here


Ivy Mazzola @ 2023-03-21T00:54 (+67)

Somehow they were doing this while having audited financials, passing due diligence from major investors, etc.? And Sam was supposedly a great fundraiser but was circulating a balance sheet with a $8B line item for “hidden poorly labeled account”? I would find it pretty helpful for someone to explain what actually happened here because this violates my models of how the world works.

Mine too, so I went digging. All in all, one can argue (and lawyers are) that there were a lot of enablers. Certainly, people trying to actively dodge being noticed as they violate standard models, is a predictable (but not necessarily pin-pointable at the time) way our models end up failing us. 

For talk about audits specifically, there's this and this. Essentially, "the firm's auditors weren't tapped to look into internal controls at FTX, and auditing the internal workings of a company isn't a [legal] requisite for private corporations." Of course plenty of people feel that doesn't hold water, and a lawsuit by FTX customers is pending.
[Edit: A suit may be reasonable because audit firms know well they are commissioned to literally prove financial safety, and the audit was used in FTX's self-promotion. That FTX was still very unsafe might prove there is negligence in the firm's business model. If I try to make this fit my model of the world, I get a thought like "corporate greed incentivizes taking on clients that want useless/partial audits that end up being no better than shams, and you look the other way as you assist them in their likely sham". I reflect more on this in the footnote which you don't have to read but>>[1]]

For talk about investors, there is this Feb 23rd piece on a major lawsuit against a few different VC banks who helped out FTX. That piece is frickin nuts just by virtue of the amount of info they fit into a mere 5 paragraphs. Here's one quote to inspire a read:

The suit alleges that some of world’s largest venture capital firms, including Sequoia Capital, SoftBank Group, and Thoma Bravo, learned through due diligence that FTX was a fraudulent scheme, but nevertheless incited the Fraud with billions in necessary capital, provided guidance and other support critical to the Fraud, and publicly promoted Bankman-Fried and FTX to keep the Fraud concealed until FTX could go public or cash out in a private sale

And of course there was internal assistance. I'd bet there were both (1) employees who knew what they were doing and (2) employees just following direction without realizing they were committing crimes or aiding in them. 

When it comes to improving models of how the world works, Zvi's piece had some good discussion of this (and much more!). It's long, but very worth reading even months later. Here's a section on VC:

If you are a VC investor or taking VC money, the optimal amount of fraud, from your perspective, is not zero. You are more excited to invest if you suspect a fraud, those kinds of founders make good and make dreams real for you. So what if sometimes it all blows up? This is a game of hits for you, and you are much more worried about being asked why you didn’t invest in FTX than you should worry about people asking why you were. This goes double for crypto. 

Notice this VC ready to invest in SBF again if he asked. Which, from a pure EV perspective, sure why not, same as they invested in Adam Neumann. 

Therefore, I do not view ‘the VCs didn’t catch this’ as much of a justification. They are not supposed to catch it. It is not their job to catch it. I mean, they are supposed to do some things to catch this level of fraud, demanding voting shares and a company board in which they have a seat and doing proper audits, but they got none of that, because [SBF] needed to not allow it and the pitch was so good otherwise they went along (or, they took this to mean ‘this is a fraud’ and invested anyway thinking they were not the sucker, also plausible). [If] SBF said ‘you can’t check for fraud, invest or don’t’ then they are doing what they do, as much as we might hate that. Better to make that common knowledge. [emphasis mine]

The institutional traders are different. They face a different risk profile. If the exchange blows up in 10% of years that is a real drag on returns, whereas a VC expects 80% or more of their investments to go to zero, fraud or otherwise. Why did they trade?

Some of them Did Not Do the Research, no doubt. Others likely decided it was worth the risk. If FTX is an easy place to make money, because trading is very good against Alameda and generally they treat customers great, and they pay interest on USD and BTC, it is not difficult to imagine a decision that the blowup risk is worth taking, at least for some portion of one’s bankroll. Or one can say that if FTX goes down everything is terrible anyway, it’s already systemic risk, so assume it won’t fail. 

Another play is to hedge the risk with a short position elsewhere, and put your leveraged longs at FTX since if FTX goes broke you would have gotten liquidated at Binance anyway.

[Note: There could also be a section about lack of regulation here. As commented on here. From a "how the world works" POV, it is the mother of all permissiveness that allowed the rest, especially the useless audits. Global heuristic = Pretty nuts how much can go wrong with a regulation gap. But FTX also maybe would have found  away around/already did break regulations so idk] 

Anyway, just thought that all might interest you. Thank you for sharing your insights. Really useful stuff.

  1. ^

    Interestingly, now the company has stopped offering crypto audits due to "changing market conditions". And I was going to say "good of them to notice that the bare legal minimum is not enough for one of the most volatile, least regulated assets the world has ever seen, eyeroll." But actually that auditor firm is starting up crypto audits again under a different name, sigh. It appears that they only stopped offering crypto audits because some non-crypto clients of the audit firm put pressure on them to do so. Those non-crypto clients felt that the auditor being known to audit crypto, might reduce the trust their potential clients/users end up having in their own commissioned audits. So it appears that, to make sure they can catch the most non-crypto and crypto audit contracts without one segment compromising the other, the auditors are just splitting them under two companies. I didn't see any mention of raising the crypto audit standards.

    Additionally, through this process. I found mention a couple times that there are other auditing firms who do a much better job, "The big 4", and it is sort-of business wisdom to downgrade trust in audits that aren't from them. I was very surprised at this! There are auditors that business-people know to trust less? Then why do they exist? I guess because most consumers don't know enough to downgrade trust? One has to wonder if the big 4 would have put their stamp of approval on FTX or even many of this audit firm's non-FTX-clients. Probably not, right? And it makes you wonder why companies would go to these known-worse-auditors, especially if they can afford the best auditing like FTX should have been able to, if they don't have something to hide. If the goal is consumer trust, and a company doesn't have something to hide, that company should go to the best auditors, those that in-the-know-consumers trust the most, right? And surely a "worse" audit firm like this one would realize that is how the selection effect cookie crumbles. So lesser-known auditors should expect they will likely get a slew of clients who are nowhere near as reputable as those who hire the big 4 audit firms. 

    Sooo I think it's easy to argue that the minor audit firm(s) are negligent or intentionally turning a blind eye somewhere in their business model. But it's more a problem of incentives of corporate America and low federal standards for private corporations allowing those incentives to play out in auditing contracts, than it is a problem of a single actor. Even though the single actor/auditor might know damn well that they will end up giving a scammer cover eventually, maybe even frequently among their really wealthy clients like FTX who could have afforded better-known services. It appears to be part of the business model, chronic not acute. And as long as the private corporation and auditor are following the law in reviewing the bare minimum, oh well?

Ben_West @ 2023-03-21T15:55 (+20)

Thanks! I appreciate the link round up; the boundaries of what exactly was audited does seem helpful to know, and the claim that VCs have a preference for fraudulent founders is interesting. This is exactly the kind of comment I was hoping to get from my post.

Czynski @ 2023-05-03T19:42 (+12)

And it makes you wonder why companies would go to these known-worse-auditors, especially if they can afford the best auditing like FTX should have been able to, if they don't have something to hide.

Complying with an audit is expensive, and not just in money.

A thorough audit in progress is going to disrupt the workflow of all or most of your company in order to look at their daily operations more closely. This reduces productivity and slows down the ability to change anything, even if nothing improper is happening. It is expensive and disruptive.

A thorough audit is also going to recommend changes. Not just changes required to be technically in compliance, but ones which will make it easier to audit for compliance in the future and ones which remove something that could potentially be mistaken for bad behavior in a dim light. Making those changes is expensive and disruptive. 

If you don't need extremely high levels of trust from your customers and partners, choosing to receive a thorough audit means you're paying a bunch of unnecessary costs. Much better to get a more lax audit, which is less disruptive to have ongoing and less disruptive to handle once the results are in. Better still if it also costs less money. 

The correct audit is the one that provides your customers and clients - and/or your own management - with exactly as much trust and reassurance as you need them to get and no more. Anything less and you lose business that doesn't trust you; anything more and you're paying a cost for a benefit you don't actually benefit from.

Jason @ 2023-05-03T23:35 (+1)

Corporations have their own legal personhood; it's difficult to see how the corporation's interest could be served by such a shoddy audit that failed to detect apparently unsophisticated, and certainly massive, raids on the corporate fisc by insiders.

Czynski @ 2023-05-03T23:46 (+1)

Also, the only known raids on the corporate assets happened post-crash and therefore long post-audit. Under the espoused worldview of the management, everything before that was plausibly 'good for the company'. In that it benefitted the company in raw EV across all possible worlds with no discount rate for higher gains or for massive losses.

Czynski @ 2023-05-03T23:44 (+1)

That wasn't the question. The question was why any company would go to less-than-maximally-trustworthy auditors.

Jeff Kaufman @ 2023-03-21T17:37 (+2)

There are auditors that business-people know to trust less? Then why do they exist? I guess because most consumers don't know enough to downgrade trust?

Maybe the big 4 are enough more expensive that it's common for people to go with other firms for reasons other than "we're doing fraudulent stuff and hope to sneak it past auditors"? And so even if you would be able to afford one of the big 4 it doesn't send a strong signal by going with someone else?

Ivy Mazzola @ 2023-03-21T17:47 (+2)

Yeah my thoughts exactly. Or, it doesn't send a big signal to non-finance people. But like, I think it should send a signal to people in finance, eg the auditors. That FTX should have been able to afford a different service and yet didn't. Or maybe, idk, should have revealed their internals for different certification (better than GAAP cert idk, I know nothing). I just think it should have raised flags for the auditor. If someone is enlisting you for purposes of increasing trust but they are clearly not doing their damnedest, according to their abilities, to ensure that trust is accurate. The US consumers can't be expected to know the difference, but the auditor should. I think.

Jason @ 2023-03-21T18:20 (+8)

In general, standard corporate audits aren't intended to be intelligible by consumers but instead by investors and regulators. It's shocking that FTX's regulator in the Bahamas apparently did not require a clean audit opinion addressing internal controls, and maybe no US regulator required it for FTX US either.

At present, my #2 on who to blame (after FTX insiders in the know) is the regulators. It's plausible the auditors did what they were hired to do and issued opinion letters making it clear what their scope of work was in ways that were legible to their intended audience. I can't find any plausible excuse for the regulators.

Ivy Mazzola @ 2023-03-21T18:37 (+3)

That makes sense. It is really shocking. I agree on blaming regulators [although I don't give others a pass].

[I think a section on regulations def belongs from the POV of improving world models too. Before I added my long thinking-out-loud footnote, I didn't realize just how much it all points at regulators as the original permissiveness break.]

Jason @ 2023-03-21T01:34 (+2)

Thanks for sharing this. I skimmed the relevant portions of the underlying lawsuit referenced in the press release, and my overall impression is "fishing expedition." (Maybe more than that against the banks . . . but those banks just went bust and I doubt will have any money to pay a judgment, so I didn't bother skimming that). Not that there aren't reasonable grounds for a class-action law firm to engage in a fishing expedition, but they won't have any real evidence until they (possibly) survive motions to dismiss and get to discovery.

Ivy Mazzola @ 2023-03-21T02:05 (+5)

Glad you liked it. Perhaps I wasn't clear in purpose though. My point was not to talk about payouts, but to explain how things like this can happen. Because it "violates model of how the world works". [Edit: I cut stuff from here and expanded on it in footnote above]

I'm just saying there are systemic reasons why the fiasco got as far as it did.

[Edit: Ah this is one of those times I might be being dramatic, but I may as well say] I'm a bit sad to hear "fishing expedition" to this. But [so many EAs didn't feel similarly] about EA leaders taking some of the blame. I didn't want to bring EA into this particular comment, but gee. The actors I've named here had like 1000x the likelihood of knowing what was going on and being negligent or otherwise at fault somehow than non-Alameda EAs did. It's a bit flippant to call it a fishing expedition to go after others, if it is worth doing, and when our community has just spent so much time talking about EA fault. dies a bit inside on behalf of EA  Tbh they seem like reasonable suits to me in general, and I hope disincentivize something like this from happening again :/

Jason @ 2023-03-21T23:58 (+6)

I characterized the lawsuit is a fishing expedition because I saw no specific evidence in the complaint about what the VC firms actually knew -- only assumptions based on rather general public statements from the VCs. And the complaints allege -- and I think probably have to allege -- actual knowledge of the fraudulent scheme against the depositors. The reason is that, as a general rule, the plaintiff has to establish that the defendant owed them a duty to do or refrain from doing something before negligence liability will attach. 

Of course, you have to file the lawsuit in order to potentially get to discovery and start subpoenaing documents and deposing witnesses. It's not an unreasonable fishing expedition to undertake, but I think the narrative that the VCs were sloppy, rushed, or underinvested on their due dilligence is much more likely than the complaint's theory that they knew about the depositor fraud and actively worked to conceal it until FTX did an IPO and they unloaded their shares.

(I certainly do not think anyone in EA knew about the fraudulent scheme against depositors either.)

Jeff Kaufman @ 2023-03-20T19:41 (+35)

Thanks for sharing your first-hand experience!

FTX’s new CEO has slammed their accounting practices, and I don’t understand why he would be incentivized to lie here

This is minor, but the more he paints a picture of FTX as a mess the harder a job it looks like he's taken on, the more slack people give him, and the better his efforts are likely to be judged in hindsight. I doubt he would lie as in "say things he knows are untrue" but it's very common for people to end up with somewhat self-serving beliefs.

EDIT: not saying their accounting practices were good! Just that I expect them to be less bad than if I took the CEO's statements literally.

Ivy Mazzola @ 2023-03-21T01:21 (+18)

Eh, I still agree with Ben here. He said they are the worst financial documents he has ever seen, including Enron. And given he's the guy who steered Enron after bankruptcy, that's a concrete claim. And as the documents will surely all be submitted, he'd be putting his neck on the line to say such things if it weren't clearly like the most egregious thing you could imagine. shrugs :/

Jeff Kaufman @ 2023-03-21T02:21 (+5)

There are a lot of degrees of freedom in "worst". I'm not that familiar with Enron's accounting, but my impression is their finances were careful and relatively normal looking, just intentionally over-complex and with 'aggressive' choices that made things look much better than they actually were? So if you think sloppiness is a very serious issue in this business (a sensible position to hold!) then you might not need very much before the state of documentation can be 'worse' than Enron?

Ivy Mazzola @ 2023-03-21T02:38 (+10)

Yeah, turns out there was not only sloppiness here though. Like Enron, things were labelled to look much better than they really were. Like, stocks of coins held in such volumes and accounted as their current exchange price such that it looked like billions in net worth, IIRC, but of course if they would have sold the coins, the value of the coins would have plummeted far before they got through their sale order, so there is no way they could have expected to gather that much USD for the coins they held. This might be normal for stocks valuation? But my impression from the tone is that it was handled differently/worse. Maybe there were other things too, tbh I didn't look very closely. Plus there was SBF's backdoor (that was real right?) and I'd bet other weird money movements I assume he has noticed by now.

Geoffrey Miller @ 2023-03-21T03:11 (+20)

Ben - thanks for this helpful information. It adds useful context to some of the FTX news.

One clarification question: in your Background section 5c, you suggested that '“EA leaders”... did not take enough preventative action and are therefore (partly) responsible for FTX’s collapse'

I agree that EA leaders might, in hindsight, have done a better job of distancing the EA movement from FTX and SBF, to protect EA's public reputation. However, I'm not sure how much leverage EA leaders could have had in preventing or delaying FTX's collapse. 

If EA leaders had privately challenged Sam's bad accounting, fraudulent behavior, etc, back before fall2022, would he really have listened and behaved any differently?  Would other FTX leaders or employees have behaved differently?

If a few EAs had come out as public whistleblowers questioning FTX's legitimacy, would any VCs, crypto influencers, crypto investors, major FTX depositors, or regulators have paid any attention? (Bearing in mind all crypto exchanges, protocols, and companies are subject to a relentless barrage of strategic or tactical 'fear, uncertainty, & doubt' (FUD) from rival organizations, short-sellers, 'mainstream' (anti-crypto) financial journalism, and 'legacy' (anti-crypto) financial institutions.)

These are honest questions; I really don't know the answers, and I'd value any comments from people with more insider knowledge than I have.

Ubuntu @ 2023-03-21T09:33 (+14)

I want to emphasise that Background section 5 is the OP saying, "The recent TIME article doesn’t make a very precise argument; here is my attempt at steelmanning/clarifying a major argument made in that article, which I will then respond to ... “EA leaders” ... did not take enough preventative action and are therefore (partly) responsible for FTX’s collapse".

In other words, I don't think Ben is "suggesting" EA leaders are partly responsible. I think Ben is saying "I think TIME is claiming they are? Well,  here's my response..."

Ubuntu @ 2023-03-21T10:10 (+23)

(But I'm glad you ask these questions; the apparent prevalence and persistence of hindsight bias in the EA movement today has been one of the biggest updates for me in recent months. I wondered if it might be because EA had generally been selecting for something like 'smart' but not 'rationalist,' but I'm not sure that the rationalists have fared much better and I think people outside both communities do tend to fare better in relation to EA events. My latest theory is just that I'd underestimated the allure of gossip, public shaming, witch hunts etc, and how easy it is to stir things up in an online world. Maybe I should read some of your work - could be a grounding counterweight to the lofty rationalist and altruistic ideals I have for myself and this community!)

Geoffrey Miller @ 2023-03-21T15:44 (+5)

Ubuntu - yes, regarding the underestimated 'allure of gossip, public shaming, witch hunts, etc', I think the moral psychology at work in these things runs so deep that even the most rationalist & clever EAs can be prone to them -- and then we can sometimes deceive ourselves about what's really going on.

However, the moral psychology around public shaming evolved for some good adaptive reasons, to help deter bad actors, solve coordination problems, enforce social norms, virtue-signal our values, internalize self-control heuristics, etc. So I don't think we should dismiss them entirely. (My 2019 book 'Virtue Signaling' addresses some of these issues.)

Indeed, leveraging the power of these 'darker' facets of moral psychology (e.g. public shaming) has arguably been crucial in many effective moral crusades throughout history, e.g. against torture, slavery, sexism, racism, nuclear brinksmanship, chemical weapons, etc. They may still prove useful in fighting against AI X-risk...

Jason @ 2023-03-22T01:18 (+22)

I think it would be problematic if a society heaped full adoration on risk-takers when their risks worked out, but doled out negative social consequences (which I'll call "shame" to track your comment) only based on ex ante expected-value analysis when things went awry. That would overincentivize risktaking. 

To maintain proper incentives, one could argue that society should map the amount of public shame/adoration to the expected value of the decision(s) made in cases like this, whether the risk works out or not. However, it would be both difficult and burdensome to figure out all the decisions someone made, assign an EV to each, and then sum to determine how much public shame or adoration the person should get. 

By assigning shame or adoration primarily based on the observed outcome, society administers the shame/adoration incentives in a way that at least makes the EV of public shame/adoration at least somewhat related to the EV of the decision(s) made. Unfortunately, that approach means that people whose risks don't pan out often end up with shame that may not be morally justified.

Ubuntu @ 2023-03-21T16:27 (+5)

Yeah that's a fair point to raise. I guess I'm just lamenting that these facets aren't refined enough to catch less false positives by this point.

Geoffrey Miller @ 2023-03-21T15:36 (+9)

Ubuntu - thanks for the correction; you're right; I misread that section as reflecting Ben's views, rather than as his steel-manning of TIME's views. Oops.

So, please take my reply as a critique of TIME's view, rather than as a critique of Ben's view.

Jason @ 2023-03-21T17:24 (+4)

In a universe where EA leaders had a sufficiently high index of suspicion, they could have at least started publicly distancing themselves from SBF and done one of two things: (1) stop working with FTXFF or encouraging people to apply, and/or (2) obtain "insurance" against fraudlent collapse by enlisting some megadonors who privately agreed in advance to immediately commit to repay all monies paid out to EA-aligned grantees if fraud ended up being discovered that inflicted relevant losses.

Public whistleblowing would likely have been terrible . . .if the evidence were strong enough (which I really doubt it was) then it should have been communicated to the US Department of Justice or another appropriate government agency.

ESRogs @ 2023-03-21T22:38 (+13)

Your summary of the article's thesis doesn't seem right to me:

b. Even though those EAs (including myself) quit before FTX was founded and therefore could not have had any first-hand knowledge of this improper relationship between AR and FTX, they knew things (like information about Sam’s character) which would have enabled them to predict that something bad would happen

c. This information was passed on to “EA leaders”, who did not take enough preventative action and are therefore (partly) responsible for FTX’s collapse

I interpreted the article as arguing more that EA leaders should not have promoted FTX / Sam as a model to look up to, or aligned themselves with him, rather than that they should have somehow prevented the fraud.

The article has this to say about the knowledge and responsibility of early employees:

None of the early Alameda employees who witnessed Bankman-Fried’s behavior years earlier say they anticipated this level of alleged criminal fraud. There was no “smoking gun,” as one put it, that revealed specific examples of lawbreaking. Even if they knew Bankman-Fried was dishonest and unethical, they say, none of them could have foreseen a fraud of this scope.

... which really doesn't sound to me like it's blaming those early employees for what happened. If anything, they come across as the heroes of the story!

In contrast, what seems to be particularly highlighted in the article is Will MacAskill's association with Sam:

Even after Bankman-Fried left the board of CEA, he retained MacAskill’s support, both in public and private. In a 2022 interview on the 80,000 Hours podcast, MacAskill describes himself as “remarkably aligned with Sam,” and said the FTX Future Fund could be a “an enormous inflection point for EA.” FTX advertisements used the language of effective altruism. “I’m on crypto because I want to make the biggest global impact for good,” read one FTX ad, which featured a photo of Bankman-Fried.

So the thesis of the article seems to me more like, "EA leaders (esp. Will) should have known this guy was sketchy and stayed away." rather than "EA leaders should have prevented the FTX fraud."

Ubuntu @ 2023-03-21T23:22 (+41)

The article reads to me like it's trying to get away with insinuating that EA leaders somehow knew about or at least suspected the fraud, based on what they were told by employees who had no such suspicions.

They take pains to emphasise the innocence of their sources, of course - I agree that they're painted as the heroes of the story (emphasis mine): 

None of the early Alameda employees who witnessed Bankman-Fried’s behavior years earlier say they anticipated this level of alleged criminal fraud. There was no “smoking gun,” as one put it, that revealed specific examples of lawbreaking. Even if they knew Bankman-Fried was dishonest and unethical, they say, none of them could have foreseen a fraud of this scope.

While suggesting that despite this, EA leaders somehow knew (emphasis mine):

When Alameda and Bankman-Fried’s cryptocurrency exchange FTX imploded in late 2022, these same effective altruist (EA) leaders professed outrage and ignorance.

...

Multiple EA leaders knew about the red flags surrounding Bankman-Fried

...

“I was shocked at how much of what came out about FTX rhymed with the concerns we raised in the early days ... It was the same thing. All of the same problems.”

...

In a planning document prepared for that confrontation and reviewed exclusively by TIME, they accuse him of “gross negligence,” “willful and wanton conduct that is reasonably considered to cause injury,” and “willful and knowing violations of agreements or obligations, particularly with regards to creditors”—all language that echoes the U.S. criminal code.

So I don't think the thesis of the article is simply, "EA leaders (esp. Will) should have known this guy was sketchy and stayed away."

And let's be honest, "These people said some positive things about a sketchy rich guy and gave him philanthropic advice" is not a story - they wouldn't be writing it if that was what they were trying to convey.

"These people knew about one of the biggest financial frauds in U.S. history but didn't try to stop it" - now that's a story.

ESRogs @ 2023-03-21T23:56 (+12)

These people knew about one of the biggest financial frauds in U.S. history but didn't try to stop it

I think you're stretching here. Nowhere in the article does it suggest that the EA leaders actually knew about ongoing fraud.

It just says (as in the quotes you cited), that they'd been warned Sam was shady. That's very different from having actual knowledge of ongoing fraud. If the article wanted to make that claim, I think it would have been more direct about it.

Evan_Gaensbauer @ 2024-01-17T07:02 (+2)

I'm sorry to hear to join Alameda under the impression that it would be the opposite of what it became to be, like happened to so many others, is the reason you quit the company you had founded. I didn't know you stopped working at the company you founded to work at Alameda.

At the time, I thought you had maybe sold your stake in it or something so you'd have a lot of cash to donate while moving onto an opportunity to do way more good in some other job at the advice of 80k or whoever. I thought it seemed strange you had left the company you founded then, given that it seemed unlikely you could find that much of a higher-impact job that would outweigh the value of the money you could gain to donate if you stuck at Health eFilings for a while longer. I was sad you left the company at that point because it seemed to me you could've gotten more good done there. I was glad to hear you were hired at the CEA, though I felt like it was strange to learn about your exciting new job a few months after you stopped working at Health eFilings, when I thought it's something you'd want to tell the rest of us about right away.

In a way, I was right about all of that. I wish I had read this post when you first published it last year, though it's still interesting to be someone who has also participated in the EA community for that long and to know the fuller story now.

Ben_West @ 2024-01-18T18:35 (+4)

Thanks Evan, I appreciate the kind words!

And yeah, in retrospect staying at HeF would almost certainly have been more valuable, but oh well...