Benny Smith's Quick takes

Steelmanning is typically described as responding to the “strongest” version of an argument you can think of.

Recently, I heard someone describe it a slightly different way, as responding to the argument that you “agree with the most.” 

I like this framing because it signals an extra layer of epistemic humility: I am not a perfect judge of what the best possible argument is for a claim. In fact, reasonable people often disagree on what constitutes a strong argument for a given claim.

This framing also helps avoid a tone of condescension that sometimes comes with steelmanning. I’ve been in a few conversations in which someone says they are “steelmanning” some claim X, but says it in a tone of voice that communicates two things:

• The speaker thinks that X is crazy.
• The speaker thinks that those who believe X need help coming up with a sane justification for X, because X-believers are either stupid or crazy.

It’s probably fine to have this tone of voice if you’re talking about flat earthers or young earth creationists, and are only “steelmanning” X as a silly intellectual exercise. But if you’re in a serious discussion, framing “steelmanning” as being about the argument you "agree with the most" rather than the "strongest" argument might help signal that you take the other side seriously.

Anyone have thoughts on this? Has this been discussed before? 

Discussions of the long-term future often leave me worrying that there is a tension between democratic decision-making and protecting the interests of all moral patients (e.g. animals). I imagine two possible outcomes:

1. Mainstream political coalitions make the decisions in their usual haphazard manner. 
   1. RISK: vast numbers of moral patients are ignored.
2. A small political cadre gains power and ensures that all moral patients are represented in decision-making.
   1. RISK: the cadre lacks restraint and leaves its fingerprints on the future.

Neither of these is what we should want.

CLAIM: The most straightforward way to dissolve this tradeoff is to get the mainstream coalitions to care about all sentient beings before they make irreversible decisions.

How?

• A major push to change public opinion on animal welfare. Conventional wisdom in EA is to prioritize corporate campaigns over veg outreach for cost effectiveness reasons. The tradeoff I've described here is a point in favor of large-scale outreach.
  
  I don't just mean 10x of your grandpa's vegan leafletting. A megaproject-scale campaign would be an entirely different phenomenon.
   
• A Long Reflection. Give society time to come to its senses on nonhuman sentience.

Of course, the importance of changing public opinion depends a lot on how hingey you think the future is, and tractability depends on how close you think we are to the hinge. But in general, I think this is an underrated point for moral circle expansion.

Animal and AI Consciousness in The Economist

https://www.economist.com/science-and-technology/2023/06/28/thousands-of-species-of-animals-likely-have-consciousness

A succinct discussion of the current state of our understanding of consciousness. I love seeing things like this in mainstream media.

Interestingly, there's also a reference to AI risk at the end:

As to conscious AI, Yoshua Bengio of the University of Montreal, a pioneer of the modern deep-learning approach to AI, told the meeting he believes it might be possible to achieve consciousness in a machine using the global-workspace approach. He explained the advantages this might bring, including being able to generalise results with fewer data than the present generation of enormous models require. His fear, though, is that someone will build a self-preservation instinct into a conscious AI, which could result in its running out of control.

This paragraph probably leaves readers with two misconceptions. 

1. The wording implies that Bengio's main worry is deliberate coding of a self-preservation instinct, whereas the more prevalent concern is instrumental convergence. 
2. Readers may conclude that consciousness is required for AI to be dangerous, which is not the case.

It also would have been nice for the article to mention the ethical implications for how we treat nonhuman minds, but that's usually too much to ask for.

Perhaps someone with better credentials than me could write them a letter.

There’s no Wikipedia article on Leah Garcés. This problem seems pretty tractable.