Risks from Bad Space Governance
By Yannick_Muehlhaeuser @ 2023-07-17T12:36 (+43)
Starting last year, the EA community has put more focus on space governance. This piece is part of this process and is seeking to collect the reasons why having bad or non-existing space governance might be very harmful.
The distinction between near- and long-term risks is fuzzy. I am differentiating between the risks we face in the next few centuries and the risks which will be faced in the very long-run future.
The individual risks are not fully disjunctive. They should be viewed as pointers in the direction of a risk rather than fully distinct buckets.
Since long-termist space governance is a very young field, it’s not clear that this typology will stand the test of time. This post is meant to give us more clarity now to more effectively conduct the relevant research.
Near Term
Unsustainability
Space Expansion could be conducted in a way that later proves unsustainable. The resources in the earth’s immediate vicinity are overexploited early and their absence makes space expansion harder than it otherwise would be. This could set back the project of space expansion for significant amounts of time.
Examples of resources in near-Earth space which could be depleted include the limited number of comets that come close to earth and the ice on the lunar poles. Intensive utilization of Earth Orbit might lead to accidents causing Kessler Syndrome, which would be costly to clean up. Particularly valuable orbits (GEO/SSO/ISS zone) could also become crowded.
We believe that risks in this category are a lot less important than the other ones.
Negative Impact on Governance on Earth
Even before significant parts of human civilization resides in space, space expansion has the potential to impact the geopolitical balance on earth in a negative way.
A malevolent actor that is in a subordinate military position on earth could use strategic investment in space capabilities as a way to put themselves in a superior position. As satellite capabilities become more and more crucial to modern war, an actor could make strategic and focussed investments in that area.
In general the politics of space are a potentially controversial issue. A distribution of benefits that are perceived as 'unfair' could introduce political instability. Since there is no history of humanity distributing resources from space and violence has historically been associated with the conquest of new frontiers, this is a risk not to be neglected. Disagreement about it could make cooperation on other existential risk relevant issues.
Increasing Existential Risk
As more human activity shifts off earth, it may get harder to regulate, since humanity has little experience with space governance and the proper regulatory regime has yet to be set up. This means that the governance of a variety of dangerous technologies gets harder. So we can expect space expansion to increase all risks that require global governance.
We may expect Space Expansion to accelerate the deployment of AI systems, as they are more important in space than on earth. This is because space is quite inhospitable to humans and ensuring they are protected at all times while executing tasks can be expected to be quite expensive. Making AI systems harder to regulate and increasing humanity’s reliance on them might increase the risk of the "Going out with a whimper" described by Paul Christiano.
As development of the relevant technologies proceeds, more and more actors are going to have access to space and may be able to use it to do harm. One example is the deliberate diversion of asteroids towards earth. As Carl Sagan noted, any method capable of deflecting an asteroid away from earth could also be used by malevolent actors to steer an asteroid towards it.
For more details on this topic I recommend this paper by Carson Ezell.
Long Term
Suboptimal Resource Use
Whatever goals humanity may have in the future, almost everything we may want to accomplish is limited by the amount of matter in the universe and the physical and cosmological laws governing it. For some moral views, the amount of energy we can utilize is directly proportional to the amount of value we can create. If space expansion is done in a chaotic, uncoordinated way, resources may be wasted, causing us to fall short of our potential.
Harmful Irreversible Measures
On the current view of humanity's possible futures there are things ahead that - once they are executed - might only be reversible at very high cost. Examples are accidental biological contamination, deliberate panspermia, or space expansion via automated self-replicating probes. Those things could later prove suboptimal or even immoral upon reflection.
Any future Space Governance Framework should ensure that such actions are alway preceded by a long period of reflection or are executed in a more reversible manner. We can expect this to be a hard challenge, since many of the examples listed above are subject to unilateral action and a lot of coordination or enforcement might be needed to avoid them.
Using Control over Space to enforce Totalitarianism
On Earth it has so far been impossible for a single actor to establish control over the entire planet. Totalitarian regimes were always limited to a fraction of the Earth’s surface. If humanity establishes more control over outer space or human life even plays out in space primarily, the obstacles we have seen on earth thus far may no longer apply.
Establishing total control over space will likely give an actor a decisive advantage over any great power limited to earth. From there it might be possible to establish a space governance framework that ensures totalitarian power for a long period of time.
This risk is different from the claim that moving the political playing field from earth to space increases the risk for all encompassing totalitarianism - the opposite might be the case. But space expansion could present one additional opportunity for it.
Permanent War
A different scenario we should try to steer away from is one where space is inhabited by many different actors in permanent military confrontation. Instability could come from lack of trust due to the lack of communication over long distances or an OD Balance heavily favoring the offense and strongly pushing actors towards a first strike.
Dangerous Competition Dynamics
A politically unstable governance order could also lead to competition dynamics.
For instance, if there is no credible way of ensuring peaceful coexistence, different coalitions may be forced to allocate most of their resources to defense instead of ensuring a flourishing civilization.
Another example: different actors expend lots of resources to increase their speed of expansion, as described by Robin Hanson in “Burning the Cosmic Commons”.
Inability to coordinate on Large Scale Projects
In general we want to be able to coordinate on important large projects. One example of a large scale project is aestivation - the idea that civilization should delay most computation until the average temperature of the universe is lower, allowing for more efficiency.
Another example could be the moving of galaxies into so-called hyperclusters, which could counteract the increase of the distances between them due to the expansion of the universe.
Inability to coordinate on such projects could lead to wasted resources and leave us unable to reach the most desired end states of space expansion.
Inability to Enforce Rules
While we currently can’t be sure how an optimal governance order beyond earth should look, we know that we want it to be able to enforce certain rules over all inhabited parts of the universe. We want to stop malevolent actors from deliberately or instrumentally producing a lot of suffering - in physical as well as digital form. We might also want to ban actors from unilaterally moving stars and galaxies as well as wasting a lot of energy in general. Actors should also launch not be able to launch dangerous self-replicating devices or deliberately or accidentally produce vacuum decay.
Suffering Risks
Space expansion allows for the existence of many more sentient beings than would be possible on earth - in physical and potentially in digital form. This means space expansion can enable a lot of good, but also contains the risk of astronomical suffering.
Humanity may choose to terraform and spread wildlife to other planets or wildlife may be part of artificial settlements.
Digital beings might exist for a variety of purposes and for reasons of entertainment, economic productivity or information gain they may experience a lot of suffering.
If it is possible to create universes in a laboratory, this could also constitute an s-risk under certain circumstances.
Bad Response to Extraterrestrial Intelligence
There is a sufficiently large chance that in the process of expanding to other stars and galaxy humanity’s descendants might encounter ETI. This would be an outcome that is very hard to plan for and entails the potential for catastrophic outcomes.
The worst outcome is probably a very destructive war, but scenarios in which one of the parties quickly defeats and forces its preference upon the other could be very bad.
Ideally the way space expansion is conducted and the governance framework would be set up in a way to minimize the chance of a very bad outcome. It should also entail the flexibility to arrange for the best outcome given the specific conditions of the encounter.
Unknown Unknowns
Then there could still be risks that we don’t have the ability to fully grasp yet. A good space governance framework should be able to respond appropriately to such unknown unknowns.
This is one of the pieces written as part of the CHERI Summer Research Program 2022. I whole-heartedly thank the organisers for giving me this opportunity and Joseph Levin for being my mentor.
A significant proportion of work during that time went into the Space Futures Initiative research agenda. I am planning to publish the rest of my work going forward.
Originally this was meant to be part of a larger sequence I planned to write. Since then I have decided against continuing that work and am publishing the drafts as they are. I might write about my view on Space Governance as a cause area in the future.
zdgroff @ 2023-07-17T15:38 (+9)
I'm very glad to see you working and thinking about this—it seems pretty neglected within the EA community. (I'm aware of and agree with the thought that speeding up space settlement is not a priority, but making sure it goes well if it happens does seem important.)