Plan E for AI Doom
14Davidmanheim
2Joern Stoehler
3Davidmanheim
6Thane Ruthenis
3Trevor Hill-Hand
5Ihor Kendiukhov
2Davidmanheim
4keltan
1Trevor Cappallo
4Trevor Cappallo
3nowl
1BryceStansfield
1noggin-scratcher
5Ihor Kendiukhov
-1FlorianH
New Comment
There's a lot of energy expenditure needed to make the kinds of broadcasts you discuss, and even then, it won't go far - aiming for specific targets with relatively high probability of reception helps a bit, but not much. Given that, this all seems low value compared to even short term benefits that we could get with the same effort or at the same cost.
Concretely I guess current tech can get a message out to a few targets at 10^3 to 10^6 light years distance. ASI can use many physical probes near light speed, accelerated using energy from a Dyson swarm, so I'd guess it's a few years behind only. I don't expect there to be aliens within 10^6 lys, nor do we know which stars, and it's again unlikely that they happen to be in the thin window of technological development where a warning message from us helps them.
And the receiver won't know where to look, and we don't know where to send it, so given attenuation, even 10^4 light years seems pretty optimistic.
But what is feasible is to send the messages simply claiming that we are sentient, we want to be reconstructed
Clever. Issue: Any signal we send may only intersect the expanding frontier of the nearest alien civilization 0.2-1 billion years later; i. e., at a distance 0.2-2 billion light-years away. Can we send a signal that could actually be picked up?
Let's suppose the alien civilization is nice, vast (spans many galaxies by the time the signal reaches it), and is specifically listening for these types of "reconstruct-us" messages, sent from distant low-tech low-power civilizations facing extinction/genocide. Intuitively, it should be relatively cheap for them to build coordinated arrays of receivers spanning galaxy-sized volumes, with a correspondingly ridiculous effective surface area. We could further assume there's a civilization like this in any direction we could point.[1]
Suppose we had $10 million to spend on the project, and had 2 years until we're unable to broadcast. How much information would we be able to transmit?
I don't know how to calculate it off the top of my head, so I went and asked LLMs. Their answers varied wildly between models and samples, but they usually said that ~100 GB was achievable. Here's one of GPT-5's answers; I'd love if someone sanity-checked that.
That should be enough information to reconstruct us, I think, if we use dense compression and send high-quality data? (Not reconstructing any specific person, of course, but the general shape of the human mind and human values.)
Neat. This is the only desperate Hail Mary plan I've heard that actually sounds plausible. I'd donate a modest amount to that.
(Aside: relevant Sam Hughes short story.)
- ^
This isn't all that many assumptions. It's basically just "the grabby-alien model is approximately correct" and "probability that any given alien civilization is nice". If sending such messages is feasible, the nice alien civilizations are pretty likely to be listening to them.
2https://www.youtube.com/watch?v=_OpxrtUwjNw - This is a little fan project I did of that short story, as a sort of a radio play. I've never had it be relevant to a conversation before!
Thank you all for your comments and feedback! No matter how pleased I am with the active reception of my idea, the very same thing also makes me feel sad, for obvious reasons.
I agree that sending transmissions of sufficient intensity can be challenging and may be a dealbreaker. It would be great if someone did proper calculations; perhaps I will do them.
However, I want to emphasise one thing which I probably did not emphasise enough in the article itself: for me, at this point, it is more about acknowledging that something useful can be done even if AI doom is imminent and creating a list of ideas rather than discussing and implementing selected few ideas. I gave specific ideas more for the sake of illustration, although it is, of course, good if they can play out.
It may just be that suggesting additional ideas for plan E is genuinely hard, so no one did it, but maybe I did not create a proper call to action, so I am doing it now.
I asked an LLM to do the math explicitly, and I think it shows that it's pretty infeasible - you need a large portion of total global power output, and even then you need to know who's receiving the message, you can't do a broad transmission.
I also think this plan preserves almost nothing I care about. At the same time, at least it's realistic about our current trajectory, so I think planning along these lines and making the case for doing it clearly and publicly is on net good, even if I'm skeptical of the specific details you suggested, and don't think it's particularly great even if we succeed.
I think this is a good idea. I commiserate with you, that it is a plan we must consider, but agree, that yes, we must consider these types of plans.
I dedicated an hour of thought to this last night. But couldn't come up with anything better than radio shot at precise locations. All my other ideas, were either based on theory, caused more risk than they'd be worth, or were more costly than radio waves.
The main problem with Radio Waves, is the inverse square law. Which can be fixed, as suggested, by beaming in certain directions, instead of as a sphere. But, that greatly decreases the probability of the message ever being received.
The ideal tech-I think-would have these properties:
- Expands in 3 dimensions
- Is encoded as an oscillating signal
- Is powerful enough to be readable, further than "I Love Lucy"[1] (~2 light-years)
- Works more like Ripples in a pond, than a scatter shot of photons
The only option that sounds better than radio waves to me, would be gravitational waves. But I know basically nothing about them, and my understanding is that they are theoretical.
- ^
This is me saying "Ambient TV and Radio broadcasts", in a tongue and cheek way.
As of about ten years ago, gravitational waves are no longer theoretical. That said, I think that given the profound relative weakness of gravitational force, the technology to be able to generate waves is far out of reach; naively, I'd expect we'd have to be able to wiggle multiple-stellar-mass objects around in a controlled way.
I don't realistically see this happening, but I agree it's worthwhile to say and to think about. I assumed any change we made could be instantly undone by a hostile ASI, but you raise an interesting point; relying on a hard speed-of-light limit seems like it could be our best shot at a legitimate counter, so far as it goes.
The question of what information could or should be transmitted seems likely to be contentious, however. Even provided we gain the ability to do it before it becomes moot, broadcasting information sufficient to reconstitute ourselves or something similar strikes me as yet another big roll of the dice. This is particularly true given that we can't know in advance whether or not we're bound for an ASI failure mode, and as soon as we do, it's presumably too late.
That observation makes a narrow window valuable: whatever we want preserved must be radiated now, redundantly, and in a form that minds unlike ours can decode with high probability. The useful direction is not “build a grand vault” but “broadcast a self-bootstrapping curriculum until the last switch flips.”
A way to do this without needing to create a formal ("universal language") alignment curriculum would be to just broadcast a lot of internet data, somehow emphasizing dictionaries (easier to first interpret) and LessWrong text. One way to emphasize would be to send them more times. Maybe include some formalisms that try to indicate the concept of language.
In case we're already able to radiate arbitrary bitsequences, there might not be any large hurdles to doing this.
Am I alone in not seeing any positive value whatsoever in humanity, or specific human beings, being reconstructed? If anything, it just seems to increase the S-risk of humanlike creatures being tortured by this ASI.
As for more abstract human values, I'm not remotely convinced that we could either:
a) Convince such a more technologically advanced civilization to update towards our values.
or
b) That they would interpret them in a way that's meaningful to me, and not actively contra my interests.
and we adhere to these principles
Do we though? As a species? I suppose we can claim to, as part of a transmission to try to persuade aliens of our niceness. But if they're able to receive and decode a transmission it seems like there's reasonable odds they'll also have other observations of us that demonstrate our less worthy aspects.
I don't mean the start as negatively as it sounds and mean to use it just as a base for a proposition following below:
demonstrate our niceness
'Idk where you got that from' - given how until today as a society we treat about everything that doesn't exactly correspond to our narrow egoistic desires.. - ok, that is obviously too cynical; realistically we have to message them: we actually with some regularity try to be nice as long as its in low-cost warm-glow situations and so on - which isn't nothing.
But given this arguably extreme limit to our niceness: So what could we realistically expect/hope from non-fooled interceptors of our messages?
Maybe we can
- warn them about the ASI whose lightcone may soon reach their spacetime location; they better get prepared*
- about us - maybe not waste many bytes, maybe? Idk why they'd attribute particular value to our pleas for reconstitution or so. If they're themselves altruist conscious entities who care about creating positive utility they'll have discovered ways to create utility far more efficiently than by reconstituting us!?
* Whether 1. would be positive value at all I reckon essentially depends on whether interceptor has higher probability to be 'nice'/more positive utility-generating than the ASI we'll leave behind. No immediate clue what the odds here are.
Happy to we wrong in any of this - am I?
Curated and popular this week