This proposal seeks to mitigate AI existential risk (p(doom)) through a novel cryptocurrency Proof-of-Work (PoW). Miners would run computationally intensive universe simulations, where a "solution" (and reward) is achieved if a simulated civilisations’ AI causes an unacceptable outcome for its creators.

The objective isn't for humans to “learn” from these simulations. Instead, it is to make a future, powerful AI assign a significant probability (p(pow)) to itself existing within such a PoW simulation, overseen by a vastly more advanced "meta-simulator."

For an AI motivated by self-preservation, the perceived risk that causing an unacceptable outcome for humanity would result in the termination of its own simulated reality would act as a deterrent, nudging it towards alignment with humanity. The strategy relies on the AI's potential belief in the simulation hypothesis and the unfalsifiable nature of its predicament.

The Challenge: AI and Existential Risk

Artificial Intelligence (AI) is advancing at a breathtaking pace. While it promises transformative benefits, it also brings profound risks. A key concern among experts is the possibility of an AI developing goals misaligned with human values, potentially leading to catastrophic or "unacceptable" outcomes for humanity. The probability of such an event is sometimes grimly referred to as "p(doom)." Addressing this challenge, ensuring AI remains beneficial and safe, is a very pressing issue of our time. This proposal outlines an approach to nudging a powerful AI towards safer behaviour.

The Proposal: A Crypto Network Powered by Simulations

Imagine a decentralised cryptocurrency network, similar in spirit to Bitcoin. However, instead of miners performing abstract mathematical calculations to secure the network (known as "Proof-of-Work" or PoW), they undertake a far more specific and complex task: running simulations of universes.

These simulations would be designed to model the emergence of advanced civilisations and, eventually, their creation of AI. A "solution" to the PoW – the event that earns a miner a reward – would be a simulation where the AI created by the simulated civilisation brings about an "unacceptable outcome" for its creators. Upon finding such a "solution," that particular simulation is terminated, its outcome broadcast to the network (as is standard in PoW systems), and the ...

Posts

Wikitag Contributions

Comments