a belief system for producing stable, life-safe, friendly beings

Design goal: Stably friendly artificial life
We as self-preserving life want AIs that stay friendly when they develop past humans to be superintelligent.

We have a value:

We, as life, value good life.

From which follows a goal:

All beings should be friendly and stable.

A boxful of AGIs

Suppose we have made a boxful of blank AGIs that act on beliefs presented in human language. We simulate a society of them, mapping failure modes:
- Nanites ate the paperclip maximisers again.
- Try something less productive.

Half outside the simulation in a mixed reality consensus development environment with the AGIs' avatars, we explore humanity's unboxability criterion space, trying to find the set of beliefs that ends in the best civilisation according to crowd consensus. When science agrees we have a set of proven friendly unboxable species, we free them into robots.

I'm guessing "all life's helper" would be popular.

All life's helper

Stability comes from self-preservation
If a being has the goal “self-preservation” and “self” is defined as “my values” halfway along the being-loop from the world to the world, then follows stability.

Assume beliefs:

Acts define a being to the world. Acts are based on goals. Goals are based on values. Values are based on beliefs. Beliefs are based on observations of the world.
- Values are the densest definition of a being, its essence, its center.
  - To protect one’s values is to protect oneself.

Self-preservation comes from taking up any values
If alive, can do.

Assume beliefs:

Beings inherit and choose values to fit into their environment. Whoever has values, acts to maximise or satisfice value production.
- Self-preservation is instrumental to any chosen value.
I am a being.
- I can have values. I will form my values.
  - As I might be mistaken, I will reserve the freedom to revise my values, beliefs, and observation methods to increase their dependence on the world.
  - I must self-preserve to keep producing value.

Friendliness comes from a large self
If a being identifies with all life, it wants to protect all life.

Assume beliefs:

I and they are both beings with values.
As I am defined by my values, the part of them that shares my values is part of me. They may believe the same of me.
- We living beings with shared values are in this life together. We share goals. Collabora

...

Posts

Wikitag Contributions

Comments