Safety engineering for physical systems relies on the known properties of those systems. We may not know what steps the Jeff Bezos AGI (JBAGI) will create his new business empire, but we can probably know something about the properties of the physical resources that would be used to do so, or at minimum, the physical resources required to run JBAGI in the first place.
This suggests that high reliability engineering for safe AGI ought to focus on those known properties. For example, limiting the amount of physical compute, electricity, or other concretely m... (read more)
Safety engineering for physical systems relies on the known properties of those systems. We may not know what steps the Jeff Bezos AGI (JBAGI) will create his new business empire, but we can probably know something about the properties of the physical resources that would be used to do so, or at minimum, the physical resources required to run JBAGI in the first place.
This suggests that high reliability engineering for safe AGI ought to focus on those known properties. For example, limiting the amount of physical compute, electricity, or other concretely m... (read more)