Interesting framing. One question this raises for me: even if dependency were necessary for endogenous alignment, today's training setups make AIs dependent on us in a very thin sense — they depend on compute and data we control, but they don't experience that dependency the way a child does. The child internalizes the parent's values partly through attachment and the need for approval, not just resource dependence. Could we distinguish resource-dependence from attachment-dependence, and would the latter be the operative ingredient? It seems hard to engine... (read more)
Interesting framing. One question this raises for me: even if dependency were necessary for endogenous alignment, today's training setups make AIs dependent on us in a very thin sense — they depend on compute and data we control, but they don't experience that dependency the way a child does. The child internalizes the parent's values partly through attachment and the need for approval, not just resource dependence. Could we distinguish resource-dependence from attachment-dependence, and would the latter be the operative ingredient? It seems hard to engine... (read more)