LESSWRONG
LW

2856
Christo Wilken
5020
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No posts to display.
No wikitag contributions to display.
Capital Ownership Will Not Prevent Human Disempowerment
Christo Wilken10mo32

I think the economic value of long-term agents will be greater than that of agents without such skills, similarly to how an employee who can effectively work towards long-term goals coherently is more economically valuable than an employe that can’t.

I think short-term agentic skills are a subset of long-term agentic skills.

I also object to putting long-term agentic coherence at odds with controllability and direct usefulness. As a thought experiment, imagine two employees: one known to be good at short-term work and one known to be good at long-term work. Who would be more useful? Who would you expect to stay on-task better (1)?

I fear the financial incentives are such that long-term coherent agents are inevitable and will be worked towards at speed.

(1) using “staying on task” as a stand in for controllability.

Reply
Survival without dignity
Christo Wilken1y42

This was wonderful. Anyone have recommendations for similar writing?

Reply