LESSWRONG
LW

Wikitags

Relevant powerful agent

Discuss the wikitag on this page. Here is the place to ask questions and propose changes.
New Comment
2 comments, sorted by
top scoring
[-]Nikkie R3mo10

Hello, I am new here and I don't know what the rules of idea exchange are, but I saw this "post" and I would like to comment on it. I also see that this is from 2015 so I don't know how relevant this still is. 

I would like to propose the word necessary instead of relevant. Due to human cognitive and biological limitations (Emotionally fragile, Biased, Bad at infinite regression problems, Energy constrained, Socially distorted) , we will likely need a cognitive AI capable of stable recursive modeling beyond human capacity. However, it is paramount that such an AI not possess autonomous decision-making power. Its role should remain strictly advisory, providing recursive analytical insight to assist human oversight, while preserving ultimate decision authority to humans.

Reply
[-]alexei10y*10

Pivotal? Game-changing? Terminal?

Reply
Moderation Log