837

LESSWRONG
LW

836
DeepMindAI
Frontpage

34

Gwern about centaurs: there is no chance that any useful man+machine combination will work together for more than 10 years, as humans soon will be only a liability

by avturchin
15th Dec 2018
1 min read
4

34

This is a linkpost for https://www.reddit.com/r/reinforcementlearning/comments/a3rbm3/alphazero_shedding_new_light_on_the_grand_games/

34

Gwern about centaurs: there is no chance that any useful man+machine combination will work together for more than 10 years, as humans soon will be only a liability
2norswap
9gwern
2habryka
1avturchin
New Comment
4 comments, sorted by
top scoring
Click to highlight new comments since: Today at 7:32 AM
[-]norswap7y20

I don't think one can generalize so easily from bounded-options full-information games like those to the whole range of human endeavours.

Reply
[-]gwern4y90

Then Cowen and Kasparov should not have gone around saying and writing books about how you should generalize from bounded-options full-information games to the whole range of human endeavours - back when the generalization was one they liked, anyway. (Cowen no longer brings it up.)

Reply
[-]habryka7y20

Edit note: Cleaned up the quote formatting a bit. Let me know if you want me to revert that.

Reply
[-]avturchin7y10

Thanks, it much better now!

Reply
Moderation Log
More from avturchin
View more
Curated and popular this week
4Comments
DeepMindAI
Frontpage

This is a quote from the discussion in Reddit (responding to another commenter):

"I remember and I kind of subscribe to this idea of "man+machines as a future of work". I think Tyler Cowen implanted this idea into my head"
Yes, Cowen was big on that too in stuff like Average is Over.
Very irresponsible of them to try to foster complacency like that. It should have been beyond obvious that there was no reason chess engines wouldn't keep improving and that at some point very quickly, far from representing a new stable paradigm and a reason to not worry about technological unemployment, the 'centaur' would be a net liability. As far as I can tell, in chess, the centaur era lasted barely a decade, and would've been shorter still had anyone been seriously researching computer chess rather than disbanding research after Deep Blue or the centaur tournaments kept running instead of stopping a while ago. In Go, it lasted a year at best (if we assume that world champs like Lee Sedol could spot 'delusions' like made it lose a game to Lee Sedol and contribute at all, but then by the Ke Jie tournament with Master, between Master's performance and the various match settings, it looked like humans were way far behind and liabilities when paired with Master, and even if we doubt that, Zero then came out and superseded Master entirely). Not very comforting precedents... The idea was nice but it doesn't work.