onslaught — LessWrong

I am a fan of Yudkowsky and it was nice hearing him of Ezra Klein, but I would have to say that for my part the arguments didn't feel very tight in this one. Less so than in IABED (which I thought was good not great).

Ezra seems to contend that surely we have evidence that we can at least kind of align current systems to at least basically what we usually want most of the time. I think this is reasonable. He contends that maybe that level of "mostly works" as well as the opportunity to gradually give feedback and increment current systems seems like it... (read more)

TsviBT's Shortform

onslaught8mo10

Hey, thanks for engaging.

I read what I thought were the relevant excerpts in what you linked there. I hadn't really crossed paths with you before, but you seem to have a rich ontology and lexicon when it comes to theory of mind.

I am not sure if that pinpoints the disagreement or not. We might just be talking past each other. I'll tell you what I think creativity is and then I'll restate my objection to your prediction.

I do think "creativity" is a useful word, just maybe not a load bearing one in my ontology.

Like, if I really like a story ... (read more)

TsviBT's Shortform

onslaught8mo20

I think this puts a lot of weight on a bespoke definition of "interesting" and that kind of obscures what you're saying. I feel similar about your use of the concept of creativity.

I think that current LLMs are extremely "creative" for many plausible definitions of that word, so I guess it doesn't really carve things at the joints for me. Visual art, stories, plausible baby names, what sorts of recipes you can try with x ingredients. All written-ont-the-tin use cases for these things.

I do not believe that LLMs think very much in the manner that we do at all. I just don't think I would pitch that as lacking some true spark of creativity or something. It is too opaque to me what you're saying.

Shortform

onslaught9mo20

"Metalhead" from Black Mirror is a relevant contemporary art piece.

I for one find Spot spooky as hell. I would go as far as to say that I have heard others express discomfort toward Boston Dynamics demo videos.

Also, sentry guns and UAVs seem like strong examples of extant scary robots. Maybe see also autonomousweaponswatch.org .

Become a Superintelligence Yourself

onslaught9mo30

Hey, very interesting post!

I enjoyed the "become a superintelligence" framing / thought experiment. I am not sure I fully believe the "armed balance of power" b/w Superintelligences part as stated, but I can imagine something similar I might agree with.

Ultra charged human intelligence and IA are both interesting areas to me. I think writing and database search are both interesting examples of IA information technologies to use as a foil to a world of AI servants.

I couldn't really understand what Crystallect was doing/going for, but I like... (read more)

onslaught9mo10

But who night-watches the night-watchman?

Thank you for providing a more concrete vision of a sort of "light touch good guy singleton AI" world.

I agree that "AI for peace" is broadly good. I also believe that we should collectively prioritize existential security and that this is maybe one of the most noble uses of "power" and "advanced AI".

However, I still have some serious hangups with this plan. For one thing, while I understand the desire to kick certain questions of cosmic importance down the road to a more reflective process than oneself, ... (read more)