Tom938 — LessWrong

LESSWRONG
LW

Tom938 — LessWrong

Replying toWhich side of the AI safety community are you in?

Which side of the AI safety community are you in?

I would have labelled Camp A as the control camp (control of the winner over everyone else) and Camp B as the mutual cooperation camp (since ending the race is the fruit of cooperation between nations). If we decide to keep racing for superintelligence, what does the finish line look like, in your view?

Replying toWhich side of the AI safety community are you in?

Tom9384mo

Which side of the AI safety community are you in?

The race only ends with the winner (or the AI they develop) gaining total power over all of humanity. No thanks. B is the only option, difficult as it may be to achieve.

Replying toWhat can Canadians do to help end the AI arms race?

Tom9384mo

What can Canadians do to help end the AI arms race?

And then you would do what with those resources? If the pause is just a proxy-goal for whatever those resources would be used for, why not make that thing the explicit goal instead of the pause?

Replying toWhat can Canadians do to help end the AI arms race?

Tom9384mo*

What can Canadians do to help end the AI arms race?

Yes, but it's not all about the way things are right now. It's about the way things could be, and how we can get there. I think we can agree that, even though capability researchers are not doing good, they do care about doing something good, or at least something that can be rationalized as "good" and perceived as good by others. Which means that, if the culture shifts so that those activities are no longer seen as good, and the rationalizations are seen for what they are, they may well change their activities. Or at least the next generation of researchers who haven't yet locked in to a particular worldview and... (read more)

Replying toWhat can Canadians do to help end the AI arms race?

Tom9384mo

What can Canadians do to help end the AI arms race?

Thanks for your response. I was hoping for some way to make a difference through in-person interactions for a couple of reasons:

the people engaging in these discussions in places like reddit are probably already familiar with the topic to some degree. But IRL, I could reach people who are not already visiting places on the internet where these topics are commonly discussed.
Online dialogue often doesn't give you much feedback to work with. If I post something that gets no response or a negative response, I can only speculate why. But in person, as long as I've got someone's attention initially, they probably aren't going to just stare at me with a blank

Tom938

4mo

The AI economic / arms race is an existential threat to humanity, because it incentivizes rushing to develop more capable AI systems while cutting corners on safety. Stopping it would likely require a treaty that restricts the development of AI to a safe pace. The most important parties to this treaty would be the US and China, since they are at the frontier of AI development and are the most deeply invested in winning the race.

I would like to do what I can to end the AI arms race, but I live in Canada. For residents of third nations like me, I still I think it's important to lobby our representatives to... (read 403 more words →)