LESSWRONG
LW

by Jia1 min read29th Sep 20204 comments

10

World OptimizationAI
Frontpage

Cross-posted from the EA Forum

I'm searching for examples of self-governance efforts to reduce technology risk. Do people have cases to suggest?

The more similar to AI development the better. That is, efforts by companies or academic communities to address risks that affect third parties, with minimal involvement from governments beyond basic law and order.

Examples from academia:

  • Leo Szilard and other physicists coordinating to prevent Germany from obtaining atomic bomb data, 1939-1940
  • Various efforts in biotechnology:
    • Asilomar conference on recombinant DNA, 1975
    • Mutations Database Initiative, 1999-2001
    • Synthetic biology conferences SB1.0 and SB2.0, 2006
    • Biology journals discussing publication restrictions, 2001-2011

Examples from the commercial sector:

  • DNA synthesis companies screening orders and buyers, 2004-2012
  • Efforts by the nanotechnology companies in the US, UK and Europe, 2004-2007
New Answer
Ask Related Question
New Comment

2 Answers sorted by
top scoring

snog toddgrass

Sep 30, 2020

2

Interesting question.

A separate reference class is cartels formed around profitable emerging technology. Many of the examples you cited refer to state lead projects in basic science. We would expect breakthroughs to cluster there because the cutting edge is rarely on the commercial applications side. The problem is that IF artificial intelligence advances become immediately profitable at some time, companies

[-]McP822y 2

The thing with artificial intelligence is that it could be used for dangerous goals, too, and for this, there's no self-organised group of companies that will do their best to prevent that technology from falling in the wrong hands, unfortunately...

Reply

McP82

Sep 30, 2020

2

Were the efforts to prevent North Korea from developing its nuclear technology self-imposed, or was it organised by governments?

[-]Jia2y 1

Thanks, I hadn't considered this series of efforts before! I just spent 15 minutes reading about denuclearization of North Korea, and it seems like most efforts (e.g. IAEA signing and crisis in 1994, withdrawal from NPT in 2003, six-party talks) involve governments and international organisations to a large degree. [1]

But if you've got more information or sources to recommend, I'd love to learn more!

[1] https://www.nti.org/learn/countries/north-korea/nuclear/

Reply

New to LessWrong?

Getting Started

FAQ

Library