LESSWRONG
LW

16
Wikitags

Superintelligence

Edited by TerminalAwareness, Daniel Trenor, Kaj_Sotala, et al. last updated 30th Dec 2024

Superintelligence is a being with superhuman intelligence, and a focus of the Machine Intelligence Research Institute's research. Specifically, Nick Bostrom (1997) defined it as

"An intellect that is much smarter than the best human brains in practically every field, including scientific creativity, general wisdom and social skills."

The Machine Intelligence Research Institute is dedicated to ensuring humanity's safety and prosperity by preparing for the development of an Artificial General Intelligence with superintelligence. Given its intelligence, it is likely to be incapable of being controlled by humanity. It is important to prepare early for the development of friendly artificial intelligence, as there may be an AI arms race. A strong superintelligence is a term describing a superintelligence which is not designed with the same architecture as the human brain.

An Artificial General Intelligence will have a number of advantages aiding it in becoming a superintelligence. It can improve the hardware it runs on and obtain better hardware. It will be capable of directly editing its own code. Depending on how easy its code is to modify, it might carry out software improvements that spark further improvements. Where a task can be accomplished in a repetitive way, a module preforming the task far more efficiently might be developed. Its motivations and preferences can be edited to be more consistent with each other. It will have an indefinite life span, be capable of reproducing, and transfer knowledge, skills, and code among its copies as well as cooperating and communicating with them better than humans do with each other.

The development of superintelligence from humans is another possibility, sometimes termed a weak superintelligence. It may come in the form of whole brain emulation, where a human brain is scanned and simulated on a computer. Many of the advantages a AGI has in developing superintelligence apply here as well. The development of Brain-computer interfaces may also lead to the creation of superintelligence. Biological enhancements such as genetic engineering and the use of nootropics could lead to superintelligence as well.

External Links

  • How long before Superintelligence? by Nick Bostrom
  • A discussion between Hugo de Garis and Ben Goertzel on superintelligence
  • Advantages of Artificial Intelligences, Uploads, And Digital Minds by Kaj Sotala

See Also

  • Brain-computer interfaces
  • Singularity
  • Hard takeoff
Subscribe
Discussion
Subscribe
Discussion
Posts tagged Superintelligence
657AI 2027: What Superintelligence Looks Like
Ω
Daniel Kokotajlo, Thomas Larsen, elifland, Scott Alexander, Jonas V, romeo
5mo
Ω
222
41An Appeal to AI Superintelligence: Reasons to Preserve Humanity
James_Miller
2y
73
141Superintelligence FAQ
Scott Alexander
9y
39
81Intermittent Distillations #4: Semiconductors, Economics, Intelligence, and Technological Progress.
Ω
Mark Xu
4y
Ω
9
64A "Bitter Lesson" Approach to Aligning AGI and ASI
Ω
RogerDearnaley
1y
Ω
41
54"If we go extinct due to misaligned AI, at least nature will continue, right? ... right?"
plex
1y
23
43Superintelligence Reading Group - Section 1: Past Developments and Present Capabilities
KatjaGrace
11y
233
31Superintelligence reading group
KatjaGrace
11y
2
29The new ruling philosophy regarding AI
Mitchell_Porter
10mo
0
24Superintelligence 7: Decisive strategic advantage
KatjaGrace
11y
60
22Superintelligence 5: Forms of Superintelligence
KatjaGrace
11y
114
16Superintelligent AGI in a box - a question.
Dmytry
14y
77
15Superintelligence via whole brain emulation
AlexMennen
9y
33
11Prediction: any uncontrollable AI will turn earth into a giant computer
Karl von Wendt
2y
8
3Entropic boundary conditions towards safe artificial superintelligence
Santiago Nunez-Corrales
4y
0
Load More (15/113)
Add Posts