LESSWRONG
LW

1434
Wikitags

Information Hazards

Edited by Ruby, Alex_Altair, et al. last updated 6th Feb 2024

An Information Hazard (or infohazard for short) is some true information that could harm people, or other sentient beings, if known. It is tricky to determine policies on information hazards. Some information might genuinely be dangerous, but excessive controls on information has its own perils. 

This tag is for discussing the phenomenon of Information Hazards and what to do with them. Not for actual Information Hazards themselves.

An example might be a formula for easily creating cold fusion in your garage, which would be very dangerous. Alternatively, it might be an idea that causes great mental harm to people.

Bostrom's Typology of Information Hazards

Nick Bostrom coined the term information hazard in a 2011 paper [1] for Review of Contemporary Philosophy. He defines it as follows:

Information hazard: A risk that arises from the dissemination or the potential dissemination of (true) information that may cause harm or enable some agent to cause harm.

Bostrom points out that this is in contrast to the generally accepted principle of information freedom and that, while rare, the possibility of information hazards needs to be considered when making information policies. He proceeds to categorize and define a large number of sub-types of information hazards. For example, he defines artificial intelligence hazard as:

Artificial intelligence hazard: There could be computer-related risks in which the threat would derive primarily from the cognitive sophistication of the program rather than the specific properties of any actuators to which the system initially has access.

The following table is reproduced from Bostrom 2011 [1].

TYPOLOGY OF INFORMATION HAZARDS
I. By information transfer mode
 Data hazard 
Idea hazard
Attention hazard
Template hazard
Signaling hazard
Evocation hazard
II. By effect
 TYPESUBTYPE
ADVERSARIAL RISKSCompetiveness hazardEnemy Hazard
Intellectual property hazard
Commitment hazard
Knowing-too-much hazard
RISKS TO SOCIAL ORGANIZATION AND MARKETSNorm hazardInformation asymmetry Hazard
Unveiling hazard
Recognition hazard
RISKS OF IRRATIONALITY AND ERRORIdeological hazard 
Distraction and temptation hazard
Role model hazard
Biasing hazard
De-biasing hazard
Neuropsychological hazard
Information-burying hazard
RISKS TO VALUABLE STATES AND ACTIVITIESPsychological reaction hazardDisappointment hazard
Spoiler hazard
Mindset hazard
Belief-constituted value hazard 
(mixed)Embarrassment hazard
RISKS FROM INFORMATION TECHNOLOGY SYSTEMSInformation system hazardInformation infrastructure failure hazard
Information infrastructure misuse hazard
Artificial intelligence hazard
RISKS FROM DEVELOPMENTDevelopment hazard 

See Also

  • Dangerous Knowledge
  • Computation Hazards

References

  1. Bostrom, N. (2011). "Information Hazards: A Typology of Potential Harms from Knowledge". Review of Contemporary Philosophy 10: 44-79.
Subscribe
Discussion
1
Subscribe
Discussion
1
Posts tagged Information Hazards
149Terrorism, Tylenol, and dangerous information
Davis_Kingsley
7y
47
87Bioinfohazards
Spiracular
6y
14
375MIRI announces new "Death With Dignity" strategy
Eliezer Yudkowsky
3y
548
41What are information hazards?
MichaelA
6y
15
86Don't use 'infohazard' for collectively destructive info
Eliezer Yudkowsky
3y
33
68Don't Share Information Exfohazardous on Others' AI-Risk Models
Ω
Thane Ruthenis
2y
Ω
11
33Accurate Models of AI Risk Are Hyperexistential Exfohazards
Thane Ruthenis
3y
38
23Mapping downside risks and information hazards
MichaelA, JustinShovelain, David_Kristoffersson
6y
0
131Conjecture: Internal Infohazard Policy
Ω
Connor Leahy, Sid Black, Chris Scammell, Andrea_Miotti
3y
Ω
6
68Needed: AI infohazard policy
Ω
Vanessa Kosoy
5y
Ω
16
48Thoughts on the Scope of LessWrong's Infohazard Policies
Ben Pace
6y
5
45"Infohazard" is a predominantly conflict-theoretic concept
jessicata
4y
17
18Information hazards: Why you should care and what you can do
MichaelA, JustinShovelain, David_Kristoffersson, algekalipso
6y
4
156The Fusion Power Generator Scenario
Ω
johnswentworth
5y
Ω
30
139Memetic Hazards in Videogames
jimrandomh
15y
164
Load More (15/57)
Add Posts