LESSWRONG
LW

628
Wikitags

Dark Arts

Edited by Ruby, et al. last updated 24th Nov 2021

Dark Arts is a colloquial term for techniques or methods which involve deception and/or manipulation of others or oneself into believing things for non-truth-seeking reasons. These techniques may prey on human cognitive biases.

Some use the term to refer more narrowly to techniques that work equally well to compel both true and false beliefs, i.e., they are symmetric weapons. Some focus more on the Dark Arts as applied to oneself (self-deception) vs applied to manipulating others.

An example from the Dark Arts of Rationality:

Today, we're going to talk about Dark rationalist techniques: productivity tools which seem incoherent, mad, and downright irrational. These techniques include:

  1. Willful Inconsistency
  2. Intentional Compartmentalization
  3. Modifying Terminal Goals

Art vs. Technology

Sometimes these arts are further augmented by the use of persuasion technology, such as broadcast advertising or PowerPoint slides. Persuasion technology may prevent the person who is being targeted from carefully deliberating on the intended message, or thinking up an effective response to it in real time.

Such effects can be caused by something as benign as the use of a specialist vocabulary which the target is unfamiliar with, or an institutional vocabulary with high-status connotations: this is one reason why many specialist professions employ ethical codes to regulate their unbalanced power relationship with customers.

The use of such techniques as whiteboards or PowerPoint slides brings additional concerns, since these tend to connote a single party as the one "in charge" of the presentation: this makes it even more difficult for the intended audience to raise any effective objection, and encourages them to focus their attention on the content of the whiteboard or slides. Said content is often presented as a list of abrupt "bullet points", further connoting it as factual, objective and neutral. One outspoken critic of PowerPoint, management professor David R. Beatty, states: "It is like a disease. It's the AIDS of management." Beatty further states that Powerpoint "removes subtlety and thinking".

Many futurists expect that a technological singularity of even a very mild character will lead to an explosion in the use of radically effective persuasive technology, or "cognotechnology"--a term coined by American military researchers at the Lawrence Livermore Laboratories. The collection and distribution of information about people may spiral out beyond any feasible control, perhaps even comprising their inner thought processes; cognitive monitoring may range from non-intrusive body monitoring as seen in a polygraph to outright brain emulation. In this scenario, persuasion technology may easily blend over into outright mind control. This is clearly a rather paranoiac and dystopian scenario; nevertheless, the fact that it is being seriously discussed has persuasive potential in itself, such as for directing funding for research into guaranteed Friendly AI, as opposed to naïvely pursuing expanded funding for neuroscience or artificial intelligence.

Notable Posts

  • Against Propaganda by Robin Hanson
  • Lying With Style by Robin Hanson
  • Defense Against The Dark Arts: Case Study #1 by Yvain
  • Informers and Persuaders by Eliezer_Yudkowsky
  • The Dark Arts - Preamble by Aurini
  • The Dark Arts: A Beginner's Guide by faul_sname

Other Links

  • Meta-commentary on this terminology

See Also

  • Anti-epistemology
  • Curiosity stopper
  • Mind-killer
  • Not technically a lie
  • Inferential distance
Subscribe
Discussion
2
Subscribe
Discussion
2
Posts tagged Dark Arts
262Dark Arts of Rationality
So8res
12y
194
134The Dark Arts
lsusr, Lyrongolem
2y
49
122Law of No Evidence
Zvi
4y
20
127Dark Side Epistemology
Eliezer Yudkowsky
17y
156
77The Dark Arts As A Scaffolding Skill For Rationality
Screwtape
1mo
25
172Game Theory As A Dark Art
Scott Alexander
13y
108
92A few misconceptions surrounding Roko's basilisk
Rob Bensinger
10y
135
47Saying no to the Appleman
Johannes C. Mayer
3y
12
24Defense Against The Dark Arts: An Introduction
Lyrongolem
2y
36
149Defense Against The Dark Arts: Case Study #1
Scott Alexander
16y
54
122How to Bounded Distrust
Zvi
3y
17
115Parasitic Language Games: maintaining ambiguity to hide conflict while burning the commons
Hazard
3y
17
102Dark Arts 101: Using presuppositions
PhilGoetz
15y
87
96Setting the Zero Point
Duncan Sabien (Inactive)
3y
43
65The Dark Arts - Preamble
Aurini
15y
140
Load More (15/46)
Add Posts