LESSWRONG
LW

Bias in Evaluating AGI X-Risks
AI RiskHeuristics & BiasesAI
Frontpage

-13

Illusion of truth effect and Ambiguity effect: Bias in Evaluating AGI X-Risks

by Remmelt
5th Jan 2023
1 min read
2

-13

AI RiskHeuristics & BiasesAI
Frontpage

-13

Previous:
Normalcy bias and Base rate neglect: Bias in Evaluating AGI X-Risks
No comments-16 karma
Next:
Anchoring focalism and the Identifiable victim effect: Bias in Evaluating AGI X-Risks
2 comments1 karma
Log in to save where you left off
Illusion of truth effect and Ambiguity effect: Bias in Evaluating AGI X-Risks
17justinpombrio
1Remmelt
New Comment
2 comments, sorted by
top scoring
Click to highlight new comments since: Today at 11:19 PM
[-]justinpombrio3y1718

Meta comment: I'm going to be blunt. Most of this sequence has been fairly heavily downvoted. That reads to me as this community asking to not have more such content. You should consider not posting, or posting elsewhere, or writing many fewer posts of much higher quality (e.g. spending more time, doing more background research, asking someone to proofread). As a data point, I've only posted a couple times, and I spent at least, I dunno, 10+ hours writing each post. As an example of how this might apply to you, if you wrote this whole sequence as a single "reference on biases" and shared that, I bet it would be better received.

Reply
[-]Remmelt3y10

Say maybe Illusion of Truth and Ambiguity Effect each are biasing how researchers in AI Safety evaluate one option below. 

If you had to choose, which bias would more likely apply to which option?

  • A:  Aligning AGI to be safe over the long term is possible in principle.
  • B:  Long-term safe AGI is impossible fundamentally.
Reply
Crossposted from the EA Forum. Click to view 1 comment.
Moderation Log
Curated and popular this week
2Comments

Illusion of truth effect

People are more likely to identify as true statements they have previously heard (even if they cannot consciously remember having heard them before), regardless of the actual validity of the statement.

In other words, a person is more likely to believe a familiar statement than an unfamiliar one.

When combined with the bandwagon effect and/or the mere exposure effect, tends to lead to incorrect conclusions.


  - link Wikipedia:   Illusion of truth effect
  - an item on Forrest Landry's compiled list of biases in evaluating extinction risks.
   


Ambiguity effect

The tendency to avoid options for which missing information makes the probability seem "unknown".
 

  - link Wikipedia:  Ambiguity effect
  - an item on Forrest Landry's compiled list of biases in evaluating extinction risks.