Don't lie, because what you believe now is probably wrong. if you lie to convince others of what you currently believe, then the same evidence which later causes you to change your belief may not suffice to change theirs.

It's even worse -- if you successfully lie to convince others, their opinions may be the evidence that later convinces you.

In theory this should not happen, because a perfect reasoner should be able to discount the effect of their lies on others. But humans are not like this. If everyone else believes something, there is a strong pressure to join them. (A good rationalization could be: "First I was just joking, but gradually I realized that this is real.")

I would guess that there were many cult leaders who started by lying to people around them, and gradually accepted their own lies when repeated by the others.

0MinibearRex8yI agree with Decius. Do you have a wiki account, so you can post your own edit under your own name?
0Dorikka8yThis seems worth adding to the summary.

[SEQ RERUN] Protected From Myself

by MinibearRex 1 min read27th Sep 201211 comments

3


Today's post, Protected From Myself was originally published on 19 October 2008. A summary (taken from the LW wiki):

 

Ethics can protect you from your own mistakes, especially when your mistakes are about really fundamental things.


Discuss the post here (rather than in the comments to the original post).

This post is part of the Rerunning the Sequences series, where we'll be going through Eliezer Yudkowsky's old posts in order so that people who are interested can (re-)read and discuss them. The previous post was Dark Side Epistemology, and you can use the sequence_reruns tag or rss feed to follow the rest of the series.

Sequence reruns are a community-driven effort. You can participate by re-reading the sequence post, discussing it here, posting the next day's sequence reruns post, or summarizing forthcoming articles on the wiki. Go here for more details, or to have meta discussions about the Rerunning the Sequences series.