I have so far distinguished between belief as anticipation-controller, belief in belief, professing, and cheering. Of these, we might call anticipation-controlling beliefs “proper beliefs” and the other forms “improper beliefs.” A proper belief can be wrong or irrational, as when someone genuinely anticipates that prayer will cure their sick baby. But the other forms are arguably “not belief at all.”

Yet another form of improper belief is belief as group identification—as a way of belonging. Robin Hanson uses the excellent metaphor of wearing unusual clothing, a group uniform like a priest’s vestments or a Jewish skullcap, and so I will call this “belief as attire.”

In terms of humanly realistic psychology, the Muslims who flew planes into the World Trade Center undoubtedly saw themselves as heroes defending truth, justice, and the Islamic Way from hideous alien monsters a la the movie Independence Day. Only a very inexperienced nerd, the sort of nerd who has no idea how non-nerds see the world, would say this out loud in an Alabama bar. It is not an American thing to say. The American thing to say is that the terrorists “hate our freedom” and that flying a plane into a building is a “cowardly act.” You cannot say the phrases “heroic self-sacrifice” and “suicide bomber” in the same sentence, even for the sake of accurately describing how the Enemy sees the world. The very concept of the courage and altruism of a suicide bomber is Enemy attire—you can tell, because the Enemy talks about it. The cowardice and sociopathy of a suicide bomber is American attire. There are no quote marks you can use to talk about how the Enemy sees the world; it would be like dressing up as a Nazi for Halloween.

Belief-as-attire may help explain how people can be passionate about improper beliefs. Mere belief in belief, or religious professing, would have some trouble creating genuine, deep, powerful emotional effects. Or so I suspect; I confess I’m not an expert here. But my impression is this: People who’ve stopped anticipating-as-if their religion is true, will go to great lengths to convince themselves they are passionate, and this desperation can be mistaken for passion. But it’s not the same fire they had as a child.

On the other hand, it is very easy for a human being to genuinely, passionately, gut-level belong to a group, to cheer for their favorite sports team.1 Identifying with a tribe is a very strong emotional force. People will die for it. And once you get people to identify with a tribe, the beliefs which are attire of that tribe will be spoken with the full passion of belonging to that tribe.

1 This is the foundation on which rests the swindle of “Republicans vs. Democrats” and analogous false dilemmas in other countries, but that’s a topic for another time.

66

104 comments, sorted by Highlighting new comments since Today at 10:42 AM
New Comment
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings

Sounds like someone needs to examine his bias re Alabama bar patrons.

Paul, I looked up a list of the most religious states in the US. But if you actually go into an Alabama bar and say it, I'll change the post (not recommended).

I'm not about to put my money where my mouth is on that one

Sounds like someone's beliefs aren't paying rent.

6InsertUsernameHere7yOr maybe it's a matter of existential risk? If there's a 1/10 chance of him being horribly wrong, then I don't particularly blame him for not testing it. I might believe quite thoroughly, but not want to test it when the explosive is directly in front of me. I'd happily test it from behind a blast wall, though.

I thought this site would be the last place I'd see criticism of the "suicide bomber as cowardly" notion. Under some definitions, sure, doing something you expect to result in your death, in pursuit of a higher goal, necessarily counts as courage. However, it would be justifiable to say they are intellectually cowardly. That is, rather than advance their ideas through persuasion, and suffer the risk that they may be proven wrong and have to update their worldview; rather than face a world where their worldview is losing, they "abandoned&q... (read more)

Is that what extremist Americans mean when they say cowardly?

4RobinZ10yWelcome to Less Wrong [http://lesswrong.com/lw/b9/welcome_to_less_wrong/]! Feel free to introduce yourself on that thread. Don't hesitate to browse the recommendations from the About page [http://lesswrong.com/lw/1/about_less_wrong/] or start in on the Sequences [http://wiki.lesswrong.com/wiki/Sequences]. Kaj_Sotala also posted a first [http://xuenay.livejournal.com/313286.html] and a second [http://xuenay.livejournal.com/316073.html] list of favorite posts, which are also quite good. Your point is a good one - I don't know if you read The Bottom Line [http://lesswrong.com/lw/js/the_bottom_line/] (or Rationalization [http://lesswrong.com/lw/ju/rationalization/], the followup), but they make a similar point in a well-phrased way you might enjoy.
9SilasBarta10yNo, that's probably just belief as attire. My point is just that reasonable interpretations of "Suicide bombers are cowardly" allow the statement to be true, even if people don't mean the true version, or if they came to that conclusion for the wrong reason.

Except that based on videos and letters left behind, the hijackers considered Americans to be not just intellectual adversaries, but wartime ones. I believe the majority of the hijackers cited American military presence in the Middle East and military and economic support of Israel to that effect.

1SilasBarta9ySo what were the specific arguments they used when persuading acolytes of the great satan that their position has more merit? Or was it confined to "BOOM!"?

My point is that using violence to silence intellectual adversaries is very different from using violence against a perceived wartime enemy.

6TuviaDulin9yTheir ideology might be intellectually cowardly. But sacrificing your own life in battle against a perceived enemy is not a cowardly act. When people call the attacks cowardly, they're talking about the attacks themselves, not the worldview of the attackers.
3Jiro7yI think most non-LWers who refer to the attacks as cowardly mean that they were conducted against unresisting, nonmilitary, targets. The people killed couldn't fight back (or at least weren't expected to fight back), and attacking someone who isn't expected to fight back is widely seen as cowardly. In this case, of course, other aspects of the operation were hazardous to the terrorists even if they didn't expect anyone to fight back, but I believe most people who consider the attack as cowardly are treating these aspects separately.
3pnrjulius9yI think actually you're a bit confused about the difference between instrumental virtues, like courage, and inherent virtues, like benevolence. (Which list "rationality" goes on is actually a tricky one for me. In a certain sense, Stalin seems terrifyingly rational.) I guess we could talk about "intellectual courage" versus "physical courage" or something like that, and your argument is that these men were not intellectually courageous. But usually when people say "courage" simpliciter, they mean a willingness to act in spite of a high risk of pain and death. And this the hijackers definitely had! Indeed, there's something truly terrifying about the Al Qaeda hijackers: They were mostly right about their moral values. They were altruistic, courageous, devoted to duty. It's only this very small deviation---"maximize deference to Islam" instead of "maximize human happiness"---that made them do such terrible things. This also meshes with what we know about the Milgram and Zimbardo experiments; quite ordinary people, if convinced that they are acting toward a higher moral purpose, will often do horrific things. The average Nazi was not a psychopath, not a madman; he believed that what he was doing was right. And this should be the most chilling fact of all.
1Rinon8yI suspect that the Muslim hijackers, in a strange way, thought they were maximizing human happiness by removing Americans from the world.
2RichardKennaway8yI think it more likely they thought they were doing the will of Allah. Happiness? Happiness is for pigs.
2wedrifid8yWell that explains the no bacon and pork rule.
1Document7yI used to assume (possibly through overapplied principle of charity) that the accusations of cowardice had to do with their "escaping" the consequences of their actions by dying, especially if they anticipated heaven. Specifically, I wonder how comparatively scared they'd have been at the prospect of: * Surviving through being captured and extrajudicially detained * Surviving through being captured and subjected to a nationally televised trial * Destroying the towers, but somehow surviving long enough to be trapped in the wreckage with a dying Muslim girl who has no idea what's happening * Being given a teleporter they could use to escape just before the impact, knowing that each of their compatriots had refused the same offer * Being ordered to destroy the towers by firing a super rocket launcher in broad daylight in full view of bystanders * Being ordered to destroy the towers with remote explosives, then return to their normal lives with only themselves to know they'd helped kill thousands of people.
1Idan Arye4moThese is not about whether they are cowardly or brave, and not about at which level are they cowardly or brave. This is not even about whether they see themselves as cowardly or brave. This is about not being able to talk about how they see themselves for fearing the scorn of the tribe.

Are you breaking your advice to not use contemporary politics in examples?

7pnrjulius9yI doubt it's going to be very controversial that the 9/11 attacks were morally bad. (Though it might be interesting if someone is bold enough and contrarian enough to argue that they were justified?)

Good posts. This series is the first thing in a while to make me really glad to participate here.

I think that the stereotype of Alabama bars is pretty reliable. OTOH, the stereotype of suicide bombers is much much less so. If you read the rhetoric of radical Islam, or for that matter if you read ancient mythology such as Homer or the Egyptian Book of the Dead, you will see people who are occupying a VERY VERY different moral universe from us Platonized Christianized (that includes the secular children of "modern orthodox" Jews) post-Enlightenment Westerners.

In terms of realistic psychology fitting neither the SSSM nor the Evolutionary Psychology brand (which you really should spend more times reading non-leftist criticisms of), the Muslims who flew planes into the World Trade Center undoubtedly saw themselves as heros, but in some sense that we would have a VERY hard time empathizing with or relating to. They are NOT a mirror reflection of ourselves, but genuinely something that has to be understood with empiricism, not empathy and wishful thinking.

1Clarica9yI like your information, but I disagree with your conclusion. I don't think it is beyond the reach of empathy to understand them as thinking of themselves as heros. Steven_Bukal and TuviaDulin make very persuasive arguments, above. Years later, I admit, but think I remember detecting some empathy for the bombers at the time. Because I was looking for it.

Good point, Tarleton - although I'm still hard-pressed to think of a better example that isn't directly a religious belief. If you only use the obvious religious examples, people will fall into the standard trap of thinking they've achieved perfection as rationalists because they're not religious - I wanted to use something that would actually strike a sympathetic chord and let people see how the belief-as-attire effect extends beyond religion. Got a better suggestion?

Vassar, also a good point, although I'm skeptical that I would have difficulty empathizing - these are humans we're talking about, not aliens, and the WTC hijackers were mostly educated Saudi Arabians, not Yamomano. They saw themselves as heroes in the support of causes, such as sexual decency = woman's de-emancipation, which are not American causes; they believed and maybe even anticipated 72 virgins; they fought in guardianship of ancient perfection; they carried out the will of God revealed in perfect scripture. None of this strikes me as a significant barrier to understanding. Can you say specifically what you think presents the barrier to empathy?

7pnrjulius9yYou want some belief-as-attire that LW people wear? How about some of the things people say "as Singularitarians", i.e. not because they really have thought the matter through themselves, but because it is the standard position of Singularitarians. (It's not always easy to distinguish, granted. You could believe in cryonics because you really have evidence to suggest that this is the best use of resources... or you could believe in cryonics because that's "what Singularitarians believe".)

Ignorance. I may think I understand their minds, but that does not prove that I do understand their minds.

All you know is that you have a mental model of their minds which seems credible to you. Have you tested this model, and if so, how?

All I am reasonably sure of is that they did not see their act as evil and cowardly. Doubtless the same was true of Jack the Ripper and the Boston Strangler, but that tells me nothing about the differences between them and everyone else. After all, I only think that is true of them is because it seems to be true of most people.

It is really just an assumption.

0pnrjulius9yThat's really an interesting question. What about the ones who really ARE insane psychopaths? Do they think they are doing the right thing, or do they really just not care? I'm inclined toward the latter, actually. I've read some of Stalin's journals, where he says things like "What is efficient is good. What is inefficient is bad." That sounds like he literally doesn't understand what morality MEANS to ordinary, non-psychopathic people.
1johnlawrenceaspden8ySounds like he still needs to classify things as good and bad, though. Maybe a previous moral framework has collapsed and he's looking for an alternative? Any idea whether he had goals beyond 'survive'?

This might be an especially easy category of bias to identify. Just ask yourself if you feel proud that this belief associates you with some group with which you want to be associated. If so, weaken your confidence in this belief.

3pnrjulius9yUp to and including my belief that the scientific method is the best approach to understanding the world?
3johnlawrenceaspden8yAbsolutely, yes. No question that part of the reason we believe that is in order to identify with our tribe. I personally am prepared to reduce it by three orders of magnitude, from 1-epsilon to 1-1000*epsilon.

Pseudonymous, I confess that it is only a guess, just a more plausible guess than the American one. And Jack the Ripper might well have been a monster - there are such things as sociopaths.

Robin, I'd say "recalculate your reasons" not "weaken your confidence". You can't literally shift a probability estimate because it makes you feel proud.

1johnlawrenceaspden8yWhy ever not? It feels as if a belief-forming robot probably shouldn't. But what if pride was its label for 'probable flaw in calculation detected'.

Eliezer, it seems to me that you can and should shift your probability estimate because it makes you feel proud. Of course you might do even better than that by recalculating your reasons, but that approach will often not be cheap or reliable.

it would be like dressing up as a Nazi for Holloween.

"So remember kids, dressing up like Hitler in school isn't cool."

Eliezer, your lack of familiarity with "the other side" on the topic of terrorists is all too obvious from your crude attempt at a characterization of it. All you appear to know about it is a few platitudes. Often I get the feeling from this site that it is not so much about overcoming your own biases as it is about coming up with new excuses to dismiss views that you don't agree with by applying the genetic fallacy over and over (e.g. "suchandsuch belief is a product of suchandsuch bias").

Eliezer, Brilliant post, in my opinion. Clarifying and edifying. I'm looking forward to where you're going to go with this analysis of how bias and belief operate.

Silas, My opinion: you seem invested in using "muslim terrorists" for in-group/out-group construction, and I think it's coloring (biasing?) your analysis.

Michael, great criticism of an element of Eliezer's post.

Hopefully_Anonymous: You seem invested in labeling people as using "muslim terrorists" for in-group/out-group construction, and I think it's coloring (biasing?) your analysis.

(???)

Constant, this blog has warned against the genetic fallacy before. What do you think would be a good characterization of the "other side"? Eliezer's characterization describes a large minority of Americans very well. (He's clearly not intending it to be descriptive of everyone who thinks Islamic extremism is a serious threat, if that's what you're thinking.)

I think questioning the Alabama bar analogy is useful within the context of this post. Whose attire is a belief in the value of giving primacy skepticism, critical thinking, etc.? According to Eliezer's performance in the OP, it's not the attire of either Alabama bar patrons or "muslim terrorist suicide bombers" -and both of those may signal more generally, the losers of the American Civil War and non-white brown people. In short, I think there may be a gentrification of critical thinking: it's reserved for an in-group, perhaps in particular nort... (read more)

1bigjeff510yI know if I were in an Alabama bar, and the conversation turned to how "terrorists hate our freedoms", I'd certainly phrase things such that they didn't contradict what everyone in the room was yelling about. Bonus points if I were clever enough to disagree with them in a way that seemed like I was agreeing with them. Either way, I'd be wearing a belief I most certainly did not actually believe and did not in any way believe I believed, and I would do so entirely for my own preservation.
2Desrtopa10yIf you don't transmit your disagreement, why bother expressing it? Outwardly agreeing with them would accomplish the same thing with less effort.
6bigjeff510yIt's being more honest with yourself and your own beliefs, though it certainly isn't more honest with your fellow bar patrons. If you have a thing against lying (and I do), it's the lesser of two evils. The inspiration was from professor Robert Thornton of Lehigh University, who came up with a creative way to write student "recommendations" that, if read literally, said quite directly that hiring this particular student was a very, very bad idea. If read figuratively, however, they sounded like glowing reviews, and indeed if you were expecting a good review you would think it were an absolutely wonderful review. This was necessary because as a professor he was obligated to give students recommendations for their employers, but negative reviews have resulted in serious lawsuits in the past. Unwilling to compromise his morals, he got very creative with the English language instead of lying. In that case, the reviews weren't meant for the student to ever see, but that is often unavoidable. He certainly did hope that the student's potential employer was capable of reading between the lines and comprehending the message. He called his system L.I.A.R., if you want to search for it. They are pretty funny, and really do sound like positively glowing reviews until you look at exactly what they are actually saying.
0gwern10ySeems to exist mainly as a book: http://www.amazon.com/Lexicon-Intentionally-Ambiguous-Recommendations-L-I/dp/1402201397/ [http://www.amazon.com/Lexicon-Intentionally-Ambiguous-Recommendations-L-I/dp/1402201397/]
5chris-hexx9ySome brief samples available at http://www.avdf.com/feb96/humour_liar.html [http://www.avdf.com/feb96/humour_liar.html]
1Viktor Riabtsev2yDead link :(.
3Said Achmiz2yArchived version. [https://web.archive.org/web/20110616221521/http://www.avdf.com/feb96/humour_liar.html]
9Viktor Riabtsev2yThank you. I tried using http://archive.fo/ , but no luck. I'll add https://web.archive.org/ to bookmarks too.

One reason is because dog-whistles can work: I have from time to time had the experience of expressing my opinion about a subject in a way that causes the minority who agree with me to recognize me as a potential ally without triggering reprisal from the majority who disagree with me.

Another reason is to preserve some credibility in case of a future discussion where I'm more willing to deal with the consequences of public opposition. Rather than having to say (for example) "Well, yes, I know I said policy X was a good idea, but I didn't really mean it; I was lying then, but you should totally believe me now because I'm totally telling the truth" I can instead say (for example) "I said that policy X is an efficient way of achieving goals Y and Z, which it absolutely is. But I don't endorse maximizing Y and Z at the cost of W, which policy X fails to address at all."

Yet another reason is to use plausible deniability as a way of equivocating, when I'm not sure whether to come out in opposition or not. That is, I can disagree while maintaining a safe path of retreat, such that if the degree of reprisal I get for disagreeing turns out to be more than I feel like suffering, I can claim to have been misunderstood and thereby (hopefully) avert further reprisals.

2Desrtopa10yGood points.
2SilasBarta10yThat already goes by the name "politician-speak".

Empathy is hard. Cultures differ. We Americans (especially secular Americans?) really don't have a clue what it feels like to (for instance) feel an obligation to kill our daughters or our sisters in order to preserve our family honor. Some actions in the name of causes may be psychologically modular, but some really aren't. What's the parallel for honor killing? Pressuring one's schizophrenic philosophy post-doc son to go to law school where he thinks he'll be miserable for the bragging rights? Sending your kids to Hebrew School or Day Camps they ha... (read more)

3TobyBartels9yWhy was that? I can't find it with a search.

Actually, I think that much of www.xkcd.com including the current one can be though of as an enumeration of feelings that people who aren't either quite young or quite nerdy have not analogues to. Philosophy is full of others, such as existential despair and satori.

2Document10yxkcd's archive page doesn't include dates. According to Archive.org, the current comic as of 05:58:11AM (whatever time zone) on 05 August 2007 (a Sunday) was Tesla Coil [http://www.xkcd.com/298/], so I'm guessing you were talking about the previous one, Lisp Cycles [http://www.xkcd.com/297/].

"Eliezer's characterization describes a large minority of Americans very well."

All I see there are familiar platitudes, not a description of anybody who thinks about things. All I see, in fact, are familiar formulas employed by politicians. Nor are the formulas necessarily wrong. It should not be hard to see what is cowardly about most terrorist attacks.

American Heritage has a fairly good definition of cowardice: "Ignoble fear in the face of danger or pain."

The ignobility is an important factor which other dictionaries tend to miss. But... (read more)

2Clarica9yI agree with your point about "difficulty of engaging the enemy's armed forces". But I still understand the frustrations of suicide bombers, because of the difficulty of significantly or meaningfully engaging some enemy's armed forces. Especially if you respect warriors, but not their guidance. What is the brave action to take in that case? Simply suicide, and not suicide-attacks? Or better-targeted suicide-attacks? I am befuddled. I am far more comfortable condemning suicide-attacks as irrational than cowardly.

Michael, I think your example is interestingly rooted in an implied in-group/out-group construction that construction Americans in a flattering way. Consider that you contrast honor killings with forcing kids to go to law school or day camp -that won't necessarily result in their death. It's a flattering contrast that I think constructs America as Western and honor killers as culturally Middle Eastern. But, if we contrasts cultures that approve of state-sanctioned killing of people for moral transgressions, America and the nations of the honor-killers are ... (read more)

HA: I chose my examples carefully to to try to match as closely as possible as many of the categories, relationship types, motivations, etc as I could, and the examples I came up with are both pervasively American and truly ugly from my perspective in the closest way that I could think of (matching type of motive, e.g. content of emotional state, not degree of emotional state or degree of ugliness) to honor killings. My point was that we don't have any very close matches. Your examples still don't match the intensity of honor killings, but more important... (read more)

Michael, how about the point that you're (rather explicitly now) picking a point upon which to manufacture in-groups and out-groups. In-group: those of us who get motivations for execution. Out-group: those who get honor killings.

The in-groups and out-groups change if the point to get is abrahamic monotheism, or if the point to get is state-sanctioned punitive killings. It seems to me that you're picking one that's particularly salient either to you or to what you imagine your audience to be. I think this gets to the belief as attire/beliefs as cheers for ... (read more)

HA: It seems to me that you think I have changed the topic. I agree with all of the sentences of your most recent comment, except for the first, but they don't seem to be about what I was saying.

Likewise, I agreed with Eliezer's post, but I thought that his analogy was, well, lacking in appreciation of the difficulties involved in analogy.

Basically, I think that Douglas Hofstadter's writings on the difficulties of natural language translation, the proper translation of literature, etc, are all in relevant to the issue of the translation of inferred emoti... (read more)

All curiosity exists to destroy itself; there is no curiosity that does not want an answer.

Vassar, it seems important to you that you not be able to understand certain acts - a badge of pride. I don't think I'm having trouble understanding an honor-killing. Someone else rapes your sister, it stains the family honor, she has to die, QED. It's not the way I think, but that doesn't stop me from modeling it.

In proof of this, I ask you, what virtuous mode of thought, or even mode of thought that you are not particularly indignant at, do you think yourself unable to understand across cultures?

Eliezer, I have thought of another sort of belief that is not an anticipation-controller. Sometimes, I hear quite smart young people (who don't just wear beliefs as attire) profess to a belief in physicalism about qualia, or in libertarianism, or in the virtues of the scientific method, or in anti-pseudoscience (a la Martin Gardner), or in global-warming skepticism (a la Bjorn Lomborg), or in consequentialist egoism, or some similar broad philosophical or political doctrine. When I talk to these people, I find out that they can give a number of good arguments for why someone should follow their position, but that they have little to say in response to arguments for why people should follow alternative positions. For example, they might be able to clearly state various arguments for libertarianism, and to respond well to counters to those arguments. Yet when I tell them various arguments in favor of alternative positions (e.g. democratic socialism), their attempted rebuttals are much weaker in quality than their positive arguments for the position they claim to hold.

This usually occurs because these people have read good books or articles advocating physicalism, libertarianism, and ... (read more)

Bob, I take it you're not the deceased kiwi atmospheric scientist Robert "Bob" Unwin. But very high quality commentary. I hope that you start an blog to consolidate your observations under this name/pseudonym (as I have done with mine).

Bob: Great post.

Eliezer: I was not saying anything cannot be understood, but rather that using our specialized "empathic" capabilities for understanding human behavior in terms of our own hypothetical behavior is counterproductive to understanding many instances of human behavior when the humans in question are from different cultures or otherwise very different from one's self. It's easy to model it, possibly even to model it well (Chronicles of a Death Foretold by Gabriel Garcia Marquez tries to), but next to useless to model it by reference... (read more)

Bob, a very high quality comment, but at 800 words it is too long for a comment. Please everyone, let's try to keep comments under about 400 words - longer items should be their own post or essay somewhere, which you can of course link to in a comment.

Re: the Alabama bar, when that same criticism was leveled by Neil Young, the response was, "A Southern man don't need him around anyhow". Apart from the fact that it came in the form of hit song, the reply is notable in that it's not something along the lines of, "them's fightin' words!" Though you may be right about the South's religious and political attitudes, I think you misunderstand how and when violence is used in that culture.

Anyway, back to the issue. The mindset of Mohamet Atta, et al, was elegantly described by Eric Hoffer in The True Believer. I don't believe it takes any unusal emotional insight to understand Atta's psychology, if it's seen in those terms.

Konrad: Not to repeat myself yet again, but no, understanding psychology never requires unusual emotional insight. It takes analytical ability, but it gives a different type of understanding from that which emotional insight gives.

Bob wrote "The person who calls himself a global warming skeptic... after reading a couple of books and a few articles arguing for [such skepticism] will often acknowledge that if he'd started by reading books advocating alternative views, then he would not have come to be a global warming skeptic..." This is one mechanism, but sometimes positions just "feel right" to people, i.e. in agreement with their predisposed visions, or traits.

Also it seemed to me that by asking of people that they examine as many arguments opposed to their view... (read more)

What would falsify that model of belief as attire?

I am in the process of working through these delicious posts so apologies in advance if my comments are redundant.

Perhaps group membership of a mutually supportive tribe has the greatest value (for example from both a psychological and survival perspective). If this is the goal, what is the most rational course of action? Will a rational person inevitably run into problems where the tool they are using to solve their problems becomes their primary source of problems?

I like this site for the very reason that it represents a community where my natural probl... (read more)

2airandfingers10yCan we truly choose to be irrational, though? Recognizing the irrationality of a belief, and valuing reason, the most we can do is act as if we hold others' irrational beliefs. I'm sure there are many people who have done this throughout time; the tragedy is that each of these people may have "come out" as nonbelievers if they were aware of the others' presence. While I personally think that a person compromises his integrity when he acts contrary to his beliefs, there are certainly many instances in which this course of action has survival value, and so can be said to be rational.
-1pnrjulius9yUsing drugs, we could probably make ourselves less rational on purpose. Drinking lots of alcohol, for instance.

I appreciate the effort to sort out "improper beliefs". As a philosopher with a background in distinguishing surface-level propositions from speech acts with goals that may be masked by those propositions as such, I am inclined simply to say that "improper beliefs" are NOT beliefs. I prefer reserving "belief" for the anticipatory dispositional beliefs that you call "proper".

This is so far just a semantic difference, but the real difference comes out when you say that people have to "convince themselves they are ... (read more)

1pnrjulius9yBut most people clearly DON'T treat these things as meaningless speech acts. How do I know this? Because if you say something like "Right, because that's just a meaningless speech act" in response to some absurdity of religion like "virgin birth" or "transsubstantiation", people will get VERY ANGRY at you. They will not respond as though they are playing a game of words, they will respond as though you have accused them of lying. And if improper beliefs are precisely non-beliefs trying to make themselves look like beliefs, then you HAVE just accused them of lying.
0TheOtherDave9yThe only way this comment makes sense to me is if I assume that you believe that (for example) humans reliably fail to become angry when their tribal attire is challenged, unless that tribal attire also happens to be a meaningful belief. Do you in fact believe that? If so, can you expand on your reasons for believing that? It seems implausible to me, and inconsistent with my observations of human behavior.
0RobinZ9yThe only way this comment makes sense to me is if it was written without reference to its grandparent.

In all fairness, I think Islamic fundamentalists really do hate our freedom. They hate our entire way of life, and this freedom is a part of that.

Hating the freedoms of western society doesn't preclude one from committing brave, selfless acts, though. Unfortunately for us.

5JackEmpty9yTo paraphrase, there's a difference between resenting someone for having freedoms that you do not, and disliking the concept of "freedom". And these get mixed up on occasion.
2pnrjulius9yClearly they DO hate our concepts "freedom of religion" and "freedom of speech". (They will explicitly say so!) There may be some freedoms that they would value... though actually maybe not. Maybe they value deference to Islam so highly that any kind of individual freedom would entail the freedom to violate Islam and therefore be evil.

The biases of Rationalists are showing in this article.

It's peculiar to have a sequence on Korzybski's "The Map is Not the Territory" followed shortly thereafter by a post making a purely intensional distinction between "proper" and "improper" beliefs.

What's "improper" about achieving in group identification? It's often quite handy. Casting intensional aspersions on all values we might derive from our beliefs but the predictive utility does not strike me as rational.

3AlanCrowe9yI think that the word improper is being used in the post in the same way that mathematicians use it in the phrase improper integral [http://en.wikipedia.org/wiki/Improper_integral]. This usage is not pejorative, but marks a delicate extension of the basic concept. In mathematics the delicacy arises from the need to take a limit, which might not exist. In the case of an improper belief the believer is opened up to conflicts, perhaps because they belong to multiple groups with conflicting identities, perhaps because predictive utility competes with group identification in practical importance.
4buybuydandavis9yBut this is one of my issues with what I have seen at lesswrong - the privileging of predictive utility over other forms of epistemic rationality over instrumental rationality. Epistemic rationality is another form of instrumental rationality, but where rationalists gather, it gets privileged as if it were the only true rationality, or at least a better rationality. It's a mistake, and really impairs the ability of rationalists to understand other people who do not privilege epsitemic rationality to the same degree, if at all. You say improper is not used in a pejorative sense, but clearly the normal usage of "improper" is pejorative. And when an epistemic utitlity competes with another instrumental utility, why doesn't that equally make the epistemic utility improper? Further, the non-epistemic beliefs are described as TIme and time again, epistemic rationality is set up as the real, better, higher, truer, shinier rationality. Just to be clear, I'm not here to trash the idea here. I came to the site from reading EY's Harry Potter fan fiction, which is just awesome and I've dying for the next chapter. Between the book, and the sequences, I'm busy reading a guy making all my arguments and more, reading many of the key books I read years ago in graduate school. Korzybski and Jaynes are at the top of my pantheon (with Stirner, who I don't see a lot of influence from). So I'm here because of some very specific and fundamental shared methodology. I don't say "me too" to all that I agree with, unless it is something new to me or I have a refinement to add. But on this point, I see privileging of epistemic rationality, and I think it's a mistake.
1pnrjulius9yYou would put instrumental rationality above epistemic rationality? So if it makes me happy to believe the Moon is made of cheese, I ought to do so?
2buybuydandavis9yI put winning above predictive accuracy, yes. As fate would have it, the article What do We Mean by Rationality is the page that comes up in my chrome browser when I type "less" http://lesswrong.com/lw/31/what_do_we_mean_by_rationality/ [http://lesswrong.com/lw/31/what_do_we_mean_by_rationality/] It's a peculiar article, because it gives two concepts as a definition for rationality, Epistemic Rationality and Instrumental Rationality, where clearly the concepts are not identical. And yet all sorts of statements are made thereafter about Rationality without noting the difference between the two concepts. To answer you question in these terms, for all beliefs where the Instrumentally Rational belief is X, and the Epistemically Rational belief is NOT X, I'd rather believe in X. I'd rather Win than Correctly Predict, where I have to make the tradeoff.
3wedrifid9yIf making yourself happy is, all things considered, what you want to do. (And then assuming that said belief modification is the most effective way to gain happiness.)

Their belief or cowardly is not the problem. We must be concerned about their expected behavior. The rest is a commentary.

In terms of humanly realistic psychology, the Muslims who flew planes into the World Trade Center undoubtedly saw themselves as heroes defending truth, justice, and the Islamic Way from hideous alien monsters a la the movie Independence Day. Only a very inexperienced nerd, the sort of nerd who has no idea how non-nerds see the world, would say this out loud in an Alabama bar.

I read this three times. First pass: What? Why? Maybe I missed something. rereads Second pass: Oh, would they not get the reference? But why would that be so bad? rereads Third p... (read more)

2Nornagest7yEliezer's probably saying that the patrons of said Alabama bar would be, shall we say, highly unlikely to appreciate the neutral point of view, probably due to ingroup biases. It's the arguments-as-soldiers thing again, and you're implicitly putting yourself on the wrong side. I've never been to Alabama myself, so I don't know whether this is actually true or not. I suspect it wouldn't be as bad as he's implying (it might start an argument, but I wouldn't expect a fight), but that might be my optimism acting up.
0TheOtherDave7yI've never been to Alabama, but as I understand it the cultural climate in Alabama shares certain key characteristics with that in rural Massachusetts. Were I, in a rural Massachusetts bar, to make any public statement to the effect that the individuals who flew planes into the WTC could plausibly be seen as heroes, or that they were comparable in any way to American soldiers fighting and dying for American interests (1), I would expect the locals to view this as a challenge to sacred virtues and to react accordingly. I would not expect this to necessarily cause a fight (though it depends on how I went about it, and whether and how I backed down when those virtues were upheld by those around me); it wouldn't even necessarily get me asked to leave (though that's more likely, especially if I continued to defend that position). (1) Edit: on further thought, I suspect that just talking about U.S. soldiers fighting for "American interests" (as opposed to "American values" or "America" or some such thing) would raise a suspicious eyebrow or two, as it superficially pattern-matches to a particular mid-1900s stereotypical formulation of Communist propaganda.
0Moss_Piglet7yMaybe it's just because I'm a New Yorker, but trust me that you don't have to cross the Mason-Dixon line for people to be willing to sock someone who said something even remotely positive about the 9/11 hijackers. Things have cooled down a bit in the last twelve years, but there are still some things you just don't say. Or imply, in this case. I know that I would personally have trouble restraining myself if someone expressed actual support for, or tried to equivocate-away, the crimes of terrorists in my presence. It's absolutely an issue of tribal loyalty, and not even entirely irrational; expressing empathy for an enemy weakens your resolve against them, which is not a particularly wise choice when the only way our tribe can lose is by giving up.
2Lumifer7yI see a mind being killed.
0Moss_Piglet7yWe're discussing people's emotional reactions to these types of statements and why they feel those emotions. I pointed out that those reactions are typically strong and negative (and not just in Alabama), and that holding them is instrumentally rational. Since this isn't preventing me from updating on any evidence presented (I absorbed the "everyone is the hero of their life story" moral years and years ago), I don't see that I'm particularly mind-dead in this scenario.
1Lumifer7yI saw mind killing in the particular phrase: I also have doubts about that instrumental rationality.
-1Moss_Piglet7yMy reasoning is... well it's hard to explain without going 100% RL politics, which is as rude as it is counterproductive. Basically there's different schools of thought on the strategy involved in asymmetrical warfare and I tend to come down on a particularly unpopular and effective side of the debate. That's all I'm willing to say in public. In terms of instrumental rationality, it's pretty simple; being part of the winning team is generally useful, cheering and wearing the colors shows people you're on the team, and you cheer a lot more enthusiastically when you actually believe it. Cognitive dissonance gets a bad rap, but it really is a lot easier to compartmentalize than to maintain a lie long-term.
3shminux7yTrue. However cheering for your team while dehumanizing your opponents is often a poor way to make your team stronger in the long run. Labeling someone a terrorist diminishes your desire to understand their motivations and eventually mitigate further terrorism. Instead one ends up supporting Iraq war-style mission creep resulting in the needless deaths of those on your team.
1Lumifer7y“One thing is for certain: there is no stopping them; the ants will soon be here. And I for one welcome our new insect overlords. I’d like to remind them that as a trusted TV personality, I can be helpful in rounding up others to toil in their underground sugar caves.”
1nshepperd7yIt seems pretty obvious to me that your tribe can also lose by directing its energy in the wrong direction, resulting in harms to yourselves. As, for example, has already happened with TSA, so I hear. (This doesn't mean "the terrorists have won" but it does mean you have lost.)
3LoganStrohl7yYes, I understood as soon as I read the next sentence. I just felt silly that I couldn't figure it out myself.
0[anonymous]7yFrom the perspective of an intoxicated rural Southern conservative, the WTC terrorists are literally hideous alien monsters, in that they acted without humanity, they're from somewhere else, and, being Arab, they look unpleasant (racism is a significant enhancing factor in hating people you already don't like very much). For you to empathise with those terrorists would be a direct threat to this point of view. It would clearly mark you as not being one of them, and of not sharing their values.

Sayyid Qutb, who was a supplier of ideology for the terrorists who perpetrated 9/11, did see the US as evil for, among other things, the freedom of its women. (E.g., to quote Qutb via Wiki, he noted the “animal-like" mixing of the sexes (which "went on even in churches")). So “hate our freedom” has truth to it.