We see far too direct a correspondence between others’ actions and their inherent dispositions. We see unusual dispositions that exactly match the unusual behavior, rather than asking after real situations or imagined situations that could explain the behavior. We hypothesize mutants.

When someone actually offends us—commits an action of which we (rightly or wrongly) disapprove—then, I observe, the correspondence bias redoubles. There seems to be a very strong tendency to blame evil deeds on the Enemy’s mutant, evil disposition. Not as a moral point, but as a strict question of prior probability, we should ask what the Enemy might believe about their situation that would reduce the seeming bizarrity of their behavior. This would allow us to hypothesize a less exceptional disposition, and thereby shoulder a lesser burden of improbability.

On September 11th, 2001, nineteen Muslim males hijacked four jet airliners in a deliberately suicidal effort to hurt the United States of America. Now why do you suppose they might have done that? Because they saw the USA as a beacon of freedom to the world, but were born with a mutant disposition that made them hate freedom?

Realistically, most people don’t construct their life stories with themselves as the villains. Everyone is the hero of their own story. The Enemy’s story, as seen by the Enemy, is not going to make the Enemy look bad. If you try to construe motivations that would make the Enemy look bad, you’ll end up flat wrong about what actually goes on in the Enemy’s mind.

But politics is the mind-killer. Debate is war; arguments are soldiers. If the Enemy did have an evil disposition, that would be an argument in favor of your side. And any argument that favors your side must be supported, no matter how silly—otherwise you’re letting up the pressure somewhere on the battlefront. Everyone strives to outshine their neighbor in patriotic denunciation, and no one dares to contradict. Soon the Enemy has horns, bat wings, flaming breath, and fangs that drip corrosive venom. If you deny any aspect of this on merely factual grounds, you are arguing the Enemy’s side; you are a traitor. Very few people will understand that you aren’t defending the Enemy, just defending the truth.

If it took a mutant to do monstrous things, the history of the human species would look very different. Mutants would be rare.

Or maybe the fear is that understanding will lead to forgiveness. It’s easier to shoot down evil mutants. It is a more inspiring battle cry to scream, “Die, vicious scum!” instead of “Die, people who could have been just like me but grew up in a different environment!” You might feel guilty killing people who weren’t pure darkness.

This looks to me like the deep-seated yearning for a one-sided policy debate in which the best policy has no drawbacks. If an army is crossing the border or a lunatic is coming at you with a knife, the policy alternatives are (a) defend yourself or (b) lie down and die. If you defend yourself, you may have to kill. If you kill someone who could, in another world, have been your friend, that is a tragedy. And it is a tragedy. The other option, lying down and dying, is also a tragedy. Why must there be a non-tragic option? Who says that the best policy available must have no downside? If someone has to die, it may as well be the initiator of force, to discourage future violence and thereby minimize the total sum of death.

If the Enemy has an average disposition, and is acting from beliefs about their situation that would make violence a typically human response, then that doesn’t mean their beliefs are factually accurate. It doesn’t mean they’re justified. It means you’ll have to shoot down someone who is the hero of their own story, and in their novel the protagonist will die on page 80. That is a tragedy, but it is better than the alternative tragedy. It is the choice that every police officer makes, every day, to keep our neat little worlds from dissolving into chaos.

When you accurately estimate the Enemy’s psychology—when you know what is really in the Enemy’s mind—that knowledge won’t feel like landing a delicious punch on the opposing side. It won’t give you a warm feeling of righteous indignation. It won’t make you feel good about yourself. If your estimate makes you feel unbearably sad, you may be seeing the world as it really is. More rarely, an accurate estimate may send shivers of serious horror down your spine, as when dealing with true psychopaths, or neurologically intact people with beliefs that have utterly destroyed their sanity (Scientologists or Jesus Campers).

So let’s come right out and say it—the 9/11 hijackers weren’t evil mutants. They did not hate freedom. They, too, were the heroes of their own stories, and they died for what they believed was right—truth, justice, and the Islamic way. If the hijackers saw themselves that way, it doesn’t mean their beliefs were true. If the hijackers saw themselves that way, it doesn’t mean that we have to agree that what they did was justified. If the hijackers saw themselves that way, it doesn’t mean that the passengers of United Flight 93 should have stood aside and let it happen. It does mean that in another world, if they had been raised in a different environment, those hijackers might have been police officers. And that is indeed a tragedy. Welcome to Earth.

Are Your Enemies Innately Evil?
New Comment
148 comments, sorted by Click to highlight new comments since:
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings

An interesting (and in my opinion daring) point, Eliezer, although I'm not sure if it's true or not, because I'm not sure about the degree to which genetics, etc. plays a role in creating "evil mutants". After all, people who commit 9/11 type acts ARE rare. The 9/11 participants in my understanding included people with masters degrees and people with long periods of exposure to the West, and that even enjoyed Western comforts immediately prior to their act. I'm not sure if they're representative of "muslim males" as much as they're representative of people that belong to death cults. Just because they're widely admired in some parts of the world doesn't mean that they'd have many imitators. It defies most forms of "selfish gene" logic to kill onesself prior to procreating, particularly if one is a young healthy male. I do think it's possible that the actual 9/11 participants were deviant in all sorts of ways, rather than representatives of people that grow up culturally non-western and muslim rather than culturally western (muslim or not). However, I think you still make great points about the not-always-utilitarian human bias of picking a side and then supporting all of its arguments, rather than focusing on what mix of policy is actually best.

A single generation of mutation could not create an effect as specific as "die for something". Especially not frequently enough for nineteen of them to emerge closely enough to cooperate.

-6BlueAjah

From what I can gather suicide bombers and the like are pretty normal people. Part of what makes normal people normal is that they're relatively easy to influence.

If you want to find something like evil mutants, try looking at those who recruit suicide bombers. On the other hand, it's probably harder to study them, and even they may not be as alien as we hope.

From what I can gather suicide bombers and the like are pretty normal people. Part of what makes normal people normal is that they're relatively easy to influence.

Well, suicide bombers are more likely to have engineering degrees than the general public. There's also some evidence that engineers are surprisingly likely to be creationists. I don't think engineers are evil mutants, but it does suggest that there are certain modes of thinking that are likely to have bad results. To repeat fairly standard speculation in this regard, engineers aren't taught critical thinking and are taught to not tolerate uncertainty. This is not a good combination.

To repeat fairly standard speculation in this regard, engineers aren't taught critical thinking and are taught to not tolerate uncertainty. This is not a good combination.

Full disclosure: I am (almost) an engineer.

I don't think that's quite correct (uncertainty is a huge concern of engineers), although it's getting there. I would speculate as follows:

  • We know a lot of science, but it's mostly divorced from its epistemic basis. We don't know how we know.
  • We have just enough "science cred" to feel entitled to have opinions on any & all scientific issues, but are probably not actually educated outside a small area.
5NancyLebovitz
Something I've wondered about in re the high proportion of engineers among suicide bombers-- I'd have thought that engineers would be last people in the world to think that you can improve things by giving them a good hard kick. Any theories about what I'm missing?

It's not that Muslim engineers have a special tendency to become jihadis. But engineers do stuff. They solve problems, they act. So when an engineer does join the jihad, they won't be half-hearted about it, and they'll probably be good at it. And in this regard, the jihad is exactly the same as all modern war: educated people who know something of physics and problem-solving always play a large role. That's my theory.

5gwern
http://www.slate.com/id/2240157
8NancyLebovitz
And if someone is good at making bombs (which is the role I would have expected for engineers) that's precisely the sort of person a terrorist organization wouldn't want to die. I think. One thing I've noticed is that everyone (ok, some huge proportion of people) thinks they're an expert on how to do effective terrorism.
9Ender
Making perfect, evil plots can be a great conversation starter.
3gwern
More coverage: http://www.nytimes.com/2010/09/12/magazine/12FOB-IdeaLab-t.html
2NancyLebovitz
My impression of engineers is that they're more apt than the general population to invent, tinker, and adjust, but this is specifically about the sort of physical stuff where they have some knowledge. They aren't especially apt to go into politics.
3David_Gerard
This doesn't stop them. c.f. the nascent RW article on engineers and woo. Stereotypical engineer arrogance comes from assuming one's tested competence in one's chosen field carries through to fields outside one's tested competence. Engineers can get away with all manner of gibbering delusion as long as the stuff they design still works.
5wedrifid
I'd believe that. Systematic overconfidence when it comes to things outside of their field is ubiquitous across experts of nearly every kind. Experts also systematically overestimate the extent to which their expertise happens to be relevant to a given context. (Thankyou Ericsson). I've got a sneaking suspicion that another factor that contributes to said stereotypical arrogance in engineers is their relatively weak social competence (and orientation) compared to others of equivalent levels of skill. Most of what makes use judge others as arrogant seems to be the force with which they present their position as compared to the level of status that we believe it appropriate for them to claim. Insufficient submission to the social reality makes being perceived as arrogant nearly inevitable. Engineers (and other nerds) tend to do that more due to attitude, ability or a little of both.
4salymnr
Working engineer here. A lot of social ineptitude throughout the industry, at least with respect to interaction with non engineers. Certainly can't help the arrogance thing. However I think assumed confidence outside of one's field is a result of what an engineer should be. Engineers solve problems with incomplete information regularly. So when approaching a field he knows little about, an engineer will not hesitate to be as confident as he is in his normal field. Business as usual. I don't think it would be hard for that to come across as arrogant.
0Perplexed
My impression is that we tend not to participate in the political structures and organizations that non-engineers set up. We are more likely to try to reinvent the whole concept of political action. And, in doing so, to draw our inspiration from science fiction.
7Vladimir_M
JoshuaZ: I would be really curious to see the evidence you have for this latter claim. Could you give some concrete examples from engineering education or actual practice where, according to you, intolerance of uncertainty is taken to unsound extremes? As for "critical thinking," well, that's a highly subjective category. Where you see a scandalous failure of critical thinking, someone else might see a relatively insignificant and excusable human error, and vice versa, even if you're both in complete agreement that the belief in question is factually false. But in any case, could you point out an example of some actual educational program that teaches critical thinking in ways that engineers supposedly miss? I honestly can't think of what exactly you might have in mind here.
2JoshuaZ
It isn't a great way of phrasing things and may just be wrong. Simplicio's description seems like a better guess for what is going on. The article I linked to also suggests a few other possibilities.
1NancyLebovitz
I said suicide bombers seem to be normal people, not that they seem to be typical people.
2stcredzero
Also to be libertarians, I suspect.
5JohnDavidBustard
This may be entering into dangerous territory but to what extent does the psychology of a suicide bomber differ from that of say a first world war soldier. In both cases their death is guaranteed, and in both cases they view the justification as being the protection of their community. Would the outcome of losing such a war be bad enough to justify most men risking their lives? Perhaps what is strange is having a society where killing yourself for a cause is rare?
6thomblake
Not so. The soldier can say, there's still a chance (and indeed, many soldiers survived), but the suicide bomber likely doesn't have that option.

Soldier: The government told me to. They've been elected by us, so they must be right, yeah? Everyone else is doing it - think how my friends would look down on me if I said no! I'm going to be a hero! Heroes get all the girls.

Bomber: My God told me to... can't argue with God, right? My friends are doing it - I don't want to look like a coward! Mmm, virgins. (Or other heavenly reward of choice).

Hmmm... that was originally going to be a list of differences in their viewpoints, but the more I think about it, the more similar they appear. Now I'm not sure what I think any more!

2TheOtherDave
Well, one salient difference might have to do with comparing the available mechanisms for calibrating my confidence in the judgment of a government with those for calibrating my confidence in the judgment of a god.
4NickiH
Given that people who believe in god tend to really believe in god, and people who trust governments do so usually with a number of reservations, does that mean that the bomber has more justification than the soldier?
2TheOtherDave
No. Why would it? Justification for an act is not something that emerges full-blown out of nothing. My act cannot be justified by of my faith in X if that faith is itself unjustified. And if I have faith in X within certain constraints and with certain reservations (as I do with governments, for example), that doesn't somehow make that faith less justified than if I "_really believe in" X without constraints or reservations. And all of that is true whether X is my government, my god, or my grandmother.
3NickiH
From the point of view of the bomber, faith in God is not itself unjustified. It is in fact a vital part of his psychology. The original point was the difference in the psychologies of bombers and soldiers. They are both doing it because they were told to, but their confidence in the judgement of the one telling them to is different. So the one with the higher confidence feels more "justified". That's what I thought you meant, anyway. If it's not, could you please clarify? Perhaps I should have said "the bomber thinks he has more justification than the soldier".
4TheOtherDave
Ah, I see. If "justification" refers to a feeling, then sure: the person who is really convinced that X is reliable and wants them to do something has more justification for doing that thing than the person who isn't quite sure that X is reliable, or isn't quite sure that X wants them to do it. (Again, whether X is a government, a god, or a grandmother.) I was thrown off because "justification" in other contexts is often used to mean something different. Which is fine; I don't mean to turn this into a discussion about the meaning of a word. Sorry to cause confusion; thanks for clarifying.
2Biophile
Do people who believe in God tend to really believe in God?
2TheOtherDave
That's a hard question to answer without defining the terms better. I grew up among a lot of self-identified religious people. Using as my test for the left-side "believe in God" the willingness to arrange at least some superficial aspects of one's life around those beliefs (e.g., where one lives, sends children to school, eats, etc.), and using as my test for the right-side "believe in God" the willingness to die rather than violate what they understood to be God's law, I'd say I'm .95 confident that fewer than five percent of the folks with LH beliefs had RH beliefs, and .75 confident that fewer than 1one percent did.
0BlueAjah
Yes, but dying is against God's law... so they've cleverly got around that problem.
6BerryPick6
Not true for every religion. Judaism has certain specific instances where it is accepted that it would be better for one to die than commit a sin. Also, martyrdom would not be such a large aspect in Christianity (or, at least, in early Christianity) if dying for God wasn't considered a good thing.
0TheOtherDave
Yes, precisely this.
3[anonymous]
There are other differences aside from whether or not the attacker will survive. The 9/11 attacks are often compared to the attack on Pearl Harbor. One difference stands out: the 9/11 attacks included attacks on two large buildings packed with thousands of innocent civilians, with no obvious connection to any military installation. This is in contrast with the Japanese attack on Pearl Harbor, which was an attack on a military installation. What the typical WWI soldier did was a lot more like what the Japanese did at Pearl Harbor - i.e., they attacked the enemy's military - and a lot less like what the 9/11 attackers did. An additional point is that focusing on the suicide bombers may be too narrow a focus. The suicide bombers were, after all, not the only Islamist fighters who targeted innocent civilians for murder. The murder of Daniel Pearl was another deliberate murder of a civilian, not as an unavoidable casualty of an attack on a military base but as the sole target of the murder. As I recall from the murder video that was released, the murderers made a point of mentioning that Pearl was a Jew. The obvious moral comparison here is not to anyone in WWI, nor to the allies in WWII, nor to most of the Axis in WWII, but specifically to the Nazi military who were engaged in a program of the deliberate extermination of the Jewish people.
7bgaesop
The 9/11 hijackers would no doubt not refer to the inhabitants of the World Trade Center as innocent civilians, but as economic oppressors. There is a reason they targeted both the Pentagon and the World Trade Center, after all.
-2[anonymous]
Yes, obviously the hijackers did indeed see the people in the WTC as sufficiently similar to enemy soldiers to constitute a legitimate target for attack. It is just as you say. But this very fact I think reveals a psychological gulf that lies between them and the WWI soldier on either side - which was what was asked about. How we classify and identify things can itself be a significant fact about our psychology. A stereotypical example of someone who is mentally abnormal is someone who non-jokingly identifies himself as Napoleon or Jesus.

Sorry for responding so late, but do you really think that this thought:

"My people are being oppressed, primarily economically. I can see that it is mostly Americans doing this. Peaceful protest tends to get me shot at. Clearly these Americans consider their profits more important than my and my people's lives; their actions are causing our suffering and deaths, they are aware of this, yet they continue to do so. Therefore, they are deliberately killing and ravaging my people, and so it is justified for me to kill them. Also, doing so may cause them to strike out in more obvious, militaristic ways, which will weaken their economy (punishing them) and make it more obvious to my fellows that, indeed, America is an extremely evil nation that must be opposed. Better to force them out in the open than let them continue oppressing us by subterfuge. Doing this will be very difficult, and will likely cost me my life, but the organization I just joined has offered to pay a good deal of money to my surviving family when/if I do die, and given that right now they're struggling to buy food because of those fucking Americans and their economic jackassery. Therefore, it is justified and indeed Justice for me to blow up their center of commerce, even at great personal sacrifice."

Is of equivalent sanity to this thought:

"I'm the reincarnation of Napoleon! Hibberty flibberty jibbit!"

1Jiro
No, it's the equivalent of trying Sherlock Holmes style reasoning in real life. That's still insane, especially when used to kill people.
2Eugine_Nier
I'd think the hijackers would refer to them as infidels. Piece of advice: just because you see the world in purely Marxist terms, doesn't mean everyone else does.

I'd think the hijackers would refer to them as infidels.

Do you really, truly think that the only motivations in choosing to do an attack against America (heck, picking America as the target in the first place) and picking the WTC and Pentagon as the targets of that attack, was because the attackers were Muslim while the ones being attacked were not? If so, why have they not done similarly to all non-Muslim nations? Why not attack symbols or places of power of religion, rather than economics and the military?

Certainly religion is used as a framing device and recruitment tool; it's a powerful ingroup identifier. Especially when you have people doing the same on the opposite side of your fight.

Piece of advice: just because you see the world in purely Marxist terms, doesn't mean everyone else does.

That's not so much a piece of advice as a snipe at what you perceive to be the dialectic I'm using to interpret this. It seems to me that you didn't say that to enlighten me, but to reduce my status in the eyes of what you (and I) assume is a mostly capitalist readership.

5Eugine_Nier
No, not the only one, but if one were to ask them why they picked the targets they did, they'd describe it religious terms (talking about infidels, jihad and the great Satan) not in Marxist terms (i.e., economic oppression). In fact judging by the fact that most of the hijackers were from wealthy families, I'd guess they didn't really care about the economic dimension except as part of a general attitude that our decadence is sinful and is spreading to the middle east. I stand by my advice as good advice. If you want to successfully model others' behavior, you shouldn't assume they see the world the same way you do.
7bgaesop
Just as an aside, "economic oppression" isn't a uniquely Marxist term, nor am I even aware of a specific Marxist definition of it. Are you thinking of "economic exploitation", perhaps? The latter means the difference between the amount of wealth generated by labour and the amount that labourer is paid. I am pretty darn thoroughly convinced (though of course I am open to changing my mind) that the idea "religion made them do it!" is overly simplistic. I used to hold the position you do, but over the course of several years of examining the issue, I have come to the conclusion that the use of religious terminology and phrasing and all the general trappings of Islam are, while perhaps truly believed, are for the most part merely a rhetorical device constructed to take maximum advantage of the society they are recruiting, living, and (typically) acting in. I'm hesitant to say this next sentence, politics being the mind killer and all that, but I shall anyways (I have noticed I am in a hole. Hypothesis: if I dig long enough I'll get to China!). Osama bin Laden talks about "defeating the Great Satan for the glory of Allah and Mohammed (pbuh)" for the same reason George Walker Bush talked about "spreading Freedom and Democracy": because it resonates with his intended audience, convinces them that he has similar thought-processes to them and is representative of their interests, or at the very least their team, not because he (edit: necessarily) believed that that was what he was doing. Most people who have had impact in the world have come from wealthy (or at least not working-class-poor) families, including probably every Socialist Revolutionary you've heard of (Marx, Engels, Lenin, Che, et cetera), not to mention almost every politico in general. If anything, being middle class (inasmuch as that term makes sense) makes you more likely to simultaneously see the degradation of the poor and have the education to see what (at least seem to you) like plausible explanations

Osama bin Laden talks about "defeating the Great Satan for the glory of Allah and Mohammed (pbuh)" for the same reason George Walker Bush talked about "spreading Freedom and Democracy": because it resonates with his intended audience, convinces them that he has similar thought-processes to them and is representative of their interests, or at the very least their team, not because he actually believed that that was what he was doing.

There is a problem with arguments of the form, "The leader of that group clearly doesn't 'really' believe his own rhetoric he's just saying that because it resonates with his followers." This implies that their followers actually believe that stuff, otherwise there would be no point in the leaders' saying it. But you've just admitted that there exist people who really believe that stuff, why is it so absurd for the leader to be one of those people?

I certainly agree that I should not model their minds as being identical to mine, but given that I don't want to kill people, I'm already doing that at least to some degree.

You're still self-anchoring. You observe that they want to kill people, so you try to imagine under... (read more)

8wedrifid
The only part I would leave out of bgaesop's paragraph is the "not because he actually believed that that was what he was doing". All of the previous stuff fits fine when both the leader and the intended audience are sincere homo-hypocrites. That is why he is doing it (or equivalently the fact that they do it so well is what made them the leaders). What they believe about the matter can be orthogonal.
4bgaesop
Yes, definitely. I meant it that way, but what I actually wrote down is different, I'll correct it. Thanks for saying this.
1Eugine_Nier
Careful about the fundamental attribution error: I'm sincere in my beliefs; they're sincere homo-hypocrites.
2wedrifid
The warning does not appear relevant. The observation I made is that the description can apply regardless of the specific beliefs of the humans in question. It speaks to the general outcome of the political incentives.
4bgaesop
My mistake, wedrifid is correct, I turned my thought into a sentence poorly. I admit to not having considered this bias on this subject. That said, I don't think that this bias is affecting me very significantly here, and I think that because of the direction I approached my current position from: I arrived at it after moving from somewhere near where you are currently. I will consider the possibility that my position is affected by this bias, however. The manner in which I am doing so right now is to reread the wikipedia page that I just linked and follow several of the citations. It seems that the consensus is that perceived western aggression against Muslims and Islam is one of the prime motivators--which would then include what I said, and also perceived aggression against Islam specifically. So a mixture of what we've both been saying. I don't think that they are attempting to inspire a proletarian revolt across nations. I don't think that they are attempting to engage in a class struggle pitting the poor against the rich. I do think that they perceive themselves and their fellow Muslims as being the victims of exploitation by Westerners, and I think that they perceive a number of dimensions to that exploitation: military, economic, and cultural; perhaps more. Military is fairly obvious. Economic is what I was talking about, I mentioned it specifically because we were discussing the attacks on the World Trade Center. Cultural is what you are talking about. I believe that while it is an important portion of their motivation, it is not the primary piece. Unfortunately their rhetoric focuses on that issue largely (though by no means entirely) which gives an inflated view of its importance. It might be that we are saying similar things with rather different vocabularies. When you say that the Islamic world isn't as powerful as it was in its glory days, does that include what I talk about when I say they're being economically exploited? For instance, instead of a
0Eugine_Nier
The wikipedia page doesn't mention anything about "economic oppression". A large part of this "western aggressions" is a reaction to said attacks. Most people who aren't Marxists don't think of everything in terms of exploitation. (Note that I was able to correctly identify you as a Marxist simply from your use of the term "economic oppression"). In that case could you explain what you mean by an issue being "important" to them as it seems to have nothing to do with what they themselves think about the issue. Given that the gulf states are among the wealthiest per-capita, it's not us who are exploiting their people. In any case they're thinking in terms of military and cultural/religious power. To the extend they think about economics at all, its probably because they don't like how materialist our culture is. BTW, I don't think it's particularly meaningful to apply the term "exploitation" to voluntary, i.e., capitalist, as opposed to forced, i.e., feudal or socialist, economic relations, but that's another debate. My other point is that Islam isn't mere window dressing, but seriously affects the way they think, and hence what they do. Not recently.
1bgaesop
I just remembered the obvious point that I had been forgettig this whole time. Your position seems to me to be basically the position the article we're both commenting on is directly arguing is a silly, untenable one to take.
5[anonymous]
Muslim attacks are a worldwide phenomenon, concentrated in and around the Muslim world. See for example this or this.
0LCC
I read somewhere (I wonder if I can still find the source) that the terrorist groups which train the terrorists and provide the logistics etc. reward the family of the attacker generously. The article said that the reward was enough to allow one of the brothers of the attacker to marry – and by extension, to procreate. The "genetic" motive is therefore in my opinion all but irrelevant. That being said, I don't know if that specifically applies to the perpetrators in question.
1nickDaniels
This is the nature(genetics) vs nurture(environment/culture/upbringing) debate. Most scientists believe both of these to play a role and there's fascinating interplay between them. One interesting new field is epigenetics. Schizophrenia is a compelling example.  People may have the latent genetics for Schizophrenia and never display it. However, certain environmental pressures can cause these genes to express the phenotype and that person has these genes expressed..

I agree; there may very well be the rare innately evil person, but promoting or implementing an ideology that is based on false premises that turns out to have evil consequences does not require "innate" evil. The 9/11 hijackers might very well be described as "neurologically intact people with beliefs that have utterly destroyed their sanity" but, if the beliefs they had about the state of the world were actually true (which they weren't!) then many value systems would endorse their actions.

If there were a diety that condemns unbelieve... (read more)

"Everyone is the hero of their own story." is a popular claim, and may well be true, but I don't know if any evidence for it has been carefully collected.

"The Enemy's story, as seen by the Enemy, is not going to make the Enemy look bad." Some cultures fairly reliably create people who think rap sounds bad, others fairly reliably create people who think rap sounds good. Some cultures fairly reliably create people who think sushi tastes bad, others fairly reliably create people who think sushi tastes good. Some cultures fairly reliably cr... (read more)

A great post, and one of the reasons I promote emotivism. I attribute a recent dissagreement (in which I admit I acted like a dick) to just this. The funny thing is that usually two people argue with each other, convinced the other is evil. In this case I am arguing with someone over just how scary some other people that we both don't care for are.

It appears counterproductive to use the word mutants to describe how people think of enemies. Most people can easily deny that they've done that, and therefore conclude they don't need to learn from your advice. I think if you were really trying to understand those who accept misleading stereotypes of suicide bombers, you'd see that their stereotype is more like "people who are gullible enough to be brainwashed by the Koran". People using such stereotypes should be encouraged to think about how many people believe themselves to be better than average at overcoming brainwashing.

And for those who think suicide bombers are unusual deviants, I suggest reading Robert Pape's book Dying to Win.

This post starts off talking about school shooters, but I think it could be applied to terrorists as well, although they have a movement and ideology behind them.

It is interesting that you talk about the "nineteen [who] hijacked four jet airliners in a deliberately suicidal effort to hurt the United States of America". Your article starting in this vain gave me hope. Alas, it was not to be. I have not read all of your posts nor followed all of your links so I realize I have missed many of your thoughts and probably have an incomplete picture, so take what I'll say and put it in that context. If not, then your lack of expansion of this idea to its logical conclusion that these individuals did not typify [v... (read more)

7ChristianKl
Eliezer just used 9/11 as an example. His post isn't supposed to say all there is to say about 9/11. It's supposed to make a point about seeing the humanness in people who do bad deeds. Not understanding actions doesn't help. Praying doesn't help either. It's rather important to understand why the world is the way it is. If a significant amount of people in a democracy understand the way the world works you get positive political change.

Some Dude, since when is war profitable? It can be extremely expensive, and you can't really have both sides win, yet it is often the case that both sides are eager for it.

9bgaesop
Since there existed private military contractors, or before that, since there existed spoils of war?

An accurate estimate of anyone else’s psychology is a dubious benefit in strategic interactions that depend solely on being able to predict the actions of friend and foe.

In Proposition XXXVII of Part IV of the Ethics, Benedict Spinoza asserts that the good that every man who follows after virtue wants for himself, he also desires for other men; and this Desire is greater as his knowledge of God is greater. After proving his claim, Spinoza observes that the law against killing animals is based more on vain superstition and womanish pity than on sound reason... (read more)

1jeronimo196
Necroing, I couldn't help myself: An accurate estimate of anyone else's psychology should improve your ability to predict their actions. Beautiful. If I may misquote Tanos -"Using christianity to destroy christianity." I am not sure Spinoza would agree with the notion that foreigners are non-human, though. Leaving questions of theology and morality aside, the point of the above post is that thinking of your enemies as non-human will intervene with your ability to accurately model their motivations and predict/influence their future behaviour.

What do you mean by "evil"?

I've come to think that way years ago, and am happy to read such a clear exposition on the point.

What's ironic is that the first time the issue actually called my attention was while reading the famous How to Win Friends and Influence People. Now, the book is about winning, not truth, and the point of the chapter was saying to people "If I were in your position, I would have done the same thing" as a strategy to win their sympathy. Functional and teleological friend-winning strategy, sure. But when afterward Carnegie made the point that saying th... (read more)

1Paul Crowley
This seems trivially false - clearly the actions of others are influenced by my existence and the things I do in myriad ways. What non-trivially-false thing do you mean to say by it?
0ABranco
Influenced, yes. But not 'because' of you. It's not that personal. The other person carries all her dreams, histories, frustrations, hormones, cognitive biases and -- which is relevant -- a rather inaccurate map of the very territory that you are. Their response is more like an effect of that mix, in which, what concerns you, only a partial map of who you are play a role.
2Paul Crowley
That seems to me a very different sentiment from the one you quoted!

It seems to me that us readers and commenters of such a blog as this one might in fact have genuinely evil mutants as enemies.

This interview with notorious lawyer Jacques Verges in Spiegel deals with the question of evil in a very thought provoking way.

SPIEGEL: Mr. Verges, are you attracted to evil?

Jacques Verges: Nature is wild, unpredictable and senselessly gruesome. What distinguishes human beings from animals is the ability to speak on behalf of evil. Crime is a symbol of our freedom.

SPIEGEL: That's a cynical worldview.

Verges: A realistic one.

SPIEGEL: You have defended some of the worst mass murderers in recent history, and you have been called the "devil's advocate." Why do you feel so drawn to clients like Carlos and Klaus Barbie?

Verges: I believe that everyone, no matter what he may have done, has the right to a fair trial. The public is always quick to assign the label of "monster." But monsters do not exist, just as there is no such thing as absolute evil. My clients are human beings, people with two eyes, two hands, a gender and emotions. That's what makes them so sinister.

SPIEGEL: What do you mean?

Verges: What was so shocking about Hitler the "monster" was that he loved his dog so much and kissed the hands of his secretaries -- as we know from the literature of t

... (read more)

Another problem with seeing enemies as innately evil is that it lets us off the hook as to our own capacity for evil (so elegantly demonstrated by the Milgram experiments, although I hope I would do better).

I've lost count of how many times I've heard that Hitler or Stalin or whoever was "just evil," or that the holocaust was the result of some essentially German negative personality trait, or that child abusers of various kinds are "just monsters."

To the extent that these statements mean only "Boo Stalin!" or "Boo paedophiles!" I guess they're not so bad, but I think people actually believe them as propositions to some extent. Certainly, if movies are any guide, the bad guys are usually pure evil - for no readily apparent reason, they just love pain and want to blow up the world.

Which is a big problem, because it leads you to be naive about your own propensity. An acquaintance of mine knew a rapist, through work. This rapist was not a slavering beast, he was an ordinary guy (maybe with some nasty explicit or implicit beliefs about women) until he got drunk and raped somebody. I really don't want to say "it could have been me," and I honestly don't think it could have. But I doubt he thought, say a year before, that it could have been him.

5nick012000
More likely is that your inaccurate map of the territory of his mind was sufficiently wrong that it fell under the "normal person" category. As someone who has fantasies about that sort of thing (but would hopefully never actually do it), let me tell you that this isn't the sort of thing that comes out of nowhere. Odds are, he knew where his proclivities lay, and simply decided not to actualise his fantasies until alcohol reduced his inhibitions sufficiently that he decided to go through with them.

Eliezer, terrorists may not be evil mutants, but I'm pretty sure they do hate freedom. Islam translates to "submission to God", and if you look at the history of radical Islam, you'll see that their main opposition has been to freedom and liberalism all along. It all got started with a Muslim university student in the fifties who got disgusted with American immorality, and decided that Islam needed to stand against it, so he tried to overthrow the Egyptian government and establish an Islamic state. It failed, and he and his followers came to believe that it failed because Islam was being corrupted by Western freedoms and immorality.

They might not be evil, but their value structure is incompatible with ours.

I'm pretty sure they do hate freedom

Here's something that Muslim university student wrote:

When, in a society, the sovereignty belongs to God alone, expressed in its obedience to the Divine Law, only then is every person in that society free from servitude to others, and only then does he taste true freedom. This alone is 'human civilization', as the basis of a human civilization is the complete and true freedom of every person and the full dignity of every individual of the society. On the other hand, in a society in which some people are lords who legislate and some others are slaves who obey them, then there is no freedom in the real sense, nor dignity for each and every individual.

Qutb hates "liberal" freedom, but he considers it internal slavery to animal desires, and it correlates with external slavery to a human hierarchy. Whereas knowledge of Islam humanizes you, and a shared knowledge of Islam allows people to live without dictators, because order comes from an impersonal source - shariah law - rather than the whim of a governing class.

Qutb definitely values a form of freedom, but says it can't exist unless you have Islam first.

7nick012000
Yup. Thank you for finding that quote; it pretty much proves my point. He hates the Western version of freedom, and wants to destroy it to replace it with the iron boot on Islamic rule (and seems to have missed that in order to implement sharia law, there have to be people doing the implementation).

The person who originally claimed that "they hate us for our freedom" was probably referring to a Western, enlightenment notion, called by that name.

The thing that the Muslim university student praises and calls freedom is apparently an Islamic religious idea, corresponding very roughly to the sort of freedom a recovering addict craves from his addictions.

If the words were tabooed, then you would probably see the coherence of both points of view, and I think, could fairly assert that Islamists really do "hate our freedoms" in a sense, so long as you don't allow this approximation to carry more than its fair burden of explanatory weight (as certain former POTUSs have done).

0Danfly
When you put it like that, it actually sounds a lot like the Kantian notion of heteronomy versus autonomy.
4ChristianKl
Sayyid Qutb is more than a random Muslim university student. He's a central thinker. He was a leader of the Muslim Brotherhood when he wrote Milestones (the work you are citing).
0AlexanderRM
I just want to point out that that concept sounds almost exactly like something John Winthrop (the first governor of the Massachusetts colony) said, although I'm not sure if it was his Model of Christian Charity or a different speech (I have it in a book but it's not with me at present). Although it's actually your interpretation that's almost exactly the same, not so much the original quote. Basically that being free from God's will doesn't make you free, it makes you a slave to your animal desires, and you can only be free by being subservient to God. Rather interesting that the ideas aren't that different. Although it might be that it's not so much a common point of Abrahamic religion, but rather an independent response that very religious people develop in response to ideas of freedom. Also generally interesting to remember how incredibly different Western culture- not German culture or whatever, but English culture- were just a few centuries ago, compared to the way they are now. Anyway, mostly just found that interesting. Slightly relevant to point out that calling it "the Western version of freedom" isn't quite accurate, as said version goes back less than three centuries. I could furthermore point to all the people who cite Winthrop or the Puritans are America's founders (ex. politicians who use the phrase "City on a Hill"), but that wouldn't really be accurate; they don't really agree with any of their ideals and cite them because they honestly don't know how alien their ideals were to us.

I agree with the post; and I think it would be more applicable to us here on LW if we extend it to cover "stupid" as well as "evil". We see "stupid" and "evil" as not being very different; and we get the same shot of righteous adrenaline from putting down a stupid comment as from putting down an evildoer.

People who work with Steve Jobs said in the 1990s that he assigned everyone a "bozo bit"; and if they disagreed with him a few times, he set their bozo bit to 1, and ignored or derided everything they said... (read more)

0Vladimir_Nesov
It's a good general heuristic. It saves time and effort. When a person changes, you might get exposed to overwhelming evidence of such change, and update back only then. It also helps to have topic-specific bozo bits. For me, you are flagged for metaethics and decision theory, but you write good posts on human rationality.

Thank you so much! I really like this thread, because I've been arguing with people for years about it, and people just don't get it. ;) It's a really interesting topic, as well, trying to think from the bad guy's perspective. Thank you, again.

To me, it simply comes down to one thing: belief.

If you absolutely believe something, then no matter how implausible it may seem to others with other beliefs, to you, in your mind, it is evident truth, and that therefore is your reality, and anyone who thinks otherwise will often be irritatingly stupid to you.

People with absolute beliefs that just require faith can pretty much rationalise anything to fit them, and are amazingly good at ignoring obvious flaws in their beliefs, and at seeing any, even tiny, counter argument, as being 'evil' and taking the ot... (read more)

I agree with most of the points in this article, but yet it underestimates a fundamental difference between two ways of disagreeing.

Take the typical political debate about "raising taxes on the wealthy to give social help to the poor" vs "giving tax cuts and reducing social help". People can disagree on that topic for two completely different set of reasons.

People can disagree on that topic because, even if they share a more-or-less common utility function, in which having people dying of cold in the street is valued very negatively, they have different expectations about what each policy will do. Some will say that raising taxes on the wealthy and giving the money to the poor will improve the living conditions of the poor, without hurting much the wealthy, and will be good for the economy since it'll increase the demand in construction/good factory/... which is the true motor of economy. Some will say that raising the taxes on the wealthy and giving the money to the poor will lower the incentive for the rich to invest in the economy, and for the poor to find themselves a job, and will at the end damage the whole economy and makes everyone poorer on the long run... (read more)

3DSimon
You pose a number of excellent questions in your comment that one might ask about a political opponent. So then the next step is: how does one go about answering those questions? How do you figure out whether one's opponent has different terminal values, or different instrumental values, or both?
8kilobug
That's a very difficult question. One part of the answer lies into understanding the nature of the debate. Basically, I consider there are two kinds of debates : 1. A debate between two people, who trust each other (at least to a point, like friends or family members) and without witness. In that case, the whole point of the debate is trying to discover the truth, hoping at the end the two will agree (one conceding he was wrong, finding a common ground in the middle, or finding a third option unthought at the beginning), and it's quite easy to ask the other about his real goal (immediate or distance) and to assume he'll be honest about it. 2. A debate between two people, but who perfectly know they won't convince each other, but they try to convince witness of the debate. That's a typical debate between political candidates in an election. In that kind of debate, you've to be very doubtful about the claimed values (terminal or instrumental) of everyone involved. That kind of debate is very hard to handle in a non-mindkilling way. Most real life debates are somewhere in between those two archetypes. So I make that double distinction : between disagreement in expectation and disagreement in utility function, and between debating in order to get closer to the truth, and debating in order to convince third parties. I don't have a magical solution to find out for sure in which case we are, but I'll be glad to hear some tips/hindsight on the topic. Another way to state it : to me a political debate in front of witnesses is very like a kind of prisoner dilemma. You can cooperate, by being true on your terminal and instrumental values, being honest, pointing to the flaws of your own side when you see them, ... Or you can defect, by hiding your true values, hiding facts, avoiding your weak points, and even lying on facts. If both cooperate, the debate will go smoothly, and is likely to end up in everyone being closer to the truth than when you started. If both defec
3DSimon
I think that debates of the first type are probably even rarer than you estimate; even when two people who trust each other, and who both have a deliberate intent to seek the truth, are arguing alone, political instincts and biases kick in pretty hard. I do really like your overall strategy; I'll try to remind myself more often in the future to occasionally turn down my politics-face a bit to see if the other is willing to return to a more cooperative state.

The Jesus Camp link is broken. Does anyone have an alternative? I don't know what Eliezer is referencing there.

-6pedanterrific
2thomblake
I believe the link initially pointed to a trailer for the movie Jesus Camp.
6taelor
Jesus Camp is a documentary about a camp for fundamentalist Christian youths. The first part can be seen here (check the related videos for the subsequent parts). Alternately, if you don't have time to watch the full movie, this should give you a general idea.

This post needs to be air-dropped over the world's ten largest metropolitan areas. Actually, Harry Potter and the Methods of Rationality needs to be air-dropped, with translations where necessary, because it contains the same truths but is more entertaining. I think the same arguements apply to labeling your enemies as insane mutants, which is a somewhat gentler, more politically correct way of demonizing them. We tend to assume that the enemy is insane because we could not imagine doing such a thing, and are therefore Surprised by Reality. It might make sense to update our idea of "sanity."

3A1987dM
Not many people would want to read such a long book in large metropolitan areas (where people tend to be very busy). And this Cracked article also makes the same point (in Section 1 -- they're numbered backwards; and the other sections also cover topics which were covered in the Sequences).

Ever since I read this post, I've been trying to be as charitable as possible to my opponents, but it's been an uphill battle because emotions flare up quickly.

I recently discovered a nice psychological trick that happens to work on me, which helps me argue more sanely. As soon as I get angry or emotional, I catch myself, look straight at the other person, and repeat in my mind, I want you to prosper. I want you to be happy. I want you to live a fulfilling life. (This is true, for any and all people who disagree with me.)

Personally, I find it easier than trying to fight negativity with more negativity ("You're a Bad Person for thinking your opponent is a bad person; why is this such a horrible argument?"). Explicitly reminding myself that I'm on Team Humanity, not Team Political Party, explicitly reminding myself that the point of this arguing is to find a better way to help people, is usually enough to help me zoom out and erase negative feelings.

This hasn't been extensively tested, but it seems like it would fit the mindset of many people here. It worked on an Objectivist who said he would rather have people in Rwanda and Somalia starve to death than live like "... (read more)

I will just pop in here to say that I used to be this huge snob who would look down at people my age who said that Ender's Game is one of their favorite books. I was like "Clearly, they have not read any fancy literature since middle school. Silly noobs!"

And then I read the book again and I realized that actually that book is super-important because it basically captures the contents of this article in a book for children when most books for children are all about taking out the evil bad guy and sorta imply that violence is no big deal.

Great post of course.

If it took a mutant to do monstrous things, the history of the human species would look very different. Mutants would be rare.

Maybe I'm missing something, but shouldn't it read: "Mutants would not be rare." ? Many monstrous things happened in human history, so if only mutants could do evil deeds, there would have to be a lot of them. Furthermore, mutants are rare, so no need for the subjunctive "would".

2TheOtherDave
We posit a hypothetical alternate universe U where only mutants do monstrous things. We observe that mutants are rare in our world, and we speculate that the causes of mutant rarity would not be different in U, and therefore we conclude that "mutants would be rare" in U, and therefore we conclude that "the history of the human species would look very different" in U... specifically, that fewer monstrous things would have happened.

Realistically, most people don't construct their life stories with themselves as the villains. Everyone is the hero of their own story. The Enemy's story, as seen by the Enemy, is not going to make the Enemy look bad. If you try to construe motivations that would make the Enemy look bad, you'll end up flat wrong about what actually goes on in the Enemy's mind.

Well only at the uppermost level. i.e. most evil people are unaware that they are evil. They misconstrue their own motivations. So if you construe motivations which make the Enemy look bad, ... (read more)

-2[anonymous]
Nah, some of us are entirely well aware of the fact that we're just plain evil. It's just that, at a certain point, you look at the things that the vast supermajority of the human race consider Good and Virtuous, like noble kings who pull swords from stones, hard labor on farms, and their local army. Then you look at the things the vast supermajority of the human race consider Evil and Scummy, like democratically-elected officials, premarital sex, video games, and peace activists. And then, you realize that judging by the set of things you found appealing, you must be Evil, and you might as well embrace it.
0blacktrance
I'm confused. By "evil" do you mean "what the supermajority of the world considers Evil"?
1[anonymous]
Basically, yes. I am what the supermajority of the world considers Evil: a damn dirty democratic socialist who wants people to stop obsessing over stupid bullshit and have fun together. The mere fact that this sounds pretty ok when I say it outright just means I have creepy mind-control powers.
2blacktrance
But you don't actually think you're evil. You think you're good, you just recognize that people think you're evil.
1[anonymous]
No, I think the terminology is democratically determined.
5Lumifer
LOL. Supporting evidence, quoting Yvain's post:
2[anonymous]
While this is indeed exactly what happens when people call me a "communist" or "socialist", I'm not really sure what the relation is. I was mostly just expressing my near-total cynicism regarding people's ability to recognize that they don't live in storybooks. EDIT: As well as expressing the observation that despite my expressed moral alignment agreeing, if somewhat roughly, with what is commonly found on LessWrong, we are a tiny clique among billions. The expected-value human, chosen at random from throughout the world, thinks and feels in a way that we would deem bizarrely and almost inexplicably hostile. Whatever anyone thinks of my politics aside, much/most of the planet still operates mostly on "survive ethics", in which thinking is expensive and aesthetics suicidal, and would be both shocked and appalled to find out about how we live as people well-off enough to implement even a little "thrive ethics". Hell, just yesterday I had to suffer through a "debate" with a man who believes that by persecuting gay people and marrying exclusively within our religion, we can cause God to send the Messiah, who will proceed to... harshly enforce religious law, including death penalties, which are then multiplied as spiritual punishments in the afterlife. This is what many/most people actually believe.
2Lumifer
I don't think so. I've been to many places in the world, observed people there and talked to some of them. They did not strike me as "bizarrely and almost inexplicably hostile". Nope. I don' think this is true at all. Didn't you mean to say "This is what many/most Orthodox (and, generally, non-Reform) Jews actually believe"? There is a wee bit of a difference here... :-)
4[anonymous]
I will admit to a certain cynicism in my worldview. I do, however, wish to note that half the species lives in either China, India, or Africa. Of these, China is generally considered fairly safe and orderly. India and Africa are getting more safe and orderly over time. South America is a step up from India and Africa in some countries and a step down in some few remaining regions. North America and Europe are generally some of the safest, most orderly places on Earth. Eastern Europe and the Caucasus, as I understand them, are often orderly but sometimes unsafe. The Middle East, where I live, is generally considered the planet's dumping ground for pointless, vicious hatred. Anyway... Not even. I've met ultra-Orthodox Jews who use their mysticism and woo to justify a very warm and outgoing outlook on the world, and to whom punishment fantasies are regarded as poison for authentic religion. There's a very religious Muslim who works in the same building as me, actually, and we always say hi in the hall. To him, Allah (whom I usually regard as an utter totalitarian) gives the imperative to treat life seriously, consider things, and be ethical. In general, this guy acts like a kinder, more mature person than many of the secular people I see every day. This isn't to say I agree with either of these two religious views either, just that what we're dealing with is a general psychological outlook rather than a uniform ideology confined to a single specific clade. "Religious/ideological people are violent and nasty, but most people aren't like that" is an easy way for atheists, agnostics, and moderates of all stripes to congratulate themselves, but I don't think it's actually true. Now that I come to reevaluating my expressed view, I no longer think my original cynicism is even mostly correct, either. However, it took a relatively large step of new, original thinking for me to come up with a theory as to why, and it also required a major evaluation of my sampling set (ie:

Does anyone know of any psychological studies showing it is actually the case that people regard their enemies as evil, rather than misguided?

Agreed that the 9/11 hijackers see themselves as the heroes of their own story. But about “hating freedom”, they very likely thought that:

  1. Western influence on their cultures, regarding women’s right to dress, drive, work etc., is destructive.
  2. It is wrong that the legislatures can make laws that violate those given to them by the Prophet. (Even the alleged moderate Imam Rauf of the Ground Zero Mosque proposes that a bench of religious scholars be instituted to review decisions of the US courts).
  3. Christians and Jews must live within the limits prescribed
... (read more)

Realistically, most people don’t construct their life stories with themselves as the villains. Everyone is the hero of their own story.

At tonight's sequences-reading meetup, I argued that while it is a mistake to think that people typically see themselves as villains, it is also a mistake to think that they typically view themselves as heroes. Most people don't have especially grand narratives, nor do they view themselves as very strongly moral in either direction (even though I believe there's a trend toward positive self-image).

To get a little data on th... (read more)

-6kave