Imagine that you have a peculiar job in a peculiar factory:  Your task is to take objects from a mysterious conveyor belt, and sort the objects into two bins.  When you first arrive, Susan the Senior Sorter explains to you that blue egg-shaped objects are called "bleggs" and go in the "blegg bin", while red cubes are called "rubes" and go in the "rube bin".

    Once you start working, you notice that bleggs and rubes differ in ways besides color and shape.  Bleggs have fur on their surface, while rubes are smooth.  Bleggs flex slightly to the touch; rubes are hard.  Bleggs are opaque; the rube's surface slightly translucent.

    Soon after you begin working, you encounter a blegg shaded an unusually dark blue—in fact, on closer examination, the color proves to be purple, halfway between red and blue.

    Yet wait!  Why are you calling this object a "blegg"?  A "blegg" was originally defined as blue and egg-shaped—the qualification of blueness appears in the very name "blegg", in fact.  This object is not blue.  One of the necessary qualifications is missing; you should call this a "purple egg-shaped object", not a "blegg".

    But it so happens that, in addition to being purple and egg-shaped, the object is also furred, flexible, and opaque.  So when you saw the object, you thought, "Oh, a strangely colored blegg."  It certainly isn't a rube... right?

    Still, you aren't quite sure what to do next.  So you call over Susan the Senior Sorter.

        "Oh, yes, it's a blegg," Susan says, "you can put it in the blegg bin."
        You start to toss the purple blegg into the blegg bin, but pause for a moment.  "Susan," you say, "how do you know this is a blegg?"
        Susan looks at you oddly.  "Isn't it obvious?  This object may be purple, but it's still egg-shaped, furred, flexible, and opaque, like all the other bleggs.  You've got to expect a few color defects.  Or is this one of those philosophical conundrums, like 'How do you know the world wasn't created five minutes ago complete with false memories?'  In a philosophical sense I'm not absolutely certain that this is a blegg, but it seems like a good guess."
        "No, I mean..."  You pause, searching for words.  "Why is there a blegg bin and a rube bin?  What's the difference between bleggs and rubes?"
        "Bleggs are blue and egg-shaped, rubes are red and cube-shaped," Susan says patiently.  "You got the standard orientation lecture, right?"
        "Why do bleggs and rubes need to be sorted?"
        "Er... because otherwise they'd be all mixed up?" says Susan.  "Because nobody will pay us to sit around all day and not sort bleggs and rubes?"
        "Who originally determined that the first blue egg-shaped object was a 'blegg', and how did they determine that?"
        Susan shrugs.  "I suppose you could just as easily call the red cube-shaped objects 'bleggs' and the blue egg-shaped objects 'rubes', but it seems easier to remember this way."
        You think for a moment.  "Suppose a completely mixed-up object came off the conveyor.  Like, an orange sphere-shaped furred translucent object with writhing green tentacles.  How could I tell whether it was a blegg or a rube?"
        "Wow, no one's ever found an object that mixed up," says Susan, "but I guess we'd take it to the sorting scanner."
        "How does the sorting scanner work?" you inquire.  "X-rays?  Magnetic resonance imaging?  Fast neutron transmission spectroscopy?"
        "I'm told it works by Bayes's Rule, but I don't quite understand how," says Susan.  "I like to say it, though.  Bayes Bayes Bayes Bayes Bayes."
        "What does the sorting scanner tell you?"
        "It tells you whether to put the object into the blegg bin or the rube bin.  That's why it's called a sorting scanner."
        At this point you fall silent.
        "Incidentally," Susan says casually, "it may interest you to know that bleggs contain small nuggets of vanadium ore, and rubes contain shreds of palladium, both of which are useful industrially."
        "Susan, you are pure evil."
        "Thank you."

    So now it seems we've discovered the heart and essence of bleggness: a blegg is an object that contains a nugget of vanadium ore.  Surface characteristics, like blue color and furredness, do not determine whether an object is a blegg; surface characteristics only matter because they help you infer whether an object is a blegg, that is, whether the object contains vanadium.

    Containing vanadium is a necessary and sufficient definition: all bleggs contain vanadium and everything that contains vanadium is a blegg: "blegg" is just a shorthand way of saying "vanadium-containing object."  Right?

    Not so fast, says Susan:  Around 98% of bleggs contain vanadium, but 2% contain palladium instead.  To be precise (Susan continues) around 98% of blue egg-shaped furred flexible opaque objects contain vanadium.  For unusual bleggs, it may be a different percentage: 95% of purple bleggs contain vanadium, 92% of hard bleggs contain vanadium, etc.

    Now suppose you find a blue egg-shaped furred flexible opaque object, an ordinary blegg in every visible way, and just for kicks you take it to the sorting scanner, and the scanner says "palladium"—this is one of the rare 2%.  Is it a blegg?

    At first you might answer that, since you intend to throw this object in the rube bin, you might as well call it a "rube".  However, it turns out that almost all bleggs, if you switch off the lights, glow faintly in the dark; while almost all rubes do not glow in the dark.  And the percentage of bleggs that glow in the dark is not significantly different for blue egg-shaped furred flexible opaque objects that contain palladium, instead of vanadium.  Thus, if you want to guess whether the object glows like a blegg, or remains dark like a rube, you should guess that it glows like a blegg.

    So is the object really a blegg or a rube?

    On one hand, you'll throw the object in the rube bin no matter what else you learn.  On the other hand, if there are any unknown characteristics of the object you need to infer, you'll infer them as if the object were a blegg, not a rube—group it into the similarity cluster of blue egg-shaped furred flexible opaque things, and not the similarity cluster of red cube-shaped smooth hard translucent things.

    The question "Is this object a blegg?" may stand in for different queries on different occasions.

    If it weren't standing in for some query, you'd have no reason to care.

    Is atheism a "religion"Is transhumanism a "cult"?  People who argue that atheism is a religion "because it states beliefs about God" are really trying to argue (I think) that the reasoning methods used in atheism are on a par with the reasoning methods used in religion, or that atheism is no safer than religion in terms of the probability of causally engendering violence, etc...  What's really at stake is an atheist's claim of substantial difference and superiority relative to religion, which the religious person is trying to reject by denying the difference rather than the superiority(!)

    But that's not the a priori irrational part:  The a priori irrational part is where, in the course of the argument, someone pulls out a dictionary and looks up the definition of "atheism" or "religion".  (And yes, it's just as silly whether an atheist or religionist does it.)  How could a dictionary possibly decide whether an empirical cluster of atheists is really substantially different from an empirical cluster of theologians?  How can reality vary with the meaning of a word?  The points in thingspace don't move around when we redraw a boundary.

    But people often don't realize that their argument about where to draw a definitional boundary, is really a dispute over whether to infer a characteristic shared by most things inside an empirical cluster...

    Hence the phrase, "disguised query".

    New Comment
    108 comments, sorted by Click to highlight new comments since:
    Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings

    While the advisory against using a dictionary to resolve such arguments are true, a lot of arguments stem from confusion or disagreement over the meaning of words. Based on the work I've done in philosophy, this type of disagreement probably covers 50% of philosophical debates, with about 2% of the participants in such debates admitting that that is what they disagree about.

    For example, "Most atheists believe in the divinity of Christ" could be resolved easily without recourse to the empirical world. If I believe that it is possible for someone to be an atheist and believe in the divinity of Christ, then I am using atheist to mean something very different from its actual meaning.

    As you wrote earlier, using words invokes connotations regardless of whether a newly assigned definition merits the same connotations. Some on the far left have defined "racism" to mean "is White and lives in the USA." Appealing to a dictionary is useful in an argument with such a person because it prevents them from using a very charged word inappropriately. Similar tricks occur with "fascism," "freedom," "democracy," and many other such words.

    Bas... (read more)

    In colloge, I led a book discussion group about ethics. Most participants had read the book. Everyone in the group agreed that ethics and morals were different. They even agreed on HOW they were different (internal/personal vs group/societal, arrived at vs proscribed, philosophical vs legal). They REFUSED to agree, however, on what term referred to which distinction. Sigh...
    In that case, tabooing the word is probably better than bringing the dictionary to show that the other person's use of words are against common sense (assuming you want to actually reach a consensus, but if youre more about winning the argument then bring the dictionary is probably better?)

    Based on the work I've done in philosophy, this type of disagreement probably covers 50% of philosophical debates, with about 2% of the participants in such debates admitting that that is what they disagree about. Someone remind me against why I'm supposed to take philosophy seriously.

    Because if no one takes philosophy seriously, the philosophers will have nothing at all.

    Will you take that away from them? They have so little as it is.

    Is atheism a "religion"? Is transhumanism a "cult"?

    My favorite example is, Is a fetus a person?

    Quote: My favorite example is, Is a fetus a person? I can answer this one: A foetus is not a person prior to 20 weeks gestation (18 weeks of pregnancy), but may be a person from that point onwards. A body with one mind is one person. A body with two minds is two people (conjoint twins). A body with three minds would be three people. A heart transplant does not switch a person into a different body. A lung transplant does not switch a person into a different body. A brain transplant (and therefore a mind transplant) would switch a person into a different body. It is minds, not bodies, that defines people. The mind exists, if at all, in the brain, or more specifically the cerebral cortex. The cerebral cortex begins to develop connections no earlier than 20 weeks gestation, therefore there is not a person before this time (though the body does have reflexes). 'Brain Waves' When??? Margaret Sykes

    That doesn't answer the question "Is a fœtus a person", it just supplies a definition of "person", which may or may not be relevant to any given query.

    Suppose my real query is "Can a fœtus talk?" Now, just because I choose to define "person" in such a way that most "person"s can talk, and in such a way that a fœtus classes as a "person", that doesn't make the probability that a fœtus can talk any different to if I'd defined "person" differently.

    The whole point of these examples of disguised queries is that if you find yourself trying to answer them, you're doing it wrong.

    Suppose we call the horse's tail a leg.

    I was told once that I was clearly not a college graduate. After some digging, he explained that I took the time to define the terms in a discussion, whereas college grads knew the definitions of words, and so didn't take the time to agree on them. Can't agree with him about that.
    Hi, welcome!

    People who argue that atheism is a religion "because it states beliefs about God" are really trying to argue (I think) that the reasoning methods used in atheism are on a par with the reasoning methods used in religion, or that atheism is no safer than religion in terms of the probability of causally engendering violence, etc...

    Or they're applying a Fully General Counterargument without actually trying to make any substantive point, or realizing that they should be?

    Indeed. For example: I think that Jesus' response is a non sequitur (a well designed one (by using a technique similar to equivocation), which is why it makes for such good "blocking" technique). So there's no disguised query, since Jesus isn't querying at all, he's just trying to "win" the argument.
    There is a similarity between Christians and many atheists in their moral philosophy, however. Atheists may not believe in God, but I think they mostly adhere to the 10 commandments. At least Christians can say they follow their moral philosophy because God told them so. What reason do atheists have?
    I was actually just trying to say that Eliezer gave a bad example of a disguised query. As for moral philosophy, it can be considered a science. So atheists that believe in morality should value it as any other science (for it's usefulness etc). Well, hm, atheists need not be fans of science. So they can be moral because they enjoy it, or simply because "why the heck not".
    I wouldn't call moral philosophy a science. If we both independently invented an imaginary creature, neither would be correct. They are simply the creatures we've arbitrarily created. There is no science of moral philosophy anymore than there is a science of inventing an imaginary creature. I'd say to be science there needs to be the ability to test whether something is valid. There is no such test for the validity of morals anymore than there is a test for the validity of an imaginary creature.
    You have that backwards. Moral people follow their moral philosophy because they believe it's the right thing to do, whether they are Christian or atheist or neither. Some moral people also believe God has told them to do certain things, and use those beliefs to help them select a moral philosophy. Those people are moral and religious. Other moral people don't believe that, and select a moral philosophy without the aid of that belief. Those people are moral and atheist. Some immoral people believe that God has told them to do certain things. Those people are immoral and religious. Some immoral people don't believe that. Those people are immoral and atheist. Incidentally, I know no atheists (whether moral or not) who adhere to the Talmudic version of the first commandment. But then, since you are talking about the ten commandments in a Christian rather than Jewish context, I suppose you don't subscribe to the Talmudic version anyway a. (cf EDIT: I should probably also say explicitly that I don't mean to assert here that nobody follows the ten commandments simply because they believe God told them to... perhaps some people do. But someone who doesn't think the ten commandments are the right thing to do and does them anyway simply because God told them to is not a moral person, but rather a devout or God-fearing person. (e.g., Abraham setting out to sacrifice his son).
    I also know no atheists who adhere to the second commandment (make no graven image), the fourth (no "work" on Shabbath), or the tenth (do not covet).

    Atheists may not believe in God, but I think they mostly adhere to the 10 commandments.

    I think you're just trying to say that atheists follow moral expectations of modern Christian-influenced culture, but taken literally, the statement's nonsense.

    I mean, look at the Ten Commandments:

    1. Thou shalt have no other gods before me.
    2. Thou shalt not make unto thee any graven image (...).
    3. Thou shalt not take the name of the Lord thy God in vain (...).
    4. Remember the sabbath day, to keep it holy. (...)
    5. Honour thy father and thy mother (...).
    6. Thou shalt not kill.
    7. Thou shalt not commit adultery.
    8. Thou shalt not steal.
    9. Thou shalt not bear false witness against thy neighbour.
    10. Thou shalt not covet thy neighbour's house, (...) nor his ass, nor any thing that is thy neighbour's.

    The first 4 are blatantly ignored, 6 is famously problematic, 9 and 10 are mostly ignored (via gossip, status seeking, greed and so on) and finally 7 and 8 might be typically obeyed, but minor theft (especial anonymous) is common and adultery has at least 10% base rates.

    How is this a "mostly adhered"? (Obviously, Christians and atheists don't really differ in their behavior here.)

    In the interests of charitable reading, I took them to mean "atheists adhere to the ten commandments about as well as Christians do".
    I looked through them and I was surprised at how little I break them. 4 is way off, of course and I'll honour my father and mother to the extend they damn well earn it (rather a lot as it turns out). The thing is going by the standards that I actually held for following all those commandments when I was Christian I could have expected to be violating all over the place. I'm particularly disappointed with No. 7. I've been making a damn fine effort to be living in sin as much as conveniently possible but since I have yet to sleep with a married woman I seem to be clean on that one. Going by the actual commandment I'm probably even ok with 3. The "swearing" thing seems to be totally blown out of proportion.
    Personally I break some of them more often than I'd like, but then again I did so when I identified as an Orthodox Jew as well. Of course, if I were to take this seriously, I'd get bogged down in definitional issues pretty quickly. For example, I've slept with a married man (married to someone else, I mean), so I guess I've violated #7... or at least, he did. OTOH, given that everyone involved was aware of the situation and OK with it, I don't consider that any of us were doing anything wrong in the process. But a certain kind of religious person would say that my beliefs about what's right and wrong don't matter. Of course, I would disagree.
    I suppose you do technically scrape through in adhering to No. 7 as it is presented in that wikipedia passage based on two technicalities. That it it is only adultery if you sleep with a married woman and that being the partner of the adulterer doesn't qualify. (I'm a little skeptical of that passage actually). Come to think of it you may get a reprieve for a third exception if it is the case that the other guy was married to a guy (ambiguous).
    The guy in question was married to a woman at the time. Agreed about the technicalities.
    It's 6, isn't it! (Dexter has that problem too - I recommend following his example and at least chanelling it into vigilantism.)
    Well, I kill all the time... most people I know do. But if we adopt the conventional practice of translating "lo tirtzoch" as "don't murder", and further adopt the conventional practice of not labeling killings we're morally OK with as "murder", then I squeak by here as well... I'm basically OK with all the killing I've done. I've never actually watched Dexter, but I gather it's about someone compelled to murder people who chooses to murder only people where the world is improved by their death? Hrm. I'm not sure I agree. Certainly, if I'm going to murder someone, it should be the least valuable person I can find. Which might turn out to be myself. The question for me is how reliable my judgment is on the matter. If I'm not a reliable judge, I should recuse myself from judgement. Perhaps I should assemble a committee to decide on my victims.
    That doesn't sound like a convention that the quite fits with culture or spirit of the holy law in question or of the culture which would create such a law.
    Huh? The Israelites were for killing people during wartime, and the various cultures that interpreted that law all bent it to exclude the deaths they wanted to cause.
    Oh, of course you take into account what the Israelites considered murder, and whatever meaning they would have embedded into whatever word it was that is translated into murder or kill. But what we cannot reasonably do is plug in our moral values around killing. Being as we are a culture of immoral infidels by the standards of the law in question! (Gentiles too come to think of it.) What we consider moral killings is damn near irrelevant.
    (nods) As noted elsewhere, you're of course right. I was being snarky in the general direction of my Yeshiva upbringing, at the expense of accuracy. Bad Dave. No biscuit.
    It's not clear to me what you mean here. I took TheOtherDave to be interpreting "lo tirtzoch" as "socially disapproved killing is socially disapproved," which is vacuous on purpose. That is, a culture that would create such a law is a culture of homo hypocritus. To put it another way, the convention of how you interpret a law is more important that the written content of the law, and so the relevant question is if the Israelites saw "lo tirtzoch" as absolutely opposed to killing or not. (I would imagine not, as there were several crimes which mandated the community collectively kill the person who committed the crime!)
    I thought that was about what I said.
    I got the opposite impression from two sources: First, I saw the culture and spirit of the drafters of such a law to be self-serving / relativist / hypocritical, and so thought the convention was the embodiment of that. Your claim that the convention didn't fit with the culture suggested to me that you thought the Israelites saw the law as unchanging and unbendable. Second, the comment that claimed what we consider moral was irrelevant struck me as evidence for the previous suggestion, that there is a moral standard set at one time and not changing, rather than us modeling the Israelites' exmaple by bending the definitions to suit our purposes. It's plausible we agree except are using different definitions for things like culture and spirit, but also plausible we don't agree on key ideas here.
    In what I've seen of Dexter the most ethically grey kill was of a pedophile who was stalking his step-daughter (and that's a murder I'd be comfortable committing!). The rest were all murderers who were highly likely to kill again. For my part I would prefer to live in a world in which other people don't go around being vigilantes and also don't want to be a vigilante myself. Because frankly it isn't my problem and it isn't worth the risk or the effort it would take me.
    Slightly more specific and slightly less consequentialistic than that. He chooses to kill only other murderers, and usually only cold-blooded murderers who are unrepentant and likely to murder again, (example: one time he stopped when he realized his selected victim had only murdered the person that had raped him in prison). But it's not about improving the world really, sometimes he even sabotages the police investigation just so he can have these people to himself.
    I think the general idea is that by "murder" the concept of 'do not kill people without it being prescribed by the law' is meant -- with the rest of Mosaic law indicating in which cases it was okay to kill people nonetheless. So killing insects doesn't count (because they're not people), nor being a state executioner counts (because it's prescribed by the law).
    Yeah, you're right. I was being snarky in the general direction of my Yeshiva upbringing, at the expense of accuracy.
    I'll have to concede that atheists moral beliefs don't mostly adhere to the 10 commandments. The point I wished to make was that many of the moral philosophies of rationalists are very similar to their Christian counterparts. I believe the similarity is mostly due to the culture they were brought up in rather than whether they believe God exists or not. You might even consider God to be irrelevant to the issue.
    Agreed. Obligatory Moldbug link (warning: long, and only first in a series) for an interesting derivation of (some) modern morality as atheistic Christianity.
    I certainly agree that many people's moral beliefs are shaped and constrained by their culture, and that God is irrelevant to this, as is belief in God.
    Upvoted for the 10th commandment link.
    Maybe because they have decided that a specific moral philosophy would be most useful?
    Nitpick: Only half of the Ten Commandments are nice humanitarian commandments like "don't murder". The other half are all about how humans should interact with God, and I don't think most atheists put much weight behind "you will not make for yourself any statue or any picture of the sky above or the earth below or the water that is beneath the earth". They can say that, but unless they already have a moral philosophy that gives God moral authority (or states that Hell is to be avoided, or justifies gratitude for Creation, or...) that's not actually a reason.
    Well, for myself, it's because game theory says the world works better when people aren't dicks to one another, and because empathy (intuitive and rational) allow me to put myself in other peoples' shoes, and to appreciate that it's good to try to help them when I can, since they're very much like myself. I have desires and goals, and so do they, and mine aren't particularly more important simply because they're mine.
    0Swimmer963 (Miranda Dixon-Luinenburg)
    This is the base of my whole moral philosophy, too. And you know what? There are people who actually disagree with it! Responses I've gotten from people in discussions have ranged from "I don't give a shit about other people, they're not me" to "you can't think like that, you need to think selfishly, because otherwise everyone will trample on you."
    -2Swimmer963 (Miranda Dixon-Luinenburg)
    Lots of reasons. It's pretty much built into the human brain that being nice to your friends and neighbours is helpful to long-term survival, so most people get pleasant feelings from doing something they consider 'good', and feel guilty after doing something they consider 'bad'. You don't need the Commandments themselves. ...Oh and the whole idea that it's better to live in a society where everyone follows laws like "don't murder"...even if you personally could benefit from murdering the people who you didn't like, you don't want everyone else murdering people too, and so it makes sense, as a society, to teach children that 'murder is bad'.
    Are these reasons to not kill people or steal? Can I propose a test? Suppose that it were built into the human brain that being cruel to your friends and neighbors is helpful to long-term survival (bear with me on the evolutionary implausibility of this), and so must people get pleasant feelings from doing things they consider cruel, and feel guilty after doing nice things. Suppose all that were true: would you then have good reasons to to be cruel? If not, then how are they reasons to be nice?
    You would clearly have reasons; whether they are good reasons depends how you're measuring "good".
    We might want to distinguish here between reasons to do something and reasons why one does something. So imagine we discover that the color green makes people want to compromise, so we paint a boardroom green. During a meeting, the chairperson decides to compromise. Even if the chairperson knows about the study, and is being affected by the green walls in a decisive way (such that the greenness of the walls is the reason why he or she compromises), could the chairperson take the greenness of the walls as a reason to compromise?
    A reasonable distinction, but I don't think it quite maps onto the issue at hand. You said to suppose "people get pleasant feelings from doing things they consider cruel, and feel guilty after doing nice things". If one has a goal to feel pleasant feelings, and is structured in that manner, then that is reason to be cruel, not just reason why they would be cruel.
    Agreed, but so much is packed into that 'if'. We all seek pleasure, but not one of us believes it is an unqualified good. The implication of Swimmer's post was that atheists have reasons to obey the ten commandments (well, 4 or 5 of them) comparable in formal terms to the reasons Christians have (God'll burn me if I don't, or whatever). That is, the claim seems to be that atheists can justify their actions. Now, if someone does something nice for me, and I ask her why she did that, she can reply with some facts about evolutionary biology. This might explain her behavior, but it doesn't justify it. If we imagine someone committing a murder and then telling us something about her (perhaps defective) neurobiology, we might take this to explain their behavior, but never to justify it. We would never say 'Yeah, I guess now that you make those observations about your brain, it was reasonable of you to kill that guy." The point is that the murderer hasn't just given us a bad reason, she hasn't given us a reason at all. We cannot call her rational if this is all she has.
    -1Swimmer963 (Miranda Dixon-Luinenburg)
    I didn't claim that, and if I implied it, it was by accident. (Although I do think that a lot of atheists have just as strong if not stronger reasons to obey certain moral rules, the examples I gave weren't those examples.) I was trying to point out that if someone decides one day to stop believing in God, and realizes that this means God won't smite them if they break one of the Ten Commandments, that doesn't mean they'll go out and murder someone. Their moral instincts, and the positive/negative reinforcement to obey them (i.e. pleasure or guilt), keep existing regardless of external laws. So we ask her why, and she says "oh, he took the seat that I wanted on the bus three weeks in a row, and his humming is annoying, and he always copies my exams." Which might not be a good reason to murder someone according to you, with your normal neurobiology–you would content yourself with fuming and making rude comments about him to your friends–but she considers it a good reason, because her mental 'brakes' are off.
    Right, we agree on that. But if the apostate thereafter has no reason to regard themselves as morally responsible, then their moral behavior is no longer fully rational. They're sort of going through the motions. The question here isn't about good vs. bad reasons, but between admissible vs. inadmissible reasons. Hearsay is often a bad reason to believe that Peter shot Paul, but it is a reason. It counts as evidence. If that's all you have, then you're not reasoning well, but you are reasoning. The number of planets orbiting the star furthest from the sun is not a reason to believe Peter shot Paul. It's not that it's a bad reason. It's just totally inadmissible. If that's all you have, then you're not reasoning badly, you're just not reasoning at all.
    -2Swimmer963 (Miranda Dixon-Luinenburg)
    It's a hard world to visualize, but if cruelty-tendencies evolved because people survived better by being cruel, then cruelty works in that world, and society would be dysfunctional if there were rules against it (imagine our world having rules against being nice, ever!), and to me, something being useful is a good reason to do it. If we ever came across that species, no doubt we'd be appalled, but the universe isn't appalled. Not unless you believe that morality exists in itself, independently of brains...which I don't. If there were an entire society built out of people like this, then probably quite a lot of minor day-to-day cruelty would go on, and there would be rationalized Laws, like the Ten Commandments, justifying why being cruel was so important, and there would be social customs and structures and etiquette involved in making sure the right kind of cruelty happened at the right times... I'm not saying that our brain's evolutionary capacity for empathy is the ultimate perfect moral theory. But I do think that all those moral theories, perfect or ultimate or not, exist because our brains evolved to have the little voice of empathy. Which means that if you take away the Ten Commandments, most people won't stop being nice to people they care about. (Being nice to strangers or members of an outgroup is a completely different matter...there seems to be a mechanism for turning off empathy towards groups of strangers, and plenty of societies have produced people who were very nice to their friends and neighbors, and barbaric towards everyone else.) Most atheists don't accept deontological moral theories–i.e. any theory that talks about a set of a priori rules of what's right versus wrong. But morality doesn't go away. If you reason it out starting from what our brains already tell us, you end up with utilitarian theories ("I like being happy, and I'm capable of empathy, so I think other people must like being happy too, and since my perfect world would be on
    So we agree that one might have a reason to do something because it's recommended by moral theories. What I'm questioning is whether or not you can have a reason to do something on the basis of brain mechanisms or if you can have reason to adopt a moral theory on the basis of brain mechanisms. And I don't mean 'good' reasons, I mean admissible reasons. Imagine someone thinking to themselves: 'Well, my brain is structured in such and such a way as a result of evolution, so I think I'll kill this completely innocent guy over here.' Is he thinking rationally? And concerning the adoption of a moral theory: There's a missing inference here from wanting to be happy to wanting other people to be happy. Can you explain how you think this argument gets filled out? As it stands, it's not valid. Likewise: Why should the fact that other people want something motivate me? It doesn't follow from the fact that my wanting something motivates me, that another person's wanting that thing should motivate me. In both these arguments there's a missing step which, I think, is pertinent to the problem above: the fact that I am motivated to X doesn't even give me reason to X, much less a reason to pursue the desires of other people.
    0Swimmer963 (Miranda Dixon-Luinenburg)
    Beliefs don't feel like beliefs, they feel like the way the world is. Likewise with brain structures. If someone is a sociopath (in short, their brain mechanism for empathy is broken) and they decide they want to kill someone for reasons X and Y, are they being any more irrational than someone who volunteers at a soup kitchen because seeing people smile when he hands them their food makes him feel fulfilled? Sorry for not being clear. The inference is that "empathy", the ability to step into someone else's shoes and imagine being them, is an innate ability that most humans have, leads you to think that other people are like you...when they feel pleasure, it's like your pleasure, and when they feel pain, it's like your pain, and there's a hypothetical world where you could have been them. I don't think this hypothetical is something that's taught by moral theories, because I remember reasoning with it as a child when I'd had basically no exposure to formal moral theories, only the standard "that wasn't nice, you should apologize." If you could have been them, you want the same things for them that you'd want for yourself. I think this is immediately obvious for family members and you want your mother to be happy? Your children?
    Perhaps on some level this is right, but the fact that I can assess the truth of my beliefs means that they don't feel like the way the world is in an important respect. They feel like things that are true and false. The way the world is has no truth value. Very small children have problem with this distinction, but so far as I can tell almost all healthy adults do not believe that their beliefs are identical with the world. ETA: That sounded jerky. I didn't intend any covert meanness, and please forgive any appearance of that. I think I really don't understand your question. Could you explain the idea behind this a little better? My objection was that there are reasons to do things, and reasons why we do things, and while all reasons to do things are also reasons why, there are reasons why that are not reasons to do things. For example, having a micro-stroke might be the reason why I drive my car over an embankment, but it's not a reason to drive one's car over an embankment. No rational person could say to themselves "Huh, I just had a micro-stroke. I guess that means I should drive over this embankment." Sure, but I take myself to have moral reasons for this. I may feel this way because of my biology, but my biology is never itself a reason for me to do anything.
    1Swimmer963 (Miranda Dixon-Luinenburg)
    OK, let me give you a better example. When you look at something, a lot of very complex hardware packed into your retina, optic nerve, and visual cortex, a lot of hard-won complexity optimized over millions of years, is going all out analyzing the data and presenting you with comprehensible shapes, colour, and movement, as well as helpful recognizing objects for you. When you look at something, are you aware of all that happening? Or do you just see it? (Disclaimer: if you've read a lot about neuroscience, it's quite possible that sometimes you do think about your visual processing centres while you're looking at something. But the average person wouldn't, and the average person probably doesn't think 'well, there go my empathy centres again' when they see an old lady having trouble with her grocery bag and feel a desire to help her.) Okay, let's try to unpack this. In my example, we have a sociopath who wants to murder someone. The reason why he wants to murder someone, when most people don't, is because there's a centre in his brain that's broken and so hasn't learned to see the world from another's perspective, thus hasn't internalized any social morality because it doesn't make sense to him...basically, people are objects to him, so why not kill them. His reason to murder someone is because, let's say, they're dating a girl he wants to date. Most non-sociopaths wouldn't consider that a reason to murder anyone, but the reason why they wouldn't is because they have an innate understanding that other people feel pain, of the concept of fairness, etc, and were thus capable of learning more complex moral rules as well. The way I see it, the biology aspect is both necessary and sufficient for this kind of behaviour. Someone without the requisite biology wouldn't be a good parent or friend because they'd see no reason to make an effort (unless they were deliberately "faking it" to benefit from that person). And an ordinary human being raised with no exposure to mora
    I just see it. I'm aware on some abstract level, but I never think about this when I see things, and I don't take it into account when I confidently believe what I see. "His reason to murder someone is because, let's say, they're dating a girl he wants to date. Most non-sociopaths wouldn't consider that a reason to murder anyone" I guess I'd disagree with the second claim, or at least I'd want to qualify it. Having a broken brain center is an inadmissible reason to kill someone. If that's the only explanation someone could give (or that we could supply them) then we wouldn't even hold them responsible for their actions. But dating your beloved really is a reason to kill someone. It's a very bad reason, all things considered, but it is a reason. In this case, the killer would be held responsible. "The way I see it, the biology aspect is both necessary and sufficient for this kind of behaviour. " Necessary, we agree. Sufficient is, I think, too much, especially if we're relying on evolutionary explanations, which should never stand in without qualification for psychological, much less rational explanations. After all, I could come to hate my family if our relationship soured. This happens to many, many people who are not significantly different from me in this biological respect. An ordinary human being raised with no exposure to moral rules in an extremely strange counterfactual: no person I have ever met, or ever heard of, is like this. I would probably say that there's not really any sense in which they were 'raised' at all. Could they have friends? Is that so morally neutral an idea that one could learn it while leaning nothing of loyalty? I really don't think I can imagine a rational, language-using human adult who hasn't been exposed to moral rules. So the 'necessity' case is granted. We agree there. The 'sufficiency' case is very problematic. I don't think you could even have learned a first language without being exposed to moral rules, and if you never
    0Swimmer963 (Miranda Dixon-Luinenburg)
    A weak example of this: someone from a society that doesn't have any explicit moral rules, i.e. 'Ten Commandments.' They might follow laws, but but the laws aren't explained 'A is the right thing to do' or 'B is wrong'. Strong version: someone whose parents never told them 'don't do that, that's wrong/mean/bad/etc' or 'you should do this, because it's the right thing/what good people do/etc.' Someone raised in that context would probably be strange, and kind of undisciplined, and probably pretty thoughtless about the consequences of actions, and might include only a small number of people in their 'circle of empathy'...but I don't think they'd be incapable of having friends/being nice.'
    I can see a case like this, but morality is a much broader idea than can be captured by a list of divine commands and similar such things. Even Christians, Jews, and Muslims would say that the ten commandments are just a sort of beginning, and not all on their own sufficient to be moral ideas. Huh, we have pretty different intuitions about this: I have a hard time imagining how you'd even get a human being out of that situation. I mean, animals, even really crappy ones like rats, can be empathetic toward one another. But there's no morality in a rat, and we would never think to praise or blame one for its behavior. Empathy itself is necessary for morality, but far from sufficient.
    Relevant LW post.
    That post is in need of some serious editing: I genuinely couldn't tell if it was on the whole agreeing with what I was saying or not. I have a puzzle for you: suppose we lived in a universe which is entirely deterministic. From the present state of the universe, all future states could be computed. Would that mean that deliberation in which we try to come to a decision about what to do is meaningless, impossible, or somehow undermined? Or would this make no difference?
    That post didn't have a conclusion, because EY wanted to get much further into his Metaethics sequence before offering one. It makes no difference. In fact, many-worlds is a deterministic universe; it just so happens there are different versions of future-you who experience/do different things, so it's not "deterministic from your viewpoint".
    So I'd like to argue that it makes at least a little difference. When we engage in practical deliberation, when we think about what to do, we are thinking about what is possible and about ourselves as sources of what is possible. No one deliberates about the necessary, or about anything over which we have no control: we don't deliberate about what the size of the sun should be, or whether or not modus tollens should be valid. If we realize that the universe is deterministic, then we may still decide that we can deliberate, but we do now qualify this as a matter of 'viewpoints' or something like that. So the little difference this makes is in the way we qualify the idea of deliberation. So do you agree that there is at least this little difference? Perhaps it is inconsequential, but it does mean that we learn something about what it means to deliberate when we learn we are living in a deterministic universe as opposed to one with a bunch of spontaneous free causes running around.
    It all adds up to normality. Everything you do when making a decision is something a deterministic agent can do, and a deterministic agent that deliberates well will (on average) experience higher expected value than deterministic agents that deliberate poorly. You're getting closer to the sequence of posts that covers this in more detail, so I'll just say that I endorse what's said in this sequence.
    What is normality exactly? It's not the ideas and intuitions I came to the table with, unless the theory actually proposes to teach me nothing. My questions is this: "what do I learn when I learn that the universe is deterministic?" Do I learn anything that has to do with deliberation? One reasonable answer (and one way to explain the normality point) would just be 'no, it has nothing to do with action.' But this would strike many people as odd, since we recognize in our deliberation a distinction between future events we can bring about or prevent, and future states we cannot bring about or prevent. I find I have an extremely hard time understanding some of the arguments in that sequence, after several attempts. I would dearly love to have some of it explained in response to my questions. I find this argument in parcticular to be very confusing: This argument (which reappears in the 'timeless control' article) seems to hang on a very weird idea of 'changing the future'. No one I have ever talked to believes that they can literally change a future moment from having one property to having another, and that this change is distinct from a change that takes place over an extent of time. I certainly don't see how anyone could take this as a way to treat the world as undetermined. This seems like very much a strawman view, born from an equivocation on the word 'change'. But I expect I am missing something (perhaps something revealed later on in the more technical stage of the article). Can you help me?
    I meant that learning the universe is deterministic should not turn one into a fatalist who doesn't care about making good decisions (which is the intuition that many people have about determinism), because goals and choices mean something even in a deterministic universe. As an analogy, note that all of the agents in my decision theory sequence are deterministic (with one kind-of exception: they can make a deterministic choice to adopt a mixed strategy), but some of them characteristically do better than others. Regarding the "changing the future" idea, let's think of what it means in the context of two deterministic computer programs playing chess. It is a fact that only one game actually gets played, but many alternate moves are explored in hypotheticals (within the programs) along the way. When one program decides to make a particular move, it's not that "the future changed" (since someone with a faster computer could have predicted in advance what moves the programs make, the future is in that sense fixed), but rather that of all the hypothetical moves it explored, the program chose one according to a particular set of criteria. Other programs would have chosen another moves in those circumstances, which would have led to different games in the end. When you or I are deciding what to do, the different hypothetical options all feel like they're on an equal basis, because we haven't figured out what to choose. That doesn't mean that different possible futures are all real, and that all but one vanish when we make our decision. The hypothetical futures exist on our map, not in the territory; it may be that no version of you anywhere chooses option X, even though you considered it. Does that make more sense?
    A fair point, though I would be interested to hear how the algorithm described in DT relate to action (it can't be that they describe action, since we needn't act on the output of a DT, especially given that we're often akratic). When the metaethics sequence, for all the trouble I have with its arguments, gets into an account of free will, I don't generally find myself in disagreement. I've been looking over that and the physics sequences in the last couple of days, and I think I've found the point where I need to do some more reading: I think I just don't believe either that the universe is timeless, or that it's a block universe. So I should read Barbour's book. Thanks, buy the way for posting that DT series, and for answering my questions. Both have been very helpful. It does, but I find myself, as I said, unable to grant the premise that statements about the future have truth value. I think I do just need to read up on this view of time.
    You're welcome! Yeah, a human who consciously endorses a particular decision theory is not the same sort of agent as a simple algorithm that runs that decision theory. But that has more to do with the messy psychology of human beings than with decision theory in its abstract mathematical form.
    Christians allegedly follow the commandments because God told them to. They do what God told them to because of desire to avoid punishment, desire to obtain reward, desire to fulfill their perceived duty, or desire to express their love. They fulfill these desires because it makes them feel good/happy. Atheists do whatever they do, most of them for the same reason, cut out the idea of it being centered around a personality who effects their happiness. Harry said he preferred achieving things over happiness, but I can't help thinking that if he had sacrificed his potential, he wouldn't really have been happy about it, no matter how many friends he had. At the end of the day, happiness drives at least most people, and in theory, all (when they make their decisions through careful consideration, and not just to fulfill some role or habit. As we know, this is rare, and in reality, most people can not trace their decisions' motivation to their happiness or anyone's, or to any other consistent value; so I opine).
    That sounds like a hidden tautology-by-definition. What is happiness? That which people act to obtain. Why do people act? To obtain happiness. Whatever someone does, you can say after the fact that they did it to make themselves happy.
    It is a state of mind. So saying that someone is driven by happiness is not tautological -- it means that they have a perceptually determined utility function.
    I think Plastic's got it. I don't think happiness is defined as whatever people act to obtain. It's something most people fail at with some regularity. I mean, just look at Elsa, yah?
    Er, Elsa)? Um, what?
    Precisely! Full of noble desires, and of self-destructive means to achieve them. Her efforts for happiness are wonderfully demonstrative of the failure systemic to like efforts conceived in ignorance.
    Or they're not spelling out their evidence because it seems obvious to them and therefore (in their minds) should be obvious to you as well and need no explanation. I know many Atheists for whom their belief in no god is indeed a religion. They arrived at their belief not through reason and weighing the evidence but through the same kind of blind acceptance of someone else's cached values that religionists engage in. They fall into the same traps of treating "arguments as soldiers" as do the religionists. They make the same kind of circular, bad arguments in favour of their own point of view. Since these people also tend to be the most vocal, militant Atheists they are the ones that vocal Theists run up against the most often. As a result Theists, upon encountering a rational Atheist are at least as perplexed as an Atheist encountering one of the rare, rational Theists and the two often end up talking past each other due to not realising that the assumed common frame of reference they're each trying to use for communication isn't actually common.

    Summary: Aristotelianism considered harmful; Hilbert Space is the new industry standard.

    The question "Is this object a blegg?" may stand in for different queries on different occasions. If it weren't standing in for some query, you'd have no reason to care.

    Basically, this is pragmatism in a nutshell -- right?

    Cheers, Ari

    Excellent post, however, "But people often don't realize that their argument about where to draw a definitional boundary, is really a dispute over whether to infer a characteristic shared by most things inside an empirical cluster..." Indeed so, but there are other aspects. Humans also have obsessions with (a) how far your cluster is from mine (kinship or the lack of it) (b) given one empirical cluster, how can I pick a characteristic, however minor, which will allow me to split it into 'us vs them' (Robber's Cave). So when you get to discussing whether an uploaded human brain is part of the cluster 'human', those are the considerations which will be foremost.

    Or more concisely: sharp distinctions regarding fuzzy concepts are meaningless.

    My favorite example is, Is a fetus a person? Yes, but it's still okay to murder them.

    Micha Gertner has an interesting essay on pragmatism & economics here.

    What's really at stake is an atheist's claim of substantial difference and superiority relative to religion

    Often semantics matter because laws and contracts are written in words. When "Congress shall make no law respecting an establishment of religion", it's sometimes advantageous to claim that you're not a religion, or that your enemy is a religion. If churches get preferential tax treatment, it may be advantageous to claim that you're a church.

    Often semantics matter because laws and contracts are written in words.

    What he said.

    I'm having problems with the word "is" in your description.

    This is not intended as a snarky comment...

    Rolf, have you been reading Unqualified Reservations?

    This was a really clarifying post for me. I had gotten to the point of noticing that "What is X?" debates were really just debates over the definition of X, but I hadn't yet taken the next step of asking why people care about how X is defined.

    I think another great example of a disguised query is the recurring debate, "Is this art?" People have really widely varying definitions of "art" (e.g., some people's definition includes "aesthetically interesting," other people's definition merely requires "conceptually interesting") -- and in one sense, once both parties explain how they use the word "art," the debate should resolve pretty quickly.

    But of course, since it's a disguised query, the question "Is this art?" should really be followed up with the question "Why does it matter?" As far as I can tell, the disguised query in this case is usually "does this deserve to be taken seriously?" which can be translated in practice into, "Is this the sort of thing that deserves to be exhibited in a gallery?" And that's certainly a real, non-semantic debate. But we can have that debate without ev... (read more)

    I like this post because it shows the usefulness of one of my favourite questions to answer a question with: "What's it for?" What use do you have for the answer to your question?

    When I have discussions of the philosophical kind, I have learned that it often pays of to start with defining the words being used: For example, I recall one discussion where I defined Evil as a shorthand for "all corporations and institutions that try to compete by opposing the existence and legitimacy of competitors and newcomers instead of by trying to offer a better product, like Microsoft", and one other discussion where I defined Evil as "Working for Sauron or Saruman or Morgoth", i.e very different. I would never (that is, I try... (read more)

    I run the Less Wrong meetup group in Palo Alto. After we announced the events at, we often get a lot of guests who are interested in rationality but who have not read the LW sequences. I have an idea for a introductory session where we have the participants do a sorting exercise. Therefore, I am interested in getting 3D printed versions of rubes, bleggs and other items references in this post.

    Does anyone have any thoughts on how to do this cheaply? Is there sufficient interest in this to get a kickstarter running? I expect that these items may be of interest to other Less Wrong meetup groups, and possibly to CFAR workshops and/or schools?