Rationality quotes: June 2010

by Morendil1 min read1st Jun 2010223 comments

4

Rationality Quotes
Personal Blog

This is our monthly thread for collecting these little gems and pearls of wisdom, rationality-related quotes you've seen recently, or had stored in your quotesfile for ages, and which might be handy to link to in one of our discussions.

  • Please post all quotes separately, so that they can be voted up/down separately.  (If they are strongly related, reply to your own comments.  If strongly ordered, then go ahead and post them together.)
  • Do not quote yourself.
  • Do not quote comments/posts on LW/OB.
  • No more than 5 quotes per person per monthly thread, please.
223 comments, sorted by Highlighting new comments since Today at 4:05 PM
New Comment
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings

"I accidentally changed my mind."

my four-year-old

0JoshuaZ10yWell, that hopefully lead to a teaching moment...
2NancyLebovitz10yIt leads to a contemplative moment for me-- I suspect accidentally changing one's mind happens relatively often.
2phaedrus10yhttp://www.spring.org.uk/2007/12/our-secret-attitude-changes.php [http://www.spring.org.uk/2007/12/our-secret-attitude-changes.php]
0NancyLebovitz10yThank you. I know of a couple things I've changed my mind about, but I may be unusually inclined to keep track.
0Benquo10yMaybe you can explain to me what the lesson is here?
2JoshuaZ10yIt depends precisely on the context of what the kid meant. But I would think that high on the list would making sure the kid understands that changing one's mind based on evidence is a good thing. And discussing with the kid why they changed their mind? Did they do so for a good reason based on facts and thinking? Or was it purely emotional?
0wedrifid10yI will not teach my children that changing one's mind based on emotion is bad. Particularly not before I establish whether their emotional or logical thinking is their strong point.
1JoshuaZ10yWhat do you mean by emotional thinking? And how do you determine whether someone has good emotional thinking?
3wedrifid10yI was running with the distinction from the context: "A good reason based on facts and thinking vs X" I make the observation that many (most?) people can more effectively guide their lives by doing what 'feels' right than by facts and reason. In fact, humans come wired with mechanisms which allow feelings to override reason. The quote Roko made on this very page [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/23om] alludes to why. You look at whether they screw up more - When they do what they think is the right thing to do or when they go with what they feel is right. In all cases there will be times for each kind of thought and the balance will depend on personality and aptitude for various thinking patterns. What I will NEVER do is train my children to associate "facts and thinking" with 'good' and and contrasted with 'emotional'. It takes a HUGE amount of facts and thinking to equal the quality of thought that emotions represent and quite often those that are best at giving priority to "good reason, facts and thinking" over emotions are not those who are the most successful. (Even though I'll probably like them more. ;))
0[anonymous]10yI was running with the distinction from the context: "A good reason based on facts and thinking vs X" I make the observation that many (most?) people can more effectively guide their lives by doing what 'feels' right than by facts and reason. In fact, humans come wired with mechanisms which allow feelings to override reason. The [quote Roko made on this very page](> What do you mean by emotional thinking? I was running with the distinction from the context: "A good reason based on facts and thinking vs X" I make the observation that many (most?) people can more effectively guide their lives by doing what 'feels' right than by facts and reason. In fact, humans come wired with mechanisms which allow feelings to override reason. The quote You look at whether they screw up more when they ) alludes to why. You look at whether they screw up more - When they do what they think is the right thing to do or when they go with what they feel is right. In all cases there will be times for each kind of thought and the balance will depend on personality and aptitude for various thinking patterns. What I will NEVER do is train my children to associate "facts and thinking" with 'good' and and contrasted with 'emotional'. It takes a HUGE amount of facts and thinking to equal the quality of thought that emotions represent and quite often those that are best at giving priority to "good reason, facts and thinking" over emotions are not those who are the most successful. (Even though I'll probably like them more. ;))
0Benquo10yOh, I see. Thanks.

A certain mother habitually rewards her small son with ice cream after he eats his spinach. What additional information would you need to be able to predict whether the child will: a. Come to love or hate spinach, b. Love or hate ice cream, or c. Love or hate Mother?

-- Gregory Bateson, "Steps to an Ecology of Mind"

3SilasBarta11yGreat quote! (Talk about be smacked with your own hidden assumptions...) Got a link to the surrounding text?
4Oscar_Cunningham11yCare to explain to me what you got out of it? I think I might be missing the point of this quote.

When you interact with someone, you may think, I will do this, so that they will do that, or think such-and-such, or feel thus-and-so; but what is actually going on for them may bear no resemblance to the model of them that you have in your head. If your model is wrong at the meta-level -- you are wrong about how people work -- then you will either notice that you have difficulty dealing with people at all, or not notice that the problem is with you and get resentful at everyone else for not behaving as you expect them to.

Here, Mrs. B.F. Skinner imagines that she is reinforcing the behaviour that she desires, of eating spinach, by providing the reinforcer, ice-cream. Or is she really punishing the consumption of ice-cream by associating it with spinach? Or associating herself with an unpleasant situation? Or any number of other possibilities.

8SilasBarta11ySure thing. For me, it was the sudden realization that I had made assumptions from the very start of reading it, and that I had ranked certain outcomes far lower than the problem -- taken in isolation -- would justify. When I read it, I immediately thought, "Okay, rewarding a kid for eating spinach, same ol' same ol' ..."; then when I got to the end, I -- very quickly -- absorbed the insight that, in order for the process not to result in the child hating the mother, certain conditions have to hold, which are probably worthy of probing in depth. I know all of this may sound obvious, but I really had an aha!/gotcha! moment on that one.
2RichardKennaway11yOn Google Books [http://books.google.co.uk/books?id=HewJbnQmn1gC] (limited online availability, but search for "habitually"). If you Google the title, you'll find the full text on a Brazilian website; whether legally or not I don't know.
1gwern8ySee also http://lesswrong.com/r/discussion/lw/dxm/clarification_behaviourism_reinforcement/ [http://lesswrong.com/r/discussion/lw/dxm/clarification_behaviourism_reinforcement/]
-1cousin_it11yHate spinach, love ice cream, love mother. What's so difficult?

What's so difficult?

For you, understanding what was asked. The question is not, "what will happen?" The question is, "What information do you need in order to know which outcome will happen?"

Can someone explain why the parent is upvoted? Is everyone just assuming that the Bateson quote is just a sarcastic, roundabout way of asking what will happen?

ETA: In case you weren't aware, cousin_it is not joking with his comment.

3Vladimir_Nesov11yHow dare you dispel Deep Wisdom of Master Bateson?
1Eliezer Yudkowsky11yI try not to downvote people when they are right.
6SilasBarta11yNor, apparently, when they're not even wrong. cousin_it's reply was non-responsive [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/23e8].
0cousin_it11yThanks. I was surprised to be downvoted, but decided not to ask why.
6SilasBarta11yI downvoted you because you're either completely missing the point of the quote, or you're unsuccessfully trying to be funny. In case it's not the latter: Yes, since you already know the answer, it's easy to "infer" the result from the givens. But the question is, what additional information are you using that constrains your answer to that? That's what you need to say to solve it, not just repeat back from the answer key. Furthermore, it's not at all clear that children get the result you claim.
2cousin_it10yI don't quite understand your objection. "Love mother" was an unconditional answer, yes. Most people love their mothers, even though the mothers did try to "shape" them in childhood with rewards and punishments. But "hate spinach" and "love ice cream" were inferred from the information in the question. The kid dislikes spinach, or the mother wouldn't need to reward him; but he does like ice cream, or the mother wouldn't use it as a reward. And I haven't heard of any cases where the mother succeeded in "shaping" the kid's food preferences like this. If I'm not allowed to use real-life common sense, it's not clear how I would even understand the question, let alone solve it. Okay, what additional information do you think one should need? Why?
9SilasBarta10yAre you serious? The problem is to specify which "common sense" reasoning leads you to which conclusion! Yes, now that you've explained one reason why one outcome holds (even though it doesn't account for children who grow up recenting their mothers and so isn't even right on its own terms), you've given the kind of information the question is asking for. Stating which outcome your common sense tells you would result -- which is what you did -- is non-responsive. And even now, you haven't told what conditions determine the 27 possible outcomes - just one reason why one outcome would result. Black-box "common sense" reasoning is exactly how you stray from rationality. You should open the box, and see what's inside.
3cousin_it10y8 possible outcomes, not 27. But I think I see your point. Let me ask some more questions in this vein: 1. A man jumps off a 100 foot tall bridge. What additional information do you need to determine if he'll die? 2. I have just washed my cup. What additional information do you need to determine if my cup is clean now? 3. What additional information do you need to determine whether the Sun will rise tomorrow? If all such questions are effective in making you open your eyes, question your assumptions and upvote away, well, then I guess we'll have to agree to disagree about the nature of "rationality".
9JoshuaZ10yWithin what degree of confidence? He could have a parachute of some form, or a bungee cord or there could be some form of trampoline to break the fall. Moreover, you miss the point of the original quote. The question relies on standard assumptions about how humans learn and absorb values. Since humans are very complicated entities, understanding explicitly what assumptions we make about them can be helpful.
5cousin_it10yThanks - point taken.
7SilasBarta10y27 if you allow for "no effect", which you should. It's true that you can construct similar questions in other domains. But the questions you posed are different from that in the quote because it refers to a: -more common situation with a -more common inference that is -more often poorly grounded and hinges on complex aspects of human sociality, which are -more relevant to our everyday lives because of the -more frequent occurrence of similar situations. See also Richard's further remarks [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/238q]. The rationality issue involved in the quote is one of how you come to a conclusion, and I think it's fair to say you might have missed some of the factors that come into play regarding manipulation of children, which Richard explains. There's a difference between a) "What does your gut tell you would happen?", and b) "What information should you use to justifiably reach a conclusion about what would happen?" You were answering a), while the question was asking b).

Silas, you're making strong arguments but mixing in emotion that makes it harder for your interlocutor to change their mind.

4SilasBarta10yUnderstood; I've edited the GP comment to be more diplomatic and improve the formatting. Let me know what you think. However, regarding the other comment, my question "Are you serious?" is an honest question. I don't see how cousin_it could misinterpret the question as "What is X?" when it's clearly asking "How do you know what X is?" So I don't see why his answer of "X is ..." got modded up.
2Morendil10yI think I'd eventually come to hate ice cream in that kid's situation. A treat is no longer a treat when it's systematically used to manipulate you into eating something you hate.
2NancyLebovitz10yI think it depends on how much you hate the spinach compared to how much you love the ice cream. People's memories of an experience are strongly affected by the last bit, so the love of the ice cream may do quite a bit to overwrite the memory of hating spinach. Almost certainly not enough to affect feelings about spinach, but probably enough to not interfere with love of mother.

I know that most men — not only those considered clever, but even those who are very clever and capable of understanding most difficult scientific, mathematical, or philosophic, problems — can seldom discern even the simplest and most obvious truth if it be such as obliges them to admit the falsity of conclusions they have formed, perhaps with much difficulty — conclusions of which they are proud, which they have taught to others, and on which they have built their lives.

— Leo Tolstoy, 1896 (excerpt from "What Is Art?")

3diegocaleiro10yNot only to recognize my mistakes, but to actually speak outloud about them frequently has given me great strengh in doing it in questions that really matter. If you have social status, it is worth sparing some change in getting used to not only being wrong, but being socially recognized as wrong by your peers...
3BenAlbahari10yEmperor Sigismund, when corrected on his Latin, famously replied:

There is no such thing as absolute certainty, but there is assurance sufficient for the purposes of human life.

John Stuart Mill, On Liberty

He seems to have understood that 0 and 1 are not probabilities.

2[anonymous]10yYou know, that post is somewhat annoyingly titled. 0 and 1 are probabilities by the common definition of "probability", but defining "probability" such that 0 and 1 are not probabilities results in a system which is also consistent and useful.

"It's wonderful how much we suck compared to us ten years from now!"

-- Michael Blume

2Matt_Duing10yA troubling possible implication of this is if the impact we can expect to have on existential risks diminishes over time, then as the competence of our plans and actions increases, the expected importance of those choices tends to decrease.

If at first you don't succeed, try, try, again. Then quit. There's no use in being a damn fool about it.

-- W. C. Fields

It's no wonder that truth is stranger than fiction. Fiction has to make sense.

Another Twain quote.

On a similar theme:

Fiction often mixes up logical with other concepts ... For one thing, authors sometimes say "illogical" when they mean "counter-intuitive." Correct logic is very often counter-intuitive, however, which is to be expected, as logic is meant to prevent errors caused by relying on intuition.

TV Tropes

I've asked this question before, but where the hell does the high-quality rationality on TV Tropes come from?

8Mass_Driver11yPeople who can see through the conventions of entertainment and who enjoy posting about those conventions for free are likely to be much more awake than usual.
5gwern10yHere's a variant on that. In fiction, everything is calculated to manipulate you or fulfill some simple recognizable pattern. Troping is training in figuring out how the manipulation works and what the patterns are; this is a skill that carries over into everything else. (Doesn't matter if it's an author trying to manipulate you - or a bad argument.)
7thomblake10yThis was a nice exercise in generating a host of just-so stories.
3JoshuaZ10yYes, but many of these are testable. Thus for example, Oscar's hypothesis that "Things are only tropes if they happen more often in fiction that in reality, so to detect them you need an accurate map" is testable. You could take a random sample of people who edit TVtropes and test their map accuracy in completely separate areas (say things that can be often estimated with a Fermi calculation) and compare that to a general sample of people. Oscar's hypothesis suggests that the Tropers will do better. RobinZ's point is difficult to test, but presumably if one examined in detail what pages have historically stuck around and which have been merged or deleted, one could get data that would test it.
1RobinZ10yI would also consider my thesis [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/23e3] undermined were it demonstrated that the rate of rationally-insightful contributions to TV Tropes was significantly higher than for other notable Wikis (e.g. Wikiversity [http://www.wikiversity.org/]).
1JoshuaZ10yHow would you measure the rate of rationally-insightful contributions? I'm also not sure which wikis would be useful to test this on. Some wikis (such as say the various Wikipedias) have prohibitions on original research. Other wikis have narrow goals that will mimimze the number of rational insights. Thus, I'd expect a very low insight rate on say Wikispecies since that is devoted to cataloging existing biological knowledge.
3RobinZ10yGood points. What I was attempting to measure was the relative measure* of rationalists on TV Tropes versus other nerd communities. The part of my thesis being tested is that no notable difference need be hypothesized to explain EY's perception of unusual rationality in the wiki. (Was I mistaken to believe that EY thought TV Tropes was unusually rational compared to other nerdy Internet communities, as opposed to compared to other Internet communities, full stop? I agree that TV Tropes is nerdier than most of the Internet.) * i.e. fraction of population weighted by intensity of participation.
3RobinZ10yI noticed that - I believe it is a classic case of (warning: TV Tropes) the Rhetorical Question Blunder [http://tvtropes.org/pmwiki/pmwiki.php/Main/RhetoricalQuestionBlunder]. (In my defense, I tried to make mine [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/23e3] testable [http://lesswrong.com/lw/i3/making_beliefs_pay_rent_in_anticipated_experiences/] .)
7Mardonius10yPerhaps it's due to the fact that TV Tropes' mission is essentially to perform inference on the entire body of human fiction, and create generalised models (tropes or trope complexes) from that data. In many ways, it's science applied to things that are made up!
6Oscar_Cunningham10yThings are only tropes if they happen more often in fiction that in reality, so to detect them you need an accurate map. ETA: And everyone is already in hole-picking mood. So any cognitive biases showing up will be jumped on. ETA2: What does ETA stand for anyway?
2SilasBarta10yETA = Edited to add (not "estimated time of arrival", the more common usage) I sometimes use ETC, edited to correct, but that hasn't caught on. ETA: And here's [http://wiki.lesswrong.com/wiki/Acronyms_used_on_Less_Wrong] the LessWrong acronym list -- we need to link it from the front page.
2Nanani10yWhere I live, ETC stands for Electronic Toll Collection and is posted at the entry ramp of toll-roads equipped appropriately. What's wrong with just using "Edit: additional note goes here"
1RobinZ10yThat's what I use, come to think of it.
0Blueberry10yNothing's wrong with that, but ETA is shorter and faster to type.
0[anonymous]10yNot necessarily; perhaps one is accustomed to typing words that start with at most one capital letter.
2NancyLebovitz10yCEV needs to be added. I'm not doing it myself because I'm not sure what would be a good description of it to link to.
4[anonymous]10yI think it's that the website is dedicated to identifying common structures that make stories entertaining, with an emphasis that they are fictional structures. It's the very use of the word "tropes" in the title. Thus the user base is a bunch of people who enjoy a lot of bad (and usually absurdly bad) t.v., yet also have fun analyzing what psychological manipulation they were supposed to have been subjected to. Also, I know a few TVTropes addicts who are regular LW readers (from a forum on which Dresden Codak left a large impact), and wouldn't be surprised if they have contributed.
0Desrtopa10yI am one such, but I'm not aware of any other Koala Wallopers who're regular editors of tvtropes.
4Nanani10yRational Tropers. QED.
1JoshuaZ10yWas that a deliberate attempt at a mysterious answer? If so, I am amused.
6Blueberry10yIt looked like a joke along the lines of: Q (on discovering a pile of eggs in a strange place): Where did these eggs come from? A: Chickens.
2Paul Crowley10yOr [http://www.angelfire.com/oh/quotations/movies/g/ghostbusters.html] "Where do these stairs go?" ... "They go up."
3David_Gerard10yThe quality on TVTropes comes from the same place as the quality on Wikipedia: obsessive nerds who want things to be right. Like Wikipedia, TVTropes has successfully set up a filter such that the good stuff tends to stick more than the bad. Of course, it has the same problem with people wanting to add garbage as Wikipedia, as Desrtopa points out [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/23d8?c=1&context=1#23d8] . But the overall slight bias to good seems sufficient to grow quite remarkably high quality.
3RobinZ11yThe way TV Tropes is set up, technologically and culturally, it seems relatively easy for a rational person to contribute an insight that persists - is there some systemic pattern that this effect cannot account for?
2Desrtopa10yI think that there may be something of a sampling bias going on here. The sort of structure analysis of storytelling we do attracts some particularly intelligent and rational people, but also quite a lot who are, charitably speaking, not. It's a constant struggle to keep the prominent pages full of the stuff that's actually worth reading, and to shove the rest under a sofa when we can't get rid of it entirely.
7simplicio11yThat article [http://tvtropes.org/pmwiki/pmwiki.php/Main/StrawVulcan] is full of goodies.
6komponisto11yThe last part deserves extra emphasis: See also here [http://lesswrong.com/lw/29o/open_thread_may_2010_part_2/21fn].
5XiXiDu10y-- Mr. Spock is Not Logical [http://scienceblogs.com/goodmath/2009/03/mr_spock_is_not_logical_book_d.php]

Were it possible to trace the succession of ideas in the mind of Sir Isaac Newton, during the time that he made his greatest discoveries, I make no doubt but our amazement at the extent of his genius would a little subside. But if, when a man publishes his discoveries, he either through a design, or through habit, omit the intermediary steps by which he himself arrived at them, it is no wonder that his speculations confound them, and that the generality of mankind stand amazed at his reach of thought. If a man ascend to the top of a building by the help of a common ladder, but cut away most of the steps after he has done with them, leaving only every ninth of tenth step, the view of the ladder, in the condition which he has pleased to exhibit it, gives us a prodigious, but unjust view of the man who could have made use of it. But if he had intended that any body should follow him, he should have left the ladder as he constructed it, or perhaps as he found it, for it might have been a mere accident that threw it in his way... I think that the interests of science have suffered by the excessive admiration and wonder with which several first rate philosophers are considered, and that

... (read more)
6bentarm11yEuler is one of the few mathematicians who provide an exception to this rule. To quote Polya (Mathematics and Plausible Reasoning): (the quoted passed in the text is apparently from Condorcet, although I don't know the initial source) Polya is, of course, one of the few other mathematicians who break this mould. Explicitly writing books about the process of discovery.
3roland11yYou quoted: But I just read the original and it is written: Now it makes more sense to me, the 'a' makes all the difference.
1JoshuaZ11yMistranscription by me. Fixed now. Thanks.
1roland11yThe book is available for free on google books, can you tell us the page nr. of the quotation please?
2JoshuaZ11y575 and 576 in the edition on Google Books.
1roland11yIt's a coincidence that I was thinking along these lines recently. Most science is just the result of tiny footsteps put one after the other, but when you see the final result it is impressive. Most teaching books are in fault because they only portray the end result whereas the painstaking but simple steps that lead there often in a natural way are omitted.
2JoshuaZ11yIt is an issue that has been discussed here before. Eliezer generally uses Einstein as the example rather than Newton. See for example Einstein's Superpowers [http://lesswrong.com/lw/qs/einsteins_superpowers/] and My Childhood Role Model [http://lesswrong.com/lw/ql/my_childhood_role_model/].

Conscious thought leads people to put disproportionate weight on attributes that are accessible, plausible and easy to verbalize, and therefore too little weight on other attributes. -- Ap Dijksterhuis

2Unnamed11ySimilarly, -- John Stuart Mill [http://www.laits.utexas.edu/poltheory/jsmill/diss-disc/bentham/bentham.s04.html] Unfortunately Mill gets wordy in the middle, instead of just saying "... various secondary ends. Attempting to focus directly on happiness generally terminates in..."

I imagine that if my friend finally came to the conclusion that he were a machine, he would be infinitely crestfallen. I think he would think: "My God! How Horrible! I am only a machine!" But if I should find out I were a machine, my attitude would be totally different. I would say: "How amazing! I never before realized that machines could be so marvelous!"

(Raymond Smullyan)

I have found it in an OB comment by Zubon, but it was never posted as a rationality quote.

3Zubon10yRaymond Smullyan is a gold mine for different cached thoughts. Maybe I should start finding quotes on random pages for these threads.

To a very great extent, the term science is reserved for fields that do progress in obvious ways. But does a field make progress because it is a science, or is it a science because it makes progress?

-Thomas Kuhn, The Structure of Scientific Revolutions

Prevent all problems and get nothing done, or accept an allowable level of small problems and focus on the big things. --Timothy Ferriss

"Sanity is conforming your thoughts to reality. Conforming reality to your thoughts is creativity."

-- Unknown

6imaxwell10yI would prefer to say that conforming your thoughts to reality is science, and conforming reality to your thoughts is engineering...
3RichardKennaway10yPutting those together, science is sanity and engineering is creativity. Or to merge this with an aphorism of George Bernard Shaw, science sees things and asks "why?", and engineering dreams things that never were and asks "why not!" -- G.B.S.
2wedrifid10yMeanwhile I would want to employ a creative scientist but a sane engineer. Perhaps it is a matter of balance...
1RobinZ10yHave you noticed how many G.B.S. quotes are in the top quotes list [http://lesswrong.com/lw/2bi/open_thread_june_2010_part_2/24dp]?

Despite the fact that you arrived in this world with nothing but an unborn Buddha-mind, your partiality for yourselves now makes you want to have things move in your own way. You lose your temper, become contentious, and then you think, "I haven't lost my temper. That fellow won't listen to me. By being so unreasonable he has made me lose it." And so you fix belligerently on his words and end up transforming the valuable Buddha-mind into a fighting spirit. By stewing over this unimportant matter, making the thoughts churn over and over in your mind, you may finally get your way, but then you fail in your ignorance to realize that it was meaningless for you to concern yourself over such a matter.

From The Dharma Talks of Zen Master Bankei, translated by Norman Waddell. Quoted by Torkel Franzén as a perfect description of Usenet flamewars.

all arguments online seem to follow that format. It's like a giant straw man ate a radioactive non sequitor and began rampaging through downtown Tokyo.

-- jman3030

5Roko10yCan someone get Yvain to photoshop up a "Fallacyzilla!"

What I cannot build, I do not understand.

    — Richard Feynman

Not strictly a rationality quote, but screw it, it's beautiful anyway:

I take it as a given that, during the course of my lifespan, there's always been television (not color to start with, but there was TV), that indoor plumbing and lights have always been around, flight is not only possible but commonplace and pretty much always has been, and the moon landing happened before I was born.

A part of me regrets missing the introduction of all of those exciting technologies and innovations, because to me they are all background things that just are. They aren'

... (read more)
1Jonii10yI disagree with this. Although it's difficult to guess how people thought back then when they didn't have all these marvels of today, it's still really easy to appreciate the things themselves. Things related to cultural evolution, like basic human rights, art, modern goverments, those are a bit more difficult to see, but still, with little thought, it's easy to see much of the sheer awesomeness they have. It's also easy to see how things could easily be so much worse, and usually it's easy to check from history that yeah, things have been very much worse. Though much of this quote is about how awesome things are in our world, and I totally agree with that.
2Kaj_Sotala10yI guess that might depend on the person. For me, even though I can appreciate things like television and electricity on an intellectual level, I can't really appreciate them on an emotional level the way I can appreciate things like ubiquitous mobile phones or Wikipedia that weren't there when I was a kid.

Reason is the press secretary of the emotions, the ex post facto spin doctor of beliefs we've arrived at through a largely intuitive process.

0Randaly10yThe source is Jonathan Haidt, right?
3RichardKennaway10yWhoever it was, it was clearly someone who has never proved a theorem. Ok, in context [http://www.believermag.com/issues/200508/?read=interview_haidt] he's talking about moral beliefs, but still.
1wedrifid10yWe could say (with some degree of insight) that proving a theorem is something that the "press secretary" sometimes does as a hobby in its off hours.

"You rationalize, Keeton. You defend. You reject unpalatable truths, and if you can't reject them outright you trivialize them. Incremental evidence is never enough for you. You hear rumors of Holocaust; you dismiss them. You see evidence of genocide; you insist it can't be so bad. Temperatures rise, glaciers melt—species die—and you blame sunspots and volcanoes. Everyone is like this, but you most of all. You and your Chinese Room. You turn incomprehension into mathematics, you reject the truth without even knowing what it is."

--Jukka Sarasti, rationalist vampire in Peter Watts's Blindsight. Great book on neuroscience and map != territory.

1pjeby10yUm, wasn't he more of a p-zombie who just happened to be rational? (In that novel, vampires are a near-human species who lack consciousness -- so all the vampires are a bit like p-zombies, except they don't claim to be conscious.)
6gwern10yI'm not entirely sure what your criticism is. I'll take it as meaning 'isn't it just an arbitrary accident that the vampires happen to be more rational than humans, and not an intrinsic part of those characters?' No. It isn't. If you remember, one of the running suggestions in Blindsight is that consciousness is a useless spandrel that sucks up tons of brainpower, and which can/will be discarded with much benefit. The vampires may be rationally superior to humans because they are p-zombies, and they evolved that way in order to effectively predict human actions and hunt them. The arbitrary accident was the cross glitch - otherwise the vampires would have won rather than died out. If the vampires could as well have been less-rational-than-humans p-zombies, that would undo that major theme.
2pjeby10yI actually meant that "rationalist" is a label that doesn't make sense when applied to an entity that's already rational, but I'll admit my phrasing was confusing... probably because my attention was mainly focused on trying to make a joke about p-zombie vampires. ;-)
0SilasBarta10yEr, what? How exactly do you tell the difference between a p-zombie and a being with conscious thought? I thought the whole freaking point is that there is no way, so the story can't hinge on it, right?
1Blueberry10yNo, the whole point is if you have two entities, one of whom is a zombie and one of whom is conscious, there must be some physical difference in their brains. ('p-zombie' normally is used in the context of the (impossible) thought experiment where there is no physical difference in the two brains, but only one is conscious.) In Blindsight, the vampires' brains have a very different architecture than ours, and IIRC they explicitly state they do not have consciousness.
2SilasBarta10yPlease don't misunderstand -- I agree with all of that! I meant that the whole point of using the term "p-zombie" is to specify a being with the (hypothetical) properties that it looks just like a human (or being that is normally accepted as conscious), in all physically discernable ways, but (somehow) lacks consciousness. So I was confused as to how it could affect the storyline for some being to be specified as a p-zombie, since you wouldn't know the difference. I agree that such a being can't exist, for the standard reasons. If the vampires actually have different brain architectures, then they shouldn't be called p-zombies, because they don't have the form of something normally conscious, like a human. It would make as much sense as saying that a rock is a p-zombie.
1Blueberry10yYou're right that the term is being used incorrectly (or at least very loosely). However, I think it makes slightly more sense than calling a rock a p-zombie, since the vampires in Blindsight do behave like humans and have normal conversations like humans: that is, they would pass the Turing test. Entities like this are sometimes called "behavioral zombies" (as opposed to "physical zombies"), and it's not clear whether they are possible, though Eliezer seems to think so.
0JoshuaZ10yqwern is using p-zombie slightly incorrectly. In this case, these are entities that act more or less like humans but functionally state their own lack of conscious awareness.
0gwern10yYes; in my defense, pjeby started it!
0SilasBarta10yI lack conscious awareness. There, do you regard me as a p-zombie now?
1khafra10y"More or less" requires unpacking approximately equal in length to the novel, but the non-sentience of the vampires is weakly implied, (spoiler) juvyr gur aba-fragvrapr bs gur nyvraf gurl zrrg vf rkcyvpvg naq abg ng nyy zrgnculfvpny.
1gwern10yI thought it was more implied by the ending, myself. (Does Blindsight really need spoilers ROT13ing? I mean, the book is right there [http://www.rifters.com/real/Blindsight.htm] for anyone to read.)
7RobinZ10yThe fact of information being available does not make it known. Billions of people have never read The Woman in White by Wilkie Collins, despite it being freely available [http://www.gutenberg.org/etext/583] in most places around the world, for example. The use of spoilers is not to protect the copyright of the writers, but to protect the surprise of the readers when they discover what has been written.
1wedrifid10yNearly everything else that people do not want spoilers for is right there [http://isohunt.com] for anyone to consume. I do not think that is the point...
1magfrump10yRobinZ seconded... I may go read both these stories due to this thread and I'd prefer not to see spoilers.
0RobinZ10yBy the way: if you like The Woman in White, try also The Moonstone. Those two are Wilkie Collins' famous stories.

clippy.paperclips: how many humans, as a fraction of total humans, have a belief about whether or not they are a human, and believe they are not a human?

me: this is a subculture of humans that believes they are really animals: http://en.wikipedia.org/wiki/Furry_fandom

clippy.paperclips: so those are the normal ones? and it's like a war against the irrational majority?

me: bad example.

Do not go gentle into that good night,
Old age should burn and rage at close of day;
Rage, rage against the dying of the light.

Though wise men at their end know dark is right,
Because their words had forked no lightning they
Do not go gentle into that good night.

Good men, the last wave by, crying how bright
Their frail deeds might have danced in a green bay,
Rage, rage against the dying of the light.

Wild men who caught and sang the sun in flight,
And learn, too late, they grieved it on its way,
Do not go gentle into that good night.

Grave men, near death,

... (read more)
6Death10yTHE SCANSION IS QUITE PLEASING.

The most erroneous stories are those we think we know best - and therefore never scrutinize or question.

-- Stephen Jay Gould

The value of a sword cannot be judged when the sword stands alone in a corner; only when it is wielded by an expert can one see its true worth.

-- old Chinese saying

You wouldn't believe how much time people spend looking for evidence that something couldn't possibly work for them. If they spent one-tenth the time looking for something that DID work, they'd have their problem solved almost immediately.

-- Eric Pepke

Everyone who takes basic statistics has it drilled into them that "correlation is not causation." (When I took psych. 1, the professor said he hoped that, if he were to come to us on our death-beds and prompt us with "Correlation is," we would all respond "not causation.") This is a problem, because one can infer correlation from data, and would like to be able to make inferences about causation. There are typically two ways out of this. One is to perform an experiment, preferably a randomized double-blind experiment, to elim

... (read more)
1TheOtherDave9yObligatory xkcd reference [http://xkcd.com/552/] That said... treating correlations as evidence of causation isn't unreasonable, as long as I remember that the world is full of evidence of falsehoods as well as truths, and calibrate accordingly.
0TraderJoe9y[comment deleted]
0[anonymous]10yFar too true. :)
0wedrifid10yFar too true. :)

Using language that is appropriate in one linguistic framework in a different linguistic framework is what causes philosophical confusion and pseudo puzzles, also known as the history of philosophy.

-- Thomas Cathcart & Daniel Klein, Plato and a Platypus Walk into a Bar... : Understanding Philosophy Through Jokes

7Nic_Smith11yLooked it up in Google Books and found this gem as a chapter lead-in: "Without logic, reason is useless. With it, you can win arguments and alienate multitudes." I'll have to get a copy sometime.
1Cyan11yIt's very Philosophy 101; you can get more in-depth info online. But it does provide an entry into a variety of topics, and some of the jokes are real zingers.

Many receive advice; few profit by it.

-- Publius Syrus

Nothing exists except atoms and empty space; everything else is opinion.

-- Democritus

1simplicio11yThe quote is good but I can't help but be bothered by the source, and wonder if rationality is really on display here. Democritus may have had an atomic theory, but his reasons for having it were no better than those for the "earth, wind, fire and water" theory; i.e., wild conjecture.

That's not true. He had perfectly good reasons for atomism in his context.

The ontological arguments of Parmenides (and as exposited by Melissus) lead to extremely unpalatable, if not outright contradictory, conclusions, such as there being no time or change or different entities. The arguments seem valid, and most of their premises are reasonable, but one of his most important and questionable premises is that void cannot exist.

Reject that premise and you are left with matter and void. How are matter and void distributed? Well, either matter can be indefinitely chopped up (continuous) or it must halt and be discrete at some point. The Pluralists like Anaxagoras take the former approach, but continuousness leads to its own issues with regard to change.* So to avoid issues with infinity, you must have discrete matter with size/divison limits - _atom_s.

So, Democritus and Leucippus are led to Atomism as the one safe path through a thicket of paradoxes and problems. Describing it as wild conjecture is deeply unfair, and, I hope, ignorant.

* One argument, if I remember it from Sextus Empiricus's Against the Physicists correctly, is that if matter really is infinitely divisible, then you ... (read more)

You make a good case. I repudiate my previous statement.

5Simony10yAlso, Democritus observed Brownian motion, and realised from that the atomic nature of gas. Smart guy.
0Sniffnoy10yEven if that argument is valid, it doesn't seem to rule out matter being "infinitely divisible" in the sense that it could be divided arbitrarily many times - which is what a rejection of atomism really means - just the stronger sense of being able to divide something infinitely. As an argument against atomism it seems to rely on an equivocation between these two, unless that case is somehow ruled out.
1gwern10yI don't really follow. How is arbitrarily divisible not the same as infinitely divisible? If there is some limit to the arbitrariness then it's just atomism discussed. If there is no limit, then it seems like infinity to me. (Most of the arguments against continuity use this sort of induction; continuity causes problems at this level, and it logically causes problems on n+1 levels; therefore it causes problems on all levels.)
2Sniffnoy10yIf atomism is false, then for any matter and any n, the matter can be divided into n parts (whatever that may mean); this is a finite division, so if we started with a nonzero amount of "stuff" (whatever that may mean), the parts we divided it into should also comprise nonzero amounts of "stuff" that total to the original amount of "stuff". No problem there. The apparent problem (which I would say isn't one really, but that's not the point, because there's no way the Greeks could have been expected to come up with why not) appears if you allow it to be divided into infinitely many parts, and then argue, since there was only finitely much "stuff" originally, and we've divided it into infinitely many parts, each part must have zero "stuff", but any sum of zeroes is zero. Weak induction will reach all natural numbers, but it won't reach infinity.
0pengvado10yWould a conserved Lebesgue measure have been acceptable? I don't see why infinitely dividing matter has to reduce the amount of anything.
0gwern10yNot unless you enjoy anachronisms. The Greeks probably wouldn't have liked that either; the basic point stands: if at any point one can divide it to produce a void and 2 smaller masses, then where is the 'real' mass? Any point you pick, I can turn into void. If I can do it for any point, I can do it for every point, and if every point is void...
2pengvado10yUnless you postulate a knife with really weird properties, cutting a continuous object in half isn't turning matter into void. It's moving some of the matter without changing its density (hence my offer of conservation of volume). You can do that to every point currently occupied by an object, but only by reserving an equal amount of space that's currently void and displacing all of the matter to there.
0gwern10yIt's more of a conceptual knife - pointing out that by the definition of continuity, segment X is made of void and 2 smaller segments, Y and Z; but Y and Z are themselves made of void (and 2 smaller segments), and so on. (Any conceptual knife just illustrates how motion was supposed to be possible in a continuous framework: the matter in the knife fits into the voids of what it is moving into.)
1Sniffnoy10yOh, so the "made of void" thing comes from the void that the knife fits into. That wasn't at all clear - it seemed like we were just talking about separating things into parts, not about the physical process of cutting.

Rational belief is constrained not only by the chains of deduction but also by the rubber bands of probabilistic inference. --Nick Bostrom, Anthropic Bias

"We live on an island surrounded by a sea of ignorance. As our island of knowledge grows, so does the shore of our ignorance" - John Archibald Wheeler

1Morendil10yThat is precisely the quote I was vaguely alluding to here [http://lesswrong.com/lw/23h/the_many_faces_of_status/1vzb] - thanks ever so much for pinning it down.
5NancyLebovitz10yA more cheering version: "The larger the island of knowledge, the longer the shoreline of wonder." Ralph W. Sockman

Do not ask whether a statement is true until you know what it means.

Errett Bishop

1wedrifid10yBad advice. I do not want to understand all untrue statements. Not only is there an opportunity cost associated with thinking or learning, understanding false statements can bias your brain in undesirable directions. There are times (say, you know an expert you trust on the subject) when you can establish with acceptable confidence that a statement is not true. In such cases it is often better to not bother giving the false statement another thought.

"This achievement is often praised as a sign of the great superiority of modern civilization over the many faded and lost civilizations of the ancients. While our great skill lies in finding patterns of repetition under the apparent play of accident and chance, less successful civilizations dealt by appealing to supernatural powers for protection. But the voices of the gods proved ignorant and false; they have been silenced by the truth."

--James P. Carse, _Finite and Infinite Games_

I can't understand it. I can't even understand the people who can understand it.

-- Queen Juliana

A household is a business given over to caring for small, temporarily insane people.

-- Clark Glymour, What Went Wrong: Reflections on Science by Observation

Longer version:

A household is a business given over to caring for small, temporarily insane people, a business subject to cash-flow problems, endless legal harassments, run by people who expect to have sex with each other, who occupy the same space, and who go nuts when either party has sex with anyone else. Once in marriage, a lot of people try to get out as fast as religious tradition, poverty, o

... (read more)

When it comes to proving such obvious things, one will invariably fail to convince.

Montesquieu, "The Spirit of the Laws", book XXV, chapter XIII. (Link to the book, Original French)

"He who cannot draw on three thousand years is living from hand to mouth." -- Goethe

There is no mutually exclusive distinction between "is" and "ought". There is only a distinction between "is" and "is not". If "ought" cannot find a home in what "is", then "ought" is something that "is not".

-- Alonzo Fyfe

3savageorange10yI find this rather gnomic. Is he admonishing us to only say 'ought' in reference to existing parts of reality? Or simply classifying ought as a nonsensical notion?
1CronoDAS10ySome more context, from the link:
3Jack10yThis seems... confused. The is-ought distinction is the distinction between preference and fact.
2CronoDAS10y"Preferences" are also facts about minds.
3Vladimir_Nesov10yNot directly, there is no fixed "preference mapping" from minds to preferences that works in general. We can only hope for one that works for humans, constructed for searching preference of humans, because it won't need to work for any almost-humans or not-humans-at-all. I look at a mind and see that its preference is X, you look at the same mind and say it's Y. There is no factual disagreement, the sense of "preference" was different; and if it was the same, the purpose was lost.
0Simulation_Brain10yWell, yes; it's not straightforward to go from brains to preferences. But for any particular definition of preference, a given brain's "preference" is just a fact about that brain. If this is true, it's important to understanding morality/ethics/volition.
2orthonormal10yHello! You seem to know your way around already, but it doesn't hurt to introduce yourself on the Welcome page [http://lesswrong.com/lw/b9/welcome_to_less_wrong/]...
2wedrifid10yWow. If he keeps playing around with words like that it should only take him two more paragraphs to 'prove' the existence of God.
0simplicio10yReally? I interpret him to be saying something fairly non-dualistic - namely, that morality is not an ontologically basic thing separate from physics. He also may be saying that moral claims reduce to fact claims in some sense, which is almost true (you need to throw some values in as well). Are you coming at this from the perspective of a moral nihilist?
2wedrifid10yI did not like the particular way he was trying to make morality relate to physics. I thought it asserted a confused relationship between 'is' and 'ought'. I think that was a point that he was at least trying to make and it is something I agree with. No. That's for people who realise that God doesn't tell them what morality is and get all emo about it. I more take a 'subjectively objective' position (probably similar to what you expressed in the previous paragraph).
2Blueberry10ySuccinctly stated. I love it.
0[anonymous]10yI did not like the particular way he was trying to make morality relate to physics. I thought it asserted a confused relationship between 'is' and 'ought'. I think that was a point that he was at least trying to make and it is something I agree with. No. That's for people who realise that God doesn't tell them what morality is and get all emo about it. I more take a 'subjectively objective' position (probably similar to what you expressed in the previous paragraph).

The method-oriented man is shackled: the problem-oriented man is at least reaching freely toward what is most important. --John R. Platt

"The Master said, Yu, shall I tell you what knowledge is? When you know a thing, to know that you know it, and when you do not know a thing, to recognize that you do not know it. That is knowledge."

Analects of Confucius (Wayley's translation.)

(This quotation is an epigram to chapter 1 of Harold Jeffreys' Scientific Inference, 1957, Cambridge University Press.)

“Anyone who understands systems will know immediately that optimizing parts is not a good route to system excellence,”

Gawande on information overload in medicine

"Every conviction is a prison" ---- Nietzsche

"All generalizations are false, including this one."

-Mark Twain

When you have eliminated the impossible, whatever remains, however improbable, must be the truth.

Arthur Conan Doyle

I'm embarassed to bring this up again, because I seem to quote steven0461 too often--but, in something close to his words; "When you have eliminated the impossible, whatever remains is likely more improbable than an error in one of your impossibility proofs."

...Or you've just missed something. If all you're left with is improbable you notice that you are confused. I've always thought that quote was off.

Then again, Sherlock never did miss anything.

3Oscar_Cunningham10yI also just noticed a Sherlock quote with exactly this meaning: Sherlock's a more rounded rationalist than he's given credit for.
2gwern10yTo the contrary, he was roundly defeated [http://en.wikipedia.org/wiki/A_Scandal_in_Bohemia#Plot_summary] on at least one occasion.
0Thomas11yI am sorry gentlemen, but this quote of Holmes is the very essence of rationalism as I see it.
9orangecat11yDouglas Adams
4[anonymous]11yThere is no evidence that is so strong that it will justify a statement no matter how improbable you initially considered it. Thus, as Oscar points out, this quote is off.
4SilasBarta11yIn Bayes/Pearl terminology, knowledge of an effect destroys the causes' independence (d-connects them), and ruling out a cause shifts probability onto the remaining causes.
1PhilGoetz10yHow does a Bayesian rule out a cause?
1D_Alex10yAs a rationality quote, "... must contain the truth" would have been better.

In order to ask a question you must already know most of the answer. —Answerer, in Ask a Foolish Question in the anthology Citizen in Space by Robert Sheckley

Found here

Sufferers must be sustained by a hope so strong that no conflict with reality can smash it - so strong, indeed, that no fulfilment could ever satisfy it...

-Nietzche

4[anonymous]10ydel

The universe will expand, then it will collapse back on itself, then will expand again. It will repeat this process forever. What you don't you know is that when the universe expands again, everything will be as it is now. Whatever mistakes you make this time around, you will live through on your next pass. Every mistake you make, you will live through again, & again, forever. So my advice to you is to get it right this time around. Because this time is all you have.

-KPAX

(I do not present this as an endorsement of the Big Bounce hypothesis.)

5novalis11yHow could you distinguish a repeating process consisting of the entire universe, from that process happening only once?
3PeterS11yIf it were truly repeating, you couldn't. Unless you were a KPAXian and the screenwriters wrote it to be so.
1orthonormal11yThe idea of the eternal recurrence [http://en.wikipedia.org/wiki/Eternal_return] didn't originate with that movie.
1PeterS11yI know. What's your point? I was presenting the quote along the lines of UDT, and this [http://lesswrong.com/lw/1t0/shock_level_5/].
2orthonormal10yFair enough. It just bugs me on a status level to have an idea that was well-stated by famous philosophers quoted from K-PAX instead. I realize I'm being irrational here.
1cupholder11yGerry Rafferty offers an alternative perspective. [http://www.youtube.com/watch?v=OXBJu5vD0RY]

Sometimes exhausted from toil and endeavour

I wish I could sleep for ever and ever

But then this assertion my thinking allays

I shall be doing that one of these days.

-- Piet Hein

8Mardonius11y-Jonathan Frakes, as William T Riker
3RichardKennaway11yA fine intention. But until we make the technology, we are still, after all, only mortal. "Had we but world enough and time But we don't So let's get on with it." -- Andrew Marvell, "To His Coy Mistress" (abridged)
4Eliezer Yudkowsky11yYour original quote asserts a definite fate, not a fate which would occur if some particular technology were to remain uninvented. -- H. P. Lovecraft
3RichardKennaway11yPiet Hein is definitely dead.
2gwern10y--author William Saroyan, letter written to his survivors
1cousin_it11yHoly shit, this the first time ever that I realized the relationship between this Lovecraft quote and classic OB/LW topics. Scary.
1dclayh10yYou mean you missed it back in February [http://lesswrong.com/lw/1pq/rationality_quotes_february_2010/1js5]? :)
6simplicio11yI love Piet Hein :) or

"All we have to decide is what to do with the time that is given to us." -- Gandalf, The Lord of the Rings: The Fellowship of the Ring

(This is not necessarily a rationalist quote, but yet, it kinda is :))

The unconscious naturally weights the relative importance of various attributes. Conscious thought often leads to suboptimal weighting because it disturbs this natural process. --Ap Dijksterhuis

2JoshuaZ11yI'm not sure this is a very rationalist quote. In particular, many judgments people make and many biases come into play at a non-conscious level. We generally need to make a conscious effort to correct for those biases.
4roland11yYes and no. You are right about a lot of biases originating from the unconscious. But the other way is also possible, the smart human who does something stupid because he has a good theory of how it should be done. Or choosing a picture because of some salient verbalizable reason instead of just taking the one you like the most without necessarily being able to explain why, etc... There is more on this topic in "The rational unconscious: Conscious versus unconscious thought in complex consumer choice" by Ap Dijksterhuis and in Jonah Lehrer "How we decide".

In addition, conscious thought can lead us to rely on weird little theories. --Ap Dijksterhuis

Man's mind is a mirror of a universe that mirrors man's mind.

-- Joseph Chilton Pearce

1simplicio10yIs this true? It seems to me man's mind is a mirror of a universe (in the sense of modelling it), full stop.
[-][anonymous]10y -1

Simply responding with a Randian quote doesn't show that government doesn't work.

-- JoshuaZ

3RobinZ10y-- Rationality quotes: June 2010 [http://lesswrong.com/lw/2ay/rationality_quotes_june_2010/].