435

LESSWRONG
LW

434
Honesty
Frontpage

62

Individual Deniability, Statistical Honesty

by Alicorn
9th Aug 2011
1 min read
8

62

Honesty
Frontpage

62

Individual Deniability, Statistical Honesty
16Tesseract
7Tesseract
7MatthewBaker
4[anonymous]
5MatthewBaker
1realitygrill
0TraderJoe
-2MugaSofer
New Comment
8 comments, sorted by
top scoring
Click to highlight new comments since: Today at 5:58 PM
[-]Tesseract14y160

The keywords here are "randomized response". There are some interesting variations (from the Wikipedia page):

The sensitive question is worded in two dichotomous alternatives, and chance decides, unknown to the interviewer, which one is to be answered honestly.

Alternative 1: "I have consumed marijuana." Alternative 2: "I have never consumed marijuana." The interviewed are asked to secretly throw a die and answer the first question only if they throw a 6, otherwise the second question.

Reply
[-]Tesseract14y70

Also, it occurs to me that this is essentially an application of Bayes' Theorem. In an ordinary survey, the posterior probability (killed leopard|says yes) is 1, which is bad for the farmers, so they lie and therefore decrease the conditional probability (says yes|killed leopard), which is bad for the surveyors. Adding the die roll increases the unconditional probability of saying yes, so that the posterior probability no longer equals the conditional, and they can both get what they want.

Reply
[-]MatthewBaker14y70

I cant believe its that simple but in retrospect its obvious.

Reply
[-][anonymous]14y40

http://en.wikipedia.org/wiki/Hindsight_bias

Reply
[-]MatthewBaker14y50

Agreed :) though i think its more the specific method that's so ingenious. Every anonymous survey ive ever taken has always told me at least 3 times it was anonymous but plausible dependability works so much better in hindsight.

Reply
[-]realitygrill13y10

I reinvented this method, except using a coin flip, during an urban economics class. We were going to actually conduct surveys in the Detroit area and thus had to learn about the problems with surveys. However my professor didn't seem very excited and pointed out some incentive shortcomings (I was too disappointed to listen too closely), and I got the impression that this is a known method with known limitations.

Reply
[-]TraderJoe14y00

[comment deleted]

[This comment is no longer endorsed by its author]Reply
[-]MugaSofer13y-20

Suddenly, the number of "yes" responses to the leopard question started coming up by more than just one-sixth.

I fear any actual "leopard question" will not be as good as the ones that I imagined on reading that sentence.

Especially as the survey was about poaching in African countries :(

Reply
Moderation Log
More from Alicorn
View more
Curated and popular this week
8Comments

If you have a lot of people to question about something, and they have a motivation to lie, consider this clever use of a six-sided die.

If the farmer tossed the die and got a one, they had to respond "yes" to the surveyor's question. If they got a six, they had to say "no." The rest of the time, they were asked to answer honestly. The die was hidden from the person who was conducting the survey, so they never knew what number the farmer was responding to.

Suddenly, the number of "yes" responses to the leopard question started coming up by more than just one-sixth.