I partially agree. But I'll push back a little. The 23% wrong answers are not random key mashing. 80% of them type the number "10". Instead of copying the single digit that they are instructed to copy, they are looking further from the answer blank, finding two three-digit numbers, subtracting one from the other, and typing the two-digit difference. That is more work than the correct answer, not less.
But still, I do agree that if people had accuracy incentives, the correct answer rate would probably go up.... Then again, maybe, with monetary incentives, people would be even more likely to think the provided answer was a trap. If I had to bet, I'd say that incentives would increase the 77% "5" rate. But I wouldn't be totally shocked if it went down.
'A bat and a ball cost $110 in total.
The bat costs $100 more than the ball.
How much does the ball cost?
The answer is $5.
Please enter the number 5 in the blank below.
$_____'
That question is from one of 59 new studies (N = 72,310) which focus primarily on the “bat and ball problem," found in The formation and revision of intuitions - ScienceDirect by Andrew Meyer and Shane Frederic.
23% of respondents failed to give the correct answer.
I don't have anything insightful to say but wanted to share because it seems worth knowing.
Additionally, I'm not exactly sure how (and how much) I should update about this.
(Edit: I initially posted the wrong question)