3466

LESSWRONG
LW

3465
Frontpage

8

Most empirical questions are unresolveable; The good, the bad, and the appropriately under-powered

by Davidmanheim
23rd Jan 2017
1 min read
4

8

This is a linkpost for https://medium.com/@davidmanheim/the-good-the-bad-and-the-appropriately-under-powered-82c335652930
Frontpage

8

Most empirical questions are unresolveable; The good, the bad, and the appropriately under-powered
1sarahconstantin
-1BiasedBayes
0Davidmanheim
1BiasedBayes
New Comment
4 comments, sorted by
top scoring
Click to highlight new comments since: Today at 3:16 PM
[-]sarahconstantin9y10

Yep! this is important. You can't make everything evidence-based. Some empirical questions have to be decided by heuristic, by theory, by analogy, or sometimes "shrug, flip a coin."

An important corollary is that "this isn't evidence-based" isn't always a damning insult. It's good to know what is and isn't evidence-based, but sometimes you have to make decisions without good empirical evidence.

Reply
[-]BiasedBayes9y-10

Thanks for the link, the title is a bit misleading though ("most empirical questions..").

Reply
[-]Davidmanheim9y00

Really? I'd expect that very few questions outside of the hard sciences are resolvable given model uncertainty, the limits on running RCTs, and the limited samples available given finite population and insufficient variation regarding variables of interest.

Do you disagree?

Reply
[-]BiasedBayes9y10

Then why not to state exactly that position in the article ? To answer to your question i dont if you mean every possible crazy hypothesis being in the space of possible hypothesis but disagree if you mean in terms of pragmatic usefull hypothesis being well resolved. There is not a single doubleblinded RCT on smoking causing cancer as far as I know, but its pretty resolved that smoking causes cancer, agreed?

Reply
Moderation Log
More from Davidmanheim
View more
Curated and popular this week
4Comments