I don't give much weight to his diagnosis of problematic group decision mechanisms

I have quite a lot of time for it personally.

The world is dominated by a lot of large organizations that have a lot of dysfunction. Anybody over the age of 40 will just agree with me on this. I think it's pretty hard to find anybody who would disagree about that who's been around the world. Our world is full of big organizations that just make a lot of bad decisions because they find it hard to aggregate information from all the different people.

This is roughly Hanson's reasoning, and you can spell out the details a bit more. (Poor communication between high level decision makers and shop-floor workers, incentives at all levels dissuading truth telling etc). Fundamentally though I find it hard to make a case this isn't true in /any/ large organization. Maybe the big tech companies can make a case for this, but I doubt it. Office politics and self-interest are powerful forces.

For employment decisions, it's not clear that there is usable (legally and socially tolerated) information which a market can provide

I roughly agree - this is the point I was trying to make. All the information is already there in interview evaluations. I don't think Robin is expecting new information though - he's expecting to combine the information more effectively. I just don't expect that to make much difference in this case.

So the first question is: "how much should we expect the sample mean to move?". 

If the current state is ${\mu }_n$, and we see a sample of $x$ (where $x$ is going to be 0 or 1 based on whether or not we have heads or tails), then the expected change is:

$E\left(\right({\mu }_n-{\mu }_{n+1}{)}^2)=\frac{1}{(n+1{)}^2}E({\mu }_n-x)=\frac{1}{(n+1{)}^2}({\mu }_n^2-2{\mu }_{n}E(x)+E(x^2\left)\right)$

$\cdots =\frac{1}{(n+1{)}^2}({\mu }_n^2-2{\mu }_n{\mu }_n+{\mu }_n^2+{\sigma }_x^2)=\frac{{\sigma }_x^2}{(n+1{)}^2}\sim O\left(\frac{1}{n^2}\right)$

In these steps we are using the facts that ($x$ is independent of the previous samples, and the distribution of $x$ is Bernoulli with $p={\mu }_n$. (So $E\left(x\right)={\mu }_n$ and $Var\left(x\right)={\sigma }_x^2={\mu }_n(1-{\mu }_n)$). 

To do the proper version of this, we would be interested in how our prior changes, and our distribution for $x$ wouldn't purely be a function of ${\mu }_n$. This will reduce the difference, so I have glossed over this detail.

The next question is: "given we shift the market parameter by $O\left(1/n^2\right)$, how much money (pnl) should we expect to be able to extract from the market in expectation?"

For this, I am assuming that our market is equivalent to a proper scoring rule. This duality is laid out nicely here. Expending the proper scoring rule out locally, it must be of the form $f\left(x\right)=c+O\left(x^2\right)$, since we have to be at a local minima. To use some classic examples, in a log scoring rule:

$q\log \left(p\right)+(1-q)\log (1-p)=\left(q\log \right(q)-(q-1\left)\log \right(1-q\left)\right)+\frac{(p-q{)}^2}{\left(2\right(q-1\left)q\right)}+O\left(\right(p-q{)}^3)$

in a brier scoring rule:

$q(1-p{)}^2+(1-q)p^2=q(1-q{)}^2+(1-q)q^2+(q-p{)}^2$

Whoops. Good catch. Fixing

x is the result of the (n+1)th draw sigma is the standard deviation after the first n draws pnl is the profit and loss the bettor can expect to earn

Prediction markets generate information. Information is valuable as a public good. Failure of public good provision is not a failure of prediction markets.

I think you've slightly missed my point. My claim is narrower than this. I'm saying that prediction markets have a concrete issue which means you should expect them to be less efficient at gathering data than alternatives. Even if information is a public good, it might not be worth as much as prediction markets would charge to find that information. Imagine if the cost of information via a prediction market was exponential in the cost of information gathering, that wouldn't mean the right answer is to subsidise prediction markets more.

If you have another suggestion for a title, I'd be happy to use it

Even if there is no acceptable way to share the data semi-anonymously outside of match group, the arguments for prediction markets still apply within match group. A well designed prediction market would still be a better way to distribute internal resources and rewards amongst competing data science teams within match group.

I used to think things like this, but now I disagree, and actually think it's fairly unlikely this is the case.

1. Internal prediction markets have tried (and failed) at multiple large organisations who made serious efforts to create them
2. As I've explained in this post, prediction markets are very inefficient at sharing rewards. Internal to a company you are unlikely to have the right incentives in place as much as just subsidising a single team who can share models etc. The added frictions of a market are substantial.
3. The big selling points of prediction markets (imo) come from:
   1. Being able to share results without sharing information (ie I can do some research, keep the information secret, but have people benefit from the conclusions)
   2. Incentivising a wider range of people. At an orgasation, you'd hire the most appropriate people into your data science team and let them run. There's no need to wonder if someone from marketing is going to outperform their algorithm.

People who actually match and meetup with another user will probably have important inside view information inaccessible to the algorithms of match group.

I strongly agree. I think people often confuse "market" and "prediction market". There is another (arguably better) model of dating apps which is that the market participants are the users, and the site is actually acting as a matching engine. Since I (generally) think markets are great, this also seems pretty great to me.

Sure - but that answer doesn't explain their relative lack of success in other countries (eg the UK)

Additionally, where prediction markets work well (eg sports betting, political betting) there is a thriving offshore market catering to US customers. 

This post triggered me a bit, so I ended up writing one of my own.

I agree the entire thing is about how to subsidise the markets, but I think you're overestimating how good markets are as a mechanism for subsidising forecasting (in general). Specifically for your examples:

1. Direct subsidies are expensive relative to the alternatives (the point of my post)
2. Hedging doesn't apply in lots of markets, and in the ones where it does make sense those markets already exist. (Eg insurance)
3. New traders is a terrible idea as you say. It will work in some niches (eg where there's lots of organic interest, but it wont work at scale for important things)