One theory: the pool of metaculus traders is small enough and insufficiently motivated that there may be unexploited arbitrage opportunities, and you are correctly detecting this.
I'm coming very late to this but it is also possible that the people forecasting on each of the questions are noticeably different and they have different ideas about AI. Maybe some just don't know about the other questions. It won't explain everything but it could be a factor.
Also, it is difficult to keep all your forecasts up to date. You can forget.
Part of the story could be median is not a linear function, and there is no guarantee that the median of the difference between two distributions equals the difference of their medians.
I don't mean to say that, but maybe it's entailed. (I don't know.)
I'm saying even if it were the same group of forecasters who forecast all three questions, and even if every one of those forecasters is internally consistent with themselves, it will not necessarily be the case that the median for the "how many months" question will be equal to the difference between the medians of the other two questions.
Sure. But my question was whether we take the Metaculus timelines as indicative of the forecaster's averages or medians.
I mean, is there a way to measure the quality of the forecasters into the predictions? As number of forecasters expands, you get lower quality of average forecaster. Like how the markets were extremely overconfident (and wrong) about the Russians conquering Kiev...
The Metaculus prediction markets on AI timelines are the most referenced ones that I've seen.
The two main ones are as follows:
When will the first weakly general AI system be devised, tested, and publicly announced?: Current Community Prediction: April 14th, 2026
Criteria:
When will the First General AI System be Devised, Tested and Publicly Announced?: Current Community Prediction: January 26th 2031
Criteria:
If we subtract the two, then we get around 57 months.
However, there is a market focusing just on the difference between the two which has a substantially lower prediction.
After a (weak) AGI is created, how many months will it be before the first superintelligent AI is created? Current Community Prediction 25.82 months
Why does this differ from the figure we got before? Is this an inconsistency or is there an important difference between the two markets?
I tried looking at this difference market and I could confirm it used the same definition of strong AI, but I'm unsure what definition it is using for weak AGI.