Agreed. I think a strong reason why this might work at all is that forecasters are primarily judged by some other strictly proper scoring rule - meaning that they wouldn't have an incentive to fake calibration if it makes them come out worse in terms of e.g. Brier or log score. 

Thanks, yeah that list looks interesting!

The audio quality is incredible! How automated is the process vs. how much manual work are you putting in? Really appreciate what you're doing, thanks a lot!

This looks really cool! And it would be nice to get some version of this (or at least a link to it) on the Forecasting Wiki.