Eric Bickel wrote two papers about weatherman calibration- 2008 paper and 2011 paper. They're well-calibrated for some kinds of predictions but poorly calibrated for other kinds of predictions, and they also tend to have no skill at making predictions more than ~5 days out.

Nate writes well of interesting things, but that meteorologists are calibrated is not new news: the 2001 anthology Principles of Forecasting includes it many times, and they're one of the standard examples of an area in which it is possible to build up genuine expertise because of repeated objective feedback.

A well-known example is the "Brier" of "Brier score" who invented it in 1950 to rate wheathermen's predictions - and which budding rationalists of the Good Judgment Project and elsewhere use today to assess their own calibration/resolution.

There's a way to circumvent the NYT firewall that's easier still than all the ones mentioned so far. Wait for the article to show on your browser, then press the stop button. This will prevent the pop-over from appearing.

The easiest way to get around the limit is to paste the article URL into Google (or if that fails, search for the title.) If Google is the referrer, you are not subject to the limit.