Blake Riley
14
1
1
Blake Riley has not written any posts yet.
Blake Riley has not written any posts yet.
This year's Spring ACX Meetup everywhere in Indianapolis.
Location: Upland FSQ Brewery 1201 Prospect St, Indianapolis, IN 46203 I'll have a sign and a copy of Unsong at the table – https://plus.codes/86FMQV26+VQ
Might be seated indoors or outdoors depending on the weather. Brewery is all-ages and family-friendly, not 21+
Contact: blake.j.riley@gmail.com
This is an underappreciated fact! I like how simple the rule is when framed in terms of size and distance.
You mention both the linear and log rules. The log rule has the benefit of being scale-invariant, so your score isn't affect by the units the answer is measured in, but it can't deal with negatives and gets overly sensitive around zero. The linear rule doesn't blow up around zero, is shift-invariant, and can handle negative values fine. The best generic scoring rule would have all these properties.
Turns out (based on Lambert and Shoham, "Eliciting truthful answers to multiple choice questions") that all scoring rules for symmetric confidence intervals with coverage probability... (read more)