LESSWRONG
LW

73
Peter Mühlbacher
176010
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
Contra papers claiming superhuman AI forecasting
Peter Mühlbacher1y20

I agree it's a high bar, but note that

  1. a few particularly enthusiastic (&smart) humans still perform at roughly this level (depending on how you measure performance), so you wouldn't want it to be much lower, and
  2. we only acknowledged that this is a fairly reasonable definition of superhuman performance—it's authors in these papers who claimed that their models were (roughly) on par with, or better than the crowd forecast.

We made the deliberate choice of not getting too much into the details of what constitutes human-level/superhuman forecasting ability. We have a lot of opinions on this as well, but it is a topic for another post in order not to derail the discussion on what we think matters most here.

Reply
182Contra papers claiming superhuman AI forecasting
Ω
1y
Ω
16