Do you have a model predicting >1% chance of significant political violence (>5,000 deaths) in the US in the next year? Pls share.
Also welcome: models predicting <.1%
Metaculus has been walking around 1-5% probability of a US civil war before July 2021. While 1% is the lowest probability one can give on Metaculus, rumor has it some reasonable people put more than 1% probability of significant political violence (SPV) happening.
I am[was] confused about this, and want[ed] to get a better sense of what models lead people to assign credence on this order of magnitude.
[it turns out this exercise led me to no longer feel disbelief, but I'm preserving it below. See Changing My... (read 715 more words →)
Here's my understanding / summary, with the hope that you correct me on areas if I'm confused:
- LLMs have a bias towards 'plot', because they're trained on data that is more 'plot'-like than real life. They'll infer that environmental details like chekov's gun are plot-relevant as they often are in written text, rather than random environmental details.
- (this was a useful point for me - I notice I've been intuitively trying to steer LLMs with the right plot details, and am careful to not include environmental hints that I think might be misleading (or pad them with many other environmental hints and suggest there is lots of spurious data).
- LLMs have a bias towards "plots
... (read more)