Two months ago I said I'd be creating a list of predictions about the future in honor of my baby daughter Artemis. Well, I've done it, in spreadsheet form. The prediction questions all have a theme: "Cyberpunk." I intend to make it a fun new year's activity to go through and make my guesses, and then every five years on her birthdays I'll dig up the spreadsheet and compare prediction to reality.
I hereby invite anybody who is interested to go in and add their own predictions to the spreadsheet. Also feel free to leave comments asking for clarifications and proposing new questions or resolution conditions.
I'm thinking about making a version in Foretold.io, since that's where people who are excited about making predictions live. But the spreadsheet I have is fine as far as I'm concerned. Let me know if you have an opinion one way or another.
(Thanks to Kavana Ramaswamy and Ramana Kumar for helping out!)
Thank you! I continued your ChatGPT conversation and got the following tidbits of extra info:
For my 2020 predictions, I asked it to summarize my biggest sources of Brier loss:
Top 5 Brier losses from FALSE outcomes (overconfidence)
RankClaimp (2020)Loss1100+ drone swarms operationally fielded0.500.250210%+ news articles AI-generated0.200.0403$1 deepfake costs $100+ to detect0.350.1234Orbital rocket reused 100 times0.300.090590%+ Rio Tinto mines automated0.300.090
Top 5 Brier losses from TRUE outcomes (pessimism)
RankClaimp (2020)Loss1AI wins International Math Olympiad0.150.7232Neural net writes B-average college essays0.200.6403Crypto restaurants near Berkeley0.200.6404Combat drones <50 lbs fielded0.500.2505AI beats top StarCraft players0.700.090
The IMO prediction alone is your single largest loss across all 2020 items.
Interestingly the two biggest hits to Brier score I took (on jan 1 2020) were from underestimating LLMs basically.
Also interestingly, it seems like maybe I took significantly more Brier loss from saying things wouldn't happen, that did happen, then from saying things would happen, that didn't? In other words I was too cautious overall rather than too credulous?
6Daniel Kokotajlo
ChatGPT goes on to say that I outperformed Rick (who also made predictions in 2020 in the spreadsheet.) However, looking over the data briefly, I'm not sure I agree with some of the scores, e.g. are there really robotaxis in 20+ cities now? And drone delivery?
Kiwibot has operated delivery robots in Berkeley since 2017, founded in UC Berkeley’s Skydeck incubator. Delivers food within approximately one mile of campus with over 250,000 total deliveries completed.
Googling quickly, there are claims that it has since shut down and also that it was remote-controlled rather than fully autonomous. In any case, it'd be pretty niche and clearly only available due to the novelty value.
Robotaxis in 20+ cities was something claude initially thought... (read more)