I'm surprised fatebook.io isn't an answer here. I had in the past tried a bunch of personal prediction tools and felt dis-satisfied. Either because of the complexity, UI, or something else. Anyways, I've been using fatebook for a couple weeks now and loving it.
Personally, I've used Foretold, Google Sheets, CSVs, an R script, and my own bash script (PredictResolveTally) (which writes to a csv.).
Personally, I like my own setup best (it does work at the 5 second level), but I think you'd be better off just using a CSV, and then analyzing your results every so often with the programming language of your choice. For the analysis part, this is a Python library I'm looking forward to using.
I've tried Metaculus private questions, Roam, and Google Sheets, and unfortunately find Google Sheets the least tedious. Metaculus questions are best when you revise predictions dozens of times, and Roam can't do much automatically yet.
Columns in the spreadsheet:
I'm working on calibration, but also trying to identify patterns in mispredictions of myself that I can gain self-knowledge from, hence the extra information. It gets slow to load around 200 entries, but entering predictions using Google Forms could mitigate this (though I haven't tried it). The main advantage of a spreadsheet is the ability to customize graphs with relatively little effort.
PredictionBook is really great for lightweight, private predictions and does everything you're looking for. Metaculus is great for more fully-featured predicting and I believe also supports private questions, but may be a bit of overkill for your use case. A spreadsheet also seems more than sufficient, as others have mentioned.
I've spent a fair bit of time in the forecasting space playing w/ different tools, and I never found one that I could reliably use for personal prediction tracking.
Ultimately for me it comes down to:
1.) Friction: the predictions I'm most interested in tracking are "5-second-level" predictions - "do I think this person is right", "is the fact that I have a cough and am tired a sign that I'm getting sick" etc. - and I need to be able to jot that down quickly.
2.) "Routine": There are certain sites that are toothbrush sites, aka I use them everyday. I'm much more likely to adopt a digital habit if I can use one of those sites to fulfill the function.
So my current workflow for private predictions is to use a textexpander snippet w/ Roam.
- [[Predictions]]
- {percentage}%
- [[operationalized]]:
- [[{date}]]
- {{[[TODO]]}} [[outcome]]:
It doesn't have graphs, but I can get a pretty good sense of how calibrated I am, and if I want I could quickly export the markdown and evaluate it.
Of course I want to mention foretold.io as another good site - if you want to distributions that's definitely the way to go.
A while back TinyCast seemed pretty friendly: https://tinycast.cultivateforecasts.com/questions/new
Preferably, follow rules from "Best Textbooks in any Subject." I'm interested in people who have tried 2-3 prediction-recording tools, and can argue why one is better than the others.
I've decided I finally want to get gud at calibration.
I'm personally just interested in tracking my own predictions, often about private things. I'd prefer something very low-friction where I can record my own predictions, mark them as true/false later on using my own judgment, and automatically see a graph of how calibrated I am.