When I use the program I would enjoy it if I learn some content while I'm using the program. You could make a list of 2000 claims. 1000 true claims. 1000 false claims.
Type I error is the incorrect rejection of a true null hypothesis. A) Yes B) No
Type I error is is the failure to reject a false null hypothesis. A) Yes B) No
Pack all the knowledge that CFAR wants to teach in rationality minicamps into the program.
What's the name of the bias to see events that have already occurred as being more predictable than they were before they took place? A) Hindsight bias B) Confirmation bias
To improve learning you use the SRS in the background. Take the SuperMemo algorithm. You don't have to show the user in the open how many due cards there are. Whenever the user has completed all due cards, you add new cards. Whenever there are due cards, you add no new cards.
This approach has two big advantages: 1) The students learns two things at the same time. 2) The student is using calibrating his knowledge on questions that are more meaningful. That will increase the chance that he can use the calibration in his "real life".
"It's a dessert topping and a floor wax!"
I think trying to do two completely different things together would likely result in neither of them being done as well as they can be by two separate tools.
Hey rationality friends, I just made this FAQ for the credence calibration game. So if you have people you'd like to introduce to it --- for example, to get them used to thinking of belief strengths as probabilities --- now is a good time :)