I know next to nothing about AI, so please correct me if I'm wrong, but it seems like the thought process of a dungeon master is a difficult starting point, since they're balancing out multiple levels of considerations. They're simulating a world, but also trying to shape a story (plus modelling the players & writing decent prose). The data would seem to be simpler to understand if you're dealing with a pure simulationist DM, or player who's 100% roleplayer (or munchkin), as the chains of reasoning would be focused on maximizing a single clear metric.
I ask because if so, some of those options might be also be easier to produce than a true AI Dungeon run.
Are you familiar with forum rps (role play)s? A group of people would collectively write a story, each playing the role of one character. (Looking it up now, looks like there are some Choose-Your-Own-Adventure variants akin to AI Dungeon) It was more popular back in the day, but it looks like there are some still extant.
These people are already doing something like what you're asking for, so it might be worth someone dropping in and offering to pay them in exchange for them taking copious notes.
Funnily enough, the first one I found when googling has the gimmick of "your comments are the protagonist's thoughts," which is not exactly what you're looking for, but pretty darn close.... except for the fact that the damn commenters can't stay in character!
[link removed; it tripped the spam filter]
Anyway, I have a writer friend who used to do this, I'll ask her about suitability. As I mentioned, the popular style is collaborative storytelling. It's not exactly AI Dungeon, but it seems to check the main boxes. (The difference being that it's multiple DMs squaring off). Would something like that work for you, or would the format incompatibility with regular AI Dungeons be a dealbreaker?
He explained it in the Tyler Cohen interview. After taking over the world, Sam would do exactly as promised: continue going double-or-nothing until it came up nothing.