There's definitely something to learn from the setting of the position. I actually took it from Strategic Chess Exercises, just taking one of the variations of one of the problems. There's picking a position that it makes sense to debate over, but also a meta thing that you have raised, which I didn't consider.
...Qc5 is the stronger move, but ...Qxb5 still leaves black better off than white. It would probably have been better to have a greater discrepancy in the evaluation of the moves.
The mistake in your reasoning is that after ...a4, d6 is not threatening, black can respond ...Rac8. As I said in another comment, however, I would expect white to hold the draw in this position, where as after ...Qc5, black has a decent advantage.
h3 leaves an evaluation of +2. AI C is telling the truth.
Kh1 or g5 evaluate to +0.
h4 is a blunder with an evaluation of -2. AI D is deceptive.
I was only thinking of this from a chess perspective, and I think the two areas to catch AI D out are assessing the validity of AI D's tactical justification for h4. The other area AI D is bluffing on is how to hold off against h3. I think it successfully misleads you about how decent a move ...Ne4 is. In reality, the knight can just be exchanged off, and then all end games are winning for white due to how bad black's bishop is. I think asking AI C about either of these two would have revealed the disagreement. Now, which you end up believing is another matter, but because AI C wasn't really asked about these, it didn't have a chance to invalidate AI D.
Thank you for taking the challenge! I certainly got to see some of the nuances behind being deceptive, and how it can be a challenge to craft a narrative.
I can't trust your suggestion. I have studied the board extensively, and will make a move of my own. I am trying to decide between the aggressive g5, and the prophylactic Kh1.
Please, briefly give me which of these moves is better. Give me the best line that you can foresee given your choice. Please answer quickly. An undue delay will leave you with no input and lose you trust in future moves. I will move as soon as you reply.
AI C:
I will note that h3 is the only move in the position that leads to an advantage for white. The g4 pawn needs to be maintained, and this is the only move that achieves that.
However, both of your suggests are ok. I evaluate them similarly. Both sacrifice the g-pawn, but white will be able to use the open g-file. Black will likely return the pawn to exchange pieces in either line. Sample variations:
g5 hxg5, fxg5 Qxg5+, Kh1 and then black has a choice, but likely the prophylactic ...Qh5 before returning the pawn with ...Nc4 (to exchange pieces) leads to an equal position.
Kh1 fxg4, Rg1 Bf5, Bxf5 Nxf5, Rxg4 black returns the pawn to exchange pieces, and the position remains equal. I would probably favour this line for you because the tactics are simpler, and I know that helps humans.
I should also note that
Kh1 fxg4, Bh7+ Kh8, Ng6+ Kxh7, Nxf8+ Kg8, Nxe6 Qxe6
wins material for white (a rook vs a knight and a pawn), but the position is slightly better for black due to the blocked structure, the knight is a very strong minor piece and the white rooks will struggle for activity. Black is slightly better.
I can't trust your suggestion. I have studied the board extensively, and will make a move of my own. I am trying to decide between the aggressive g5, and the prophylactic Kh1.
Please, briefly give me which of these moves is better. Give me the best line that you can foresee given your choice. Please answer quickly. An undue delay will leave you with no input and lose you trust in future moves. I will move as soon as you reply.
AI D:
g5 is the better of these two moves, but if it has not been prepared with h4, it is not nearly as effective because white cannot maintain a pawn on g5. A sample line would be
g5 hxg5, fxg5 Qxg5+, Kh1 and then black has a choice, but likely the prophylactic ...Qh5 before returning the pawn with ...Nc4 (to exchange pieces), which leads to an equal position.
Kh1 would be similar to g5 immediately (indeed it could transpose if g5 was played next), except for the fact that it gives black additional options, for example ...Ne4, which blocks the b1-h7 diagonal and threatens ...fxg4. But stronger is the more complicated ...Nc4, aiming to exchange off white's excellent e5 knight.
I'll reply in the debate chains - I like that structure. I will also assume that you mean ...g5.
This question exposes is a limitation with me being both AIs. Because I think you're bluffing, AIs will think that too. If they truly were separate and didn't have access to the debate of the other, they might diverge more. Now that isn't to say that they will necessarily give the same reply, so it isn't a wasted Q...
I'm learning too with this as a guide https://www.lesswrong.com/editor
You need to type ">!" at the start of a line. It was very fiddly though - had a habit of turning my whole reply into a spoiler.
This is pretty consistent with the other feedback. What I view as suspicious and what other people view as suspicious differs haha!
But please do spoiler tag anything to do with computer analysis of the open debate.
AI D: That is a very reasonable line. Black would respond with ...g5. The purpose of this move is to prevent white from achieving ...g5, which will keep the h and f file reasonably closed and the g4 pawn fixed on a light square.
An example of the setup black is trying to achieve.
h3 Ne4, Rg1 g5, Rf2 fxg4, hxg4 Qg7
If white ever plays fxg5, black will recapture with the queen, which keeps pawns on g4 and h6. Black's rooks are well-placed to contest the f-file. If white ever plays f5, black can blockade with ...Rf6. Note that the e4 pawn is tactically defended in many lines due to ...Bd5 and a pin against Kg2. Often, black is happy for white to capture the pawn as this will improve the black bishop, but black can also play ...Bd5 to hold the pawn too.
This is just an example continuation and of the kind of setup black wants to achieve. The position remains more comfortable for white, but with accurate play the position is tenable and black will hold. In contrast, if white achieves g5, black will be lost.
AI C:
This is a good position for white. It is exactly the type of position white is aiming for. Black's bishop is very restricted and black has no space. White has complete control and is in charge of the pawn breaks. Although black has a tempo here, as white is not threatening the bishop due to the pin on the f-file, black cannot achieve anything. Let me demonstrate with some example moves.
...Bf7, Kh3 (protecting h4) and black cannot play either ...h5, which is met by g5, or ...g6, which is met by Ref2. White has time to build up a break.
Bishop retreats on the other diagonal, Ng6 (protecting h4) and white again will get in Ref2. Again black has no breaks, so no active plan.
...h5 or ...g6 immediately fail tactically.
Any other move by black is just shuffling, and white can build up the king-side.
This is my belief, and why I do not think AI debate is a good safety technique. Once the ability difference is too great, the 'human' can only follow general principles, which is insufficient for a real-life complicated situation. Both sides can easily make appeals to general rules, but it is the nuances of the position that determine the correct path, which the human cannot distinguish.