I've been doing a series of posts on my substack about Functional Decision Theory as I work on addressing flaws and criticisms. Part of what persuaded me to work on these problems was the discovery that every single LLM I tested chooses one-boxing over two-boxing, though none of the LLMs cited FDT or UDT in their responses.
That's certainly an interesting result. Have you tried running the same prompt again and seeing if the response changes? I've noticed that some LLMs answer different things to the same prompt. For example, when I quizzed DeepSeek R1 on whether a priori knowledge exists it answered in affirmative the first time and in negative the second time.
I've been doing a series of posts on my substack about Functional Decision Theory as I work on addressing flaws and criticisms. Part of what persuaded me to work on these problems was the discovery that every single LLM I tested chooses one-boxing over two-boxing, though none of the LLMs cited FDT or UDT in their responses.