This is a linkpost for https://x.com/KieranJGibson/status/1985524607923925317
Kieran Gibson does some nifty experiments, to check if the subjects (MTurk users) made coherent decisions. They do not. Here is the key chart:
He also rules out ceiling effects and unexpected utilities by using probabilistic rewards. All the VNM criteria really.
My explanation is that this result it due to bounded rationality. Most people can't hold the joint reward function in their mind and will choose or alternate between the individual functions instead - which leads to averaging instead of adding.