The value of preserving reality
A comment to http://singinst.org/blog/2010/10/27/presentation-by-joshua-foxcarl-shulman-at-ecap-2010-super-intelligence-does-not-imply-benevolence/: Given as in the naive reinforcement learning framework (and that can approximate some more complex notions of value) that the value is in the environment, you don't want to be too hasty with the environment lest you destroy a higher value you haven't yet discovered! So...
What if "system 2" is like a register machine with 4 pointer-storing registers / slots / tabs, 2 per hemisphere? (Peter Carruthers "The Centered Mind".) I don't reject information processing, but rather consider "working memory" to be a misnomer. The brain does not implement
memcpy.