Luck

Computation requires interpretation, and depends on interpretation. For example, a tap can be interpreted as a computer, that solves hydrodynamics equations. Or not. It depends on what meaning we assign to the results it produces. This flexibility of interpretation allows us to twist computations in some funny ways. Let me...

Let's say a system receives reward when it believes that it's doing some good. Kind of like RL with actor-critic. Estimated Good things -> max We can do some rewriting. I'll use notation -> inc. that means incentivised to be increased. It's like direction, towards which the gradients point. Preventing_estimated_catastrophe...