Eliezer_Yudkowsky comments on Selective processes bring tag-alongs (but not always!) - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (5)
I call these "secondary optimization effects".
Optimization squeezes a targeted state or future into regions high in the optimizer's preference function. This also squeezes all correlates of the optimizer's preference function. When we squeeze A, it affects every B with P(B|A) != P(B).