Eliezer_Yudkowsky comments on Selective processes bring tag-alongs (but not always!) - Less Wrong

30 Post author: AnnaSalamon 11 March 2009 08:17AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (5)

You are viewing a single comment's thread.

Comment author: Eliezer_Yudkowsky 11 March 2009 05:55:18PM 5 points [-]

I call these "secondary optimization effects".

Optimization squeezes a targeted state or future into regions high in the optimizer's preference function. This also squeezes all correlates of the optimizer's preference function. When we squeeze A, it affects every B with P(B|A) != P(B).