shminux comments on By Which It May Be Judged - Less Wrong

35 Post author: Eliezer_Yudkowsky 10 December 2012 04:26AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (934)

You are viewing a single comment's thread. Show more comments above.

Comment author: shminux 12 December 2012 12:49:21AM 0 points [-]

All good points. I was mostly thinking about an evolved paperclip maximizer, which may or may not be a result of a fooming paperclip-maximizing AI.

Comment author: Eugine_Nier 13 December 2012 04:46:24AM 1 point [-]

An evolved agent wouldn't evolve to maximize paper clips.

Comment author: MugaSofer 14 December 2012 12:18:46PM 1 point [-]

It could if the environment rewarded paperclips. Admittedly this would require an artificial environment, but that's hardly impossible.

</nitpick>

Comment author: [deleted] 18 December 2012 09:22:55PM 0 points [-]

Evolved creatures as we know them (at least the ones with complex brains) are reward-center-reward maximizers, which implicitly correlates with being offspring maximizers. (Actual, non-brainy organisms are probably closer to offspring maximizers).