army1987 comments on No Universally Compelling Arguments in Math or Science - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (227)
Do you mean a paperclip maximizer mistakenly believing that the English word moral means ‘optimizing paperclips’ rather than ‘optimizing life, consciousness, etc.’, or a paperclip maximizer who knows that that the English word moral means ‘optimizing life, consciousness, etc.’ but mistakenly believes that optimizing paperclips would optimize life, consciousness, etc.?
And neither is like a paperclip maximizer who knows that that the English word moral means ‘optimizing paperclips’ rather than ‘optimizing life, consciousness, etc.’, and knows that optimizing paperclips doesn't optimize life, consciousness, etc., but doesn't give a damn about optimizing life, consciousness, etc.
Or a paperclip maximiser who correctly believes that "moral" doesn't refer to an arbitrary set of preferences?
http://lesswrong.com/lw/t3/the_bedrock_of_morality_arbitrary/
You do realize the argument in that post applies equally well to physics?