asr comments on Tool for maximizing paperclips vs a paperclip maximizer - Less Wrong

3 Post author: private_messaging 12 May 2012 07:38AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: asr 15 May 2012 01:22:10AM 0 points [-]

My impression is that the tool/agent distinction is really about whether we use the social-modeling parts of our brain. It's a question not about the world as much as about what's a fruitful outlook. Modeling humans as humans works well -- we are wired for this. Anthropomorphizing the desires of software or robots is only sometimes useful.