Lapsed_Lurker comments on Tool for maximizing paperclips vs a paperclip maximizer - Less Wrong

3 Post author: private_messaging 12 May 2012 07:38AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread.

Comment author: Lapsed_Lurker 12 May 2012 08:48:25AM 1 point [-]

Why would tools for which the failure-mode of the tool just wireheading itself was common be built?

Comment author: private_messaging 12 May 2012 08:59:40AM *  -1 points [-]

Ugh, because we don't know other way to do it?

You don't need to implement 'real world intentionality' (even if you can, which may well not be the case) to prevent any particular tool from wireheading. You just make it non general purpose enough, which simultaneously prevents foom, but if you don't believe in foom, what do you lose?