wedrifid comments on General purpose intelligence: arguing the Orthogonality thesis - Less Wrong

20 Post author: Stuart_Armstrong 15 May 2012 10:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (156)

You are viewing a single comment's thread. Show more comments above.

Comment author: CuSithBell 11 June 2012 10:37:55PM 3 points [-]

But the theory fails because this fits it but isn't wireheading, right? It wouldn't actually be pleasing to play that game.

Comment author: wedrifid 11 June 2012 10:56:15PM *  3 points [-]

But the theory fails because this fits it but isn't wireheading, right? It wouldn't actually be pleasing to play that game.

I think you are right.

The two are errors that practically, with respect to hedonistic extremism, operate in opposing directions. They are similar in form in as much as they fit the abstract notion "undesirable outcomes due to lost purposes when choosing to optimize what turns out to be a poor metric for approximating actual preferences".