Will_Newsome comments on General purpose intelligence: arguing the Orthogonality thesis - Less Wrong

20 Post author: Stuart_Armstrong 15 May 2012 10:23AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (156)

You are viewing a single comment's thread. Show more comments above.

Comment author: CuSithBell 11 June 2012 10:37:55PM 3 points [-]

But the theory fails because this fits it but isn't wireheading, right? It wouldn't actually be pleasing to play that game.

Comment author: Will_Newsome 11 June 2012 11:55:25PM 1 point [-]

Meh, yeah, maybe? Still seems like other, more substantive objections could be made.

Relatedly, I'm not entirely sure I buy Steve's logic. PRNGs might not be nearly as interesting as short mathematical descriptions of complex things, like Chaitin's omega. Arguably collecting as many bits of Chaitin's omega as possible, or developing similar maths, would in fact be interesting in a human sense. But at that point our models really break down for many reasons, so meh whatever.