davidpearce comments on Decision Theory FAQ - Less Wrong

52 Post author: lukeprog 28 February 2013 02:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (467)

You are viewing a single comment's thread. Show more comments above.

Comment author: davidpearce 14 March 2013 03:23:40PM 0 points [-]

Wedrifid, granted, a paperclip-maximiser might be unmotivated to understand the pleasure-pain axis and the quaila-spaces of organic sentients. Likewise, we can understand how a junkie may not be motivated to understand anything unrelated to securing his supply of heroin - and a wireheader in anything beyond wireheading. But superintelligent? Insofar as the paperclipper - or the junkie - is ignorant of the properties of alien qualia-spaces, then it/he is ignorant of a fundamental feature of the natural world - hence not superintelligent in any sense I can recognise, and arguably not even stupid. For sure, if we're hypothesising the existence of a clippiness/unclippiness qualia-space unrelated to the pleasure-pain axis, then organic sentients are partially ignorant too. Yet the remedy for our hypothetical ignorance is presumably to add a module supporting clippiness - just as we might add a CNS module supporting echolocatory experience to understand bat-like sentience - enriching our knowledge rather than shedding it.

Comment author: Creutzer 14 March 2013 03:33:13PM *  2 points [-]

But superintelligent? Insofar as the paperclipper - or the junkie - is ignorant of the properties of alien qualia-spaces, then it/he is ignorant of a fundamental feature of the natural world - hence not superintelligent in any sense I can recognise, and arguably not even stupid.

What does (super-)intelligence have to do with knowing things that are irrelevant to one's values?

Comment author: whowhowho 14 March 2013 04:40:18PM *  0 points [-]

What does knowing everything about airline safety statistics, and nothing else, have to do with intelligence? That sort of thing is called Savant ability -- short for ''idiot savant''.

Comment author: [deleted] 15 March 2013 01:16:48PM 0 points [-]

I guess there's a link missing (possibly due to a missing <http://> in the Markdown) after the second word.