TheOtherDave comments on Wrong Questions - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (126)
Do you feel any less free because it never occurs to you to bash your head against a wall, or slit your throat with a steak knife?
I certainly don't; it would be a terrible inconvenience to have to go through all the really stupid options of things I could do at any given moment before arriving at the reasonable ones.
How much more so, then, for a superintelligence; it does not have to wonder about the stupid questions we humans often ask, but instead can focus on the really interesting decisions that remain to be made. (If you imagine that the space of possible decisions is finite, perhaps it could run out eventually... but my sense is that no intelligence small enough to fit in our universe can run out of possible decisions in our universe.)
It does occasionally occur to me to kill myself, and in my really bad periods I do experience myself as prevented from choosing an eminently desirable path by my own earlier precommitments. But that's neither here nor there.
Leaving the particulars aside... if there exists some question Q such that intelligence I1 finds Q difficult to answer and I2 finds Q easy to answer because I2 is a superintelligence with respect to I1, then I2 may well at some point consider Q, answer Q, and then move on to the next thing. Or, of course, it might never do so, depending on the relevance of Q to anything that occurs to I2.... as you say, the space of possible decisions is enormous.
I fail to see what follows from this. Can you unpack your thinking a bit, here?