Jack comments on You cannot be mistaken about (not) wanting to wirehead - Less Wrong

34 Post author: Kaj_Sotala 26 January 2010 12:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (79)

You are viewing a single comment's thread. Show more comments above.

Comment author: Jack 26 January 2010 09:31:41PM *  9 points [-]

You could be wrong about that.

Comment author: Eliezer_Yudkowsky 26 January 2010 09:35:39PM 5 points [-]

What if I couldn't be wrong about that?

Comment author: thomblake 26 January 2010 09:39:18PM *  14 points [-]

Then you would clearly be immune to hemlock, and therefore weigh the same as a duck.

Comment author: timtyler 26 January 2010 09:47:49PM *  0 points [-]

Then you would be 100% certain - and 0 and 1 are not probabilities.

Comment author: RobbBB 21 January 2013 09:02:42PM -1 points [-]

It might be that he can't be wrong about that, even though he doesn't know for sure that he can't be wrong about it. Infallibility and certainty are distinct concepts.

Comment author: timtyler 22 January 2013 02:12:47AM 0 points [-]
Comment author: RobbBB 22 January 2013 03:11:01AM *  0 points [-]

Certainty (confidence, etc.) is in the mind. Fallibility isn't; you can be prone (or immune) to error even if no one thinks you are.

The point is that 'What if I couldn't be wrong about it?' does not express 'What if I could be certain that I couldn't be wrong about it?'; the latter requires that 1 be a probability, but the former does not, since I might be unable to be wrong about X and yet only assign, say, a .8 probability to X's being true (because I don't assign probability 1 to my own infallibility).

Comment author: timtyler 22 January 2013 11:49:46PM *  1 point [-]

Certainty (confidence, etc.) is in the mind. Fallibility isn't; you can be prone (or immune) to error even if no one thinks you are.

Though no one could ever possibly know. Seriously: fallibility is in the mind. It's a measure of how likely something is to fail; likelihoods are probabilities - and probabilities are (best thought of as being) in the mind.