michael_vassar3 comments on A Case Study of Motivated Continuation - Less Wrong

25 Post author: Eliezer_Yudkowsky 31 October 2007 01:27AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (36)

Sort By: Old

You are viewing a single comment's thread.

Comment author: michael_vassar3 31 October 2007 07:41:51PM 3 points [-]

Eliezer: I don't think you read J Thomas carefully. He was saying, as far as I can tell from the last three sentences of his post, that the scenario itself strongly implies that you don't actually have the choice that it is asserted that you do have. As a hypothetical it fails. A person being tortured by the Gestapo is making a mistake to seriously consider the possibility that a supposed "choice" he is offered is anything but mockery and a part of his torture. *Any* person is making a mistake to seriously consider the possibility that his actions have any predictable impact on 3^^^3 other people because the chance of him being the one of those 3^^^3 people who was in the special position where he could effect the others rather than one of the others who could only be effected is simply too low.

"what would you do if your worldview had just been destroyed" is not, it seems to me, a legitimate question. The loss of your worldview implies the loss of any rational basis for inferring the consequences of your actions. It seems to me that you can ask, as a question about "you" the physical system "what would you do if you irrationally believed X", but not, as a question about rationality, "what would it be rational for you to do if you irrationally believed X"?