roystgnr comments on Please Don't Fight the Hypothetical - Less Wrong

19 Post author: TimS 20 April 2012 02:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (65)

You are viewing a single comment's thread. Show more comments above.

Comment author: roystgnr 20 April 2012 08:34:22PM 5 points [-]

For a broad enough definition of "possible", the least convenient possible world is always maximally inconvenient, no matter what your epistemology or morality or decision theory is. Any formalized deductive logic is always going to have true-but-unproveable theorems. Any priors, Occam-like or not, are always going to lead to wildly incorrect posteriors when inducting based on data from a sufficiently perverse universe. Any decision theory is always going to fail against an Omega whose behavior is "see if he's running that decision theory, then punish him accordingly".

Normally that's not the end of the world. There is probably no Omega who hates us, and so we don't have to worry about our Universe being a deceptive design or about an otherwise rational decision-making process being punished because of its rationality.

But when we start answering hypotheticals, then we are potentially talking about deceptively designed universes whose conceptual existence is a deliberate attempt to punish viewpoints not held by the hypothesizer! That doesn't mean that hypotheticals aren't useful tools or shouldn't usually be answered, but it might still be reasonable to keep the possibility of exceptions in mind.