Bongo comments on A Thought on Pascal's Mugging - Less Wrong

12 Post author: komponisto 10 December 2010 06:08AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (159)

You are viewing a single comment's thread.

Comment author: Bongo 10 December 2010 08:40:39PM 1 point [-]

Don't see how your idea defeats this:

If you have a nonzero probability that the mugger can produce arbitrary amounts of utility, the mugger just has to offer you enough to outweigh the smallness of this probability, which is fixed.

Comment author: saturn 10 December 2010 10:17:21PM 2 points [-]

Having a bounded utility function defeats that.

Comment author: komponisto 11 December 2010 12:24:17AM *  1 point [-]

See Sewing-Machine's comment. The smallness of the probability isn't fixed, if the probability is controlled by complexity, and complexity controls utility.

More precisely, the probability that the mugger can produce arbitrary amounts of utility is dominated by (the probability that the mugger can produce more than N units of utility), for every N; and as the latter is arbitrarily small for N sufficiently large, the former must be zero.

Comment author: [deleted] 10 December 2010 10:12:14PM 1 point [-]

Without invoking complexity, one can say that an agent is immune to this form of Pascal's mugging if, for fixed I, the quantity P(x amount of utility | I) goes to zero as x grows.

If the agent's utility function is such that "x amount of utility" entails "f(x) amount of complexity," f(x) --> infinity, then this will hold for priors that are sensitive to complexity.