Manfred comments on Weighting the probability of being a mind by the quantity of the matter composing the computer that calculates that mind - Less Wrong

0 Post author: yttrium 11 February 2014 03:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (23)

You are viewing a single comment's thread. Show more comments above.

Comment author: Manfred 11 February 2014 08:19:18PM *  2 points [-]

If you make a robot that explicitly cares about things differently depending on how heavy it is, then sure, it can take actions as if it cared about things more when it's heavier.

But that is done using the same probabilities as normal, merely a different utility function. Changing your utilities without changing your probabilities has no impact on the "probability of being a mind."

Comment author: kokotajlod 12 February 2014 01:54:21AM 0 points [-]

We don't have to program the machine to explicitly care about things differently depending on how heavy they are. Instead, we program the machine to care simply about how many systems exist--but wait! It turns out it we don't know what we mean by that! According to yttrium.