timtyler comments on Morality as Parfitian-filtered Decision Theory? - Less Wrong

24 Post author: SilasBarta 30 August 2010 09:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (270)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 01 September 2010 12:42:40PM 0 points [-]

It doesn't literally lose information - since the information inputs are sensory, and they can be archived as well as ever.

The short answer is that human cognition is a mess. We don't want to reproduce all the screw-ups in an intelligent machine - and what you are talking about lookss like one of the mistakes.

Comment author: pjeby 01 September 2010 03:36:34PM 2 points [-]

It doesn't literally lose information - since the information inputs are sensory, and they can be archived as well as ever.

It loses information about human values, replacing them with noise in regions where a human would need to "think things over" to know what they think... unless, as I said earlier, you simply build the entire human metacognitive architecture into your utility function, at which point you have reduced nothing, solved nothing, accomplished nothing, except to multiply the number of entities in your theory.