whowhowho comments on Decision Theory FAQ - Less Wrong

52 Post author: lukeprog 28 February 2013 02:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (467)

You are viewing a single comment's thread. Show more comments above.

Comment author: whowhowho 22 March 2013 12:38:21PM -2 points [-]

What is specialness, anyway?

I think that breaks down into what is subjective specialness, and what is objective specialness.

Clippy wants there to be as many paper clips as possible.

Which is to implicitly treat them as special or valuable in some way.

Clippy's stopping to care about paper clips is arguably not conducive there being more paperclips, so from Clippy's caring about paper clips, it follows that Clippy doesn't want to be altered so that it doesn't care about paper clips anymore.

Which leaves Clippy in a quandary. Clippy can't predict which self modifications might lead to Clippy ceasing to care about clips, so if Clippy takes a conservative approach and never self-modifies, Clippy remains inefficient and no threat to anyone.

Comment author: Creutzer 22 March 2013 03:52:13PM 1 point [-]

I think that breaks down into what is subjective specialness, and what is objective specialness.

What kind of answer is that?

Which is to implicitly treat them as special or valuable in some way.

Well, then we have it: they are special. Clippy does not want them because they are special. Clippy wants them, period. Brute fact. If that makes them special, well, you have all the more problem.

Clippy can't predict which self modifications might lead to Clippy ceasing to care about clips

Says who?

Comment author: whowhowho 22 March 2013 04:15:51PM -2 points [-]

Well, then we have it: they are special.

Subjectively, but not objectively.

Says who?

Whoever failed to equip Clippy with the appropriate oracle when stipulating Clippy.