Eliezer_Yudkowsky comments on Rationality Quotes May 2012 - Less Wrong

6 Post author: OpenThreadGuy 01 May 2012 11:37PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (696)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 01 May 2012 11:38:26PM 29 points [-]

"The Way is easy for those who have no utility function." -- Marcello Herreshoff

Comment author: Vladimir_Nesov 20 May 2012 12:11:08AM *  6 points [-]

Not sure, this came up in a few previous conversations. If an agent is almost certain that it's completely indifferent to everything, the most important thing it could do is to pursue the possibility that it's not indifferent to something, that is to work primarily on figuring out its preference on the off chance that its current estimate might turn out to be wrong. So it still takes over the universe and builds complicated machines (assuming it has enough heuristics to carry out this line of reasoning).

Say, "Maybe 1957 is prime after all, and hardware used previously to conclude that it's not was corrupted," which is followed by a sequence of experiments that test the properties of preceding experiments in more and more detail, and then those experiments are investigated in turn, and so on and so forth, to the end of time.

Comment author: Dorikka 02 May 2012 02:04:51AM 0 points [-]

If someone didn't value any world-states more than any others, I'm not sure that a Way would actually exist for them, as they could do nothing to increase the expected utility of future world-states. Thus, it doesn't seem to really make sense to speak of such a Way being easy or hard for them.

Am I missing something?

Comment author: olalonde 02 May 2012 02:19:34AM *  5 points [-]

I think you're over analyzing here, the quote is meant to be absurd.

Comment author: chaosmosis 03 May 2012 01:40:13AM 0 points [-]

Whaaa?

Someone explain please. It didn't seem absurd when I read it.

Comment author: magfrump 03 May 2012 03:55:50AM 3 points [-]

If you don't want anything, it's very easy to get what you want.

However, everyone reading this post is a human, and therefore is almost certain to want many things: to breath, to eat, to sleep in a comfortable place, to have companionship, the list goes on.

I interpreted it similarly to part of this article:

you may choose to [do whatever you want], but only if you don't mind dying.

Comment author: chaosmosis 03 May 2012 04:36:24AM 0 points [-]

Since you said the quote itself was absurd I thought you were saying the post was an internally flawed strawman meant for the purpose of satire, but you meant something else by that word.

Comment author: olalonde 03 May 2012 08:37:27PM *  2 points [-]

I'm the one who said that. Just to make it clear, I do agree with your first comment: taken literally, the quote doesn't make sense. Do you get it better if I say: "It is easy to achieve your goals if you have no goals"? I concede absurd was possibly a bit too strong here.

Comment author: chaosmosis 03 May 2012 09:00:52PM *  1 point [-]

Okay, that makes more sense, yeah I see what you mean and agree.