an comments on What Would You Do Without Morality? - Less Wrong

26 Post author: Eliezer_Yudkowsky 29 June 2008 05:07AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (171)

Sort By: Old

You are viewing a single comment's thread.

Comment author: an 29 June 2008 08:23:47AM 0 points [-]

James Andrix 'Doing nothing or picking randomly are also choices, you would need a reason for them to be the correct rational choice. 'Doing nothing' in particular is the kind of thing we would design into an agent as a safe default, but 'set all motors to 0' is as much a choice as 'set all motors to 1'. Doing at random is no more correct than doing each potential option sequentially.'

Doing nothing or picking randomly are no less rationally justified than acting by some arbitrary moral system. There is no rationally justifiable way that any rational being "should" act. You can't rationally choose your utility function.