lukeprog comments on Conceptual Analysis and Moral Theory - Less Wrong

60 Post author: lukeprog 16 May 2011 06:28AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (456)

You are viewing a single comment's thread. Show more comments above.

Comment author: Will_Sawin 16 May 2011 04:15:05PM 0 points [-]

The definition of "right action" is the kind of action you should do.

You don't need to know what "should" means, you just need to do what you should do and not do what you shouldn't do.

One should be able to cash out arguments about the "definition" of "right" as arguments about the actual nature of shouldness.

Comment author: lukeprog 16 May 2011 05:15:35PM 4 points [-]

Defining 'right' in terms of 'should' gets us nowhere; it just punts to another symbol. Thus, I don't yet know what you're trying to say in this comment. Could you taboo 'should' for me?

Comment author: Will_Sawin 17 May 2011 01:36:42AM *  2 points [-]

Only through the use of koans. Consider the dialog in:

http://en.wikipedia.org/wiki/What_the_Tortoise_Said_to_Achilles

Could you explain what "If A, then B" means, tabooing "if/then","therefore",etc.?

Here is another way:

If a rational agent becomes aware that the statement "I should do X" is true, then it will either proceed to do X or proceed to realize that it cannot do X (at least for now).

ETA: Here is a simple Python function (I think I coded it correctly):

def square (x): y=x*x return y

"return" is not just another symbol. It is not a gensym. It is functional. The act of returning and producing an output is completely separate from and non-reducible-to everything else that a subroutine can do.

Rational agents use "should" the same way this subroutine uses "return". It controls their output.