g comments on Torture vs. Dust Specks - Less Wrong

39 Post author: Eliezer_Yudkowsky 30 October 2007 02:50AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (596)

Sort By: Old

You are viewing a single comment's thread.

Comment author: g 01 November 2007 01:05:00AM 1 point [-]

I think we may be at cross purposes; my apologies if we are and it's my fault. Let me try to be clearer.

Any *particular* utility function (if it's real-valued and total) "begs the question" in the sense that it either prefers SPECKS to TORTURE, or prefers TORTURE to SPECKS, or puts them exactly equal. I don't see how this can possibly be considered a defect, but if it is one then *all* utility functions have it, not just ones that prefer SPECKS to TORTURE.

Saying "Clearly SPECKS is better than TORTURE, because here's my utility function and it says SPECKS is better" would be begging the question (absent arguments in support of that utility function). I don't see anyone doing that. Neel's saying "You can't rule out the possibility that SPECKS is better than TORTURE by saying that no real utility function prefers SPECKS, because here's one possible utility function that says SPECKS is better". So far as I can tell you're rejecting that argument on the grounds that any utility function that prefers SPECKS is ipso facto obviously unacceptable; that *is* begging the question.