red75 comments on The Moral Void - Less Wrong

31 Post author: Eliezer_Yudkowsky 30 June 2008 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (105)

Sort By: Old

You are viewing a single comment's thread.

Comment author: red75 08 June 2010 08:12:28AM *  -1 points [-]

If I AM utility function maximizer and I proved that killing baby reliably maximizes it, then sure I'll kill.

But I am not. My poorly defined unclosurable morality meter will break in and demand revising that nice and consistent utility function I've based my decision on. And so moral agonising begins.

Answer: I don't know, and it will be a painful work to decide, weighting all pro and cons, building and checking new utility functions, rewriting moral itself...