BerryPick6 comments on Rationality Quotes January 2013 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (604)
My comment applies just the same, whether you spell god God, G_d, GOD or in some other manner: You can believe such a being exists (making you a theist) without following its moral codex or whatever commands it levies on you. Doesn't make you an atheist.
Although, if you believe it always tells the truth, then you should follow whatever counterintuitive claim it makes about your own preferences and values, no? So if God were to tell you that sacrificing your son is what CEV_(Kawoomba) would do, would you do it?
I have a certain probability I ascribe to the belief that god always tells the truth, let's say this is very high.
I also have a certain probability with which I believe that CEV_(Kawoomba) contained such a command. This is negligible because (from the definition) it certainly doesn't fit with "were more the [man] [I] wished [I] were".
However, we can lay that argument (evening out between a high and a very low probability) aside, there's a more important one:
The point is that my values are not CEV_(Kawoomba), which is a concept that may make sense for an AI to feed with, or even to personally aspire to, but is not self-evidently a concept we should unequivocally aspire to. In a conflict between my values and some "optimized" (in whatever way) values that I do not currently have but that may be based on my current values, guess which ones win out? (My current ones.)
That aside, there is no way that the very foundation of my values could be turned topsy turvy and still fit with CEV's mandate of "being the person I want to be".