andrewc comments on Survey Results - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (210)
Can I make a pro-babyeater argument?
Here is a dialogue between an imaginary six-year-old child named Dennis and myself.
Me: Hi Dennis, do you like broccoli?
Dennis: No, I hate it!
Me: But it's good for you, right?
Dennis: I don't care! It tastes awful!
Me: Would you like to like broccoli?
Dennis: No, I can't stand broccoli! That stuff is gross!
Me: What if I told you some magic words that would make it so that every piece of broccoli you ever ate would taste just like chocolate if you said them? Would you say the magic words?
Dennis: Well...
Me: You like chocolate, don't you?
Dennis: Yes, but...
Me: What?
Dennis: Your questions are too hard.
I think everyone has conflicts between their different wants. I want to do well in my classes, but I don't want to study. And yet I can't think of any conflicts between my metawants: If I could choose to like studying just as much as I like my favorite computer game, I would make that choice. The wants offered to the humans in the babyeaters story seem fairly sensible from a utilitarian perspective. They promote peace throughout the galaxy and mean lots of fun for everyone. What's not to like?
I get the argument, but I assign a high value to self-determination. Like Arthur Dent, I don't want my brain replaced (unless by choice), even if the new brain is programmed to be ok with being replaced. Which ending did you pick in Deus Ex 2? I felt guilty gunning down JC and his brother, but it seemed the least wrong (according to my preferences) thing to do.
A rather vacuous statement, no?
Isn't human nature funny* that we have qualms about behaving immorally in a sufficiently realistic simulation, yet can hear cold numbers about enormous real disutility (genocides, natural disasters, etc.) and feel nothing? That's speaking for myself incidentally, not casting aspersions on you.
*(where by "funny" I mean "designed by a blind idiot god", naturally)
I don't think you're being very fair to your new brain. Do you?
I haven't played Deus Ex 2, sorry.