hairyfigment comments on Objections to Coherent Extrapolated Volition - Less Wrong

11 Post author: XiXiDu 22 November 2011 10:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (56)

You are viewing a single comment's thread. Show more comments above.

Comment author: hairyfigment 23 November 2011 07:02:41PM 4 points [-]

To fix that problem we would have to turn ourselves into superintelligences rather than creating a singleton.

I've told you before this seems like a false dichotomy. Did you give a counterargument somewhere that I missed?

Seems to me the situation has an obvious parallel in the world today. And since children would presumably still exist when we start the process, they can serve as more than a metaphor. Now children sometimes want to avoid growing up, but I don't know of any such case we can't explain as simple fear of death. That certainly suffices for my own past behavior. And you assume we've fixed death through CEV.

It therefore seems like you're assuming that we'd desire to stifle our children's curiosity and their desire to grow, rather than letting them become as smart as the FAI and perhaps dragging us along with them. Either that or you have some unstated objection to super-intelligence as a concrete ideal for our future selves to aspire to.

Comment author: Elund 25 October 2014 08:57:16PM 2 points [-]

Now children sometimes want to avoid growing up, but I don't know of any such case we can't explain as simple fear of death.

They can be afraid of having to deal with adult responsibilities, or the physical symptoms of aging after they've reached their prime.