TheOtherDave comments on Objections to Coherent Extrapolated Volition - Less Wrong

11 Post author: XiXiDu 22 November 2011 10:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (56)

You are viewing a single comment's thread. Show more comments above.

Comment author: XiXiDu 23 November 2011 05:30:24PM 1 point [-]

The problem is not that all problems might be solved at some point but that as long as we don't turn ourselves into something similarly capable as the CEV process, then there exists an oracle that we could ask if we wanted to. The existence of such an oracle is that which is diminishing the value of research and discovery.

Comment author: TheOtherDave 23 November 2011 05:52:11PM 3 points [-]

I agree that the existence of such an oracle closes off certain avenues of research and discovery.

I'm not sure that keeping those avenues of research and discovery open is particularly important, but I agree that it might be.

If it turns out that the availability such an oracle closing off certain avenues is an important human problem, it seems to follow that any system capable of and motivated to solve human problems will ensure that no such oracle is available.