TheOtherDave comments on Objections to Coherent Extrapolated Volition - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (56)
The problem is not that all problems might be solved at some point but that as long as we don't turn ourselves into something similarly capable as the CEV process, then there exists an oracle that we could ask if we wanted to. The existence of such an oracle is that which is diminishing the value of research and discovery.
I agree that the existence of such an oracle closes off certain avenues of research and discovery.
I'm not sure that keeping those avenues of research and discovery open is particularly important, but I agree that it might be.
If it turns out that the availability such an oracle closing off certain avenues is an important human problem, it seems to follow that any system capable of and motivated to solve human problems will ensure that no such oracle is available.