Vladimir_Nesov comments on Asking Precise Questions - Less Wrong

6 Post author: paulfchristiano 03 January 2011 08:48AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (34)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 04 January 2011 12:12:29AM *  3 points [-]

This is one of the issues where LW potentially disagrees with the rest of humanity, and I think the LW position (or at least the position you articulate) is actually wrong. I see many object-level ways to help the world once we have a magical optimizer: solve protein folding, model plasma containment, etc. And these are just the opportunities we can take advantage of with existing tech, but the optimizer can also help design new tech.

Comment author: Vladimir_Nesov 04 January 2011 09:53:59AM *  5 points [-]

And these are just the opportunities we can take advantage of with existing tech, but the optimizer can also help design new tech.

We can do lots of useful things, sure (this is not a point where we disagree), but they don't add up towards "saving the world". These are just short-term benefits. Technological progress makes it easier to screw stuff up irrecoverably, advanced tech is the enemy. One shouldn't generally advance the tech if distant end-of-the-world is considered important as compared to immediate benefits (this value judgment can well be a real point of disagreement).