Vladimir_Nesov comments on Welcome to Less Wrong! - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (1953)
If you are determined to read the sequences, you'll see. At least read the posts linked from the wiki pages.
Well, you'll have the same chance of successfully discovering that AI does what you want as a sequence of coin tosses spontaneously spelling out the text of "War and Peace". Even if you have a perfect test, you still need for the tested object to have a chance of satisfying the testing criteria. And in this case, you'll have neither, as reliable testing is also not possible. You need to construct the AI with correct values from the start.
Acting in the world might require you being alive, but it's not necessary for you to be alive in order for the world to have value, all according to your own preference. It does matter to you what happens with the world after you die. A fact doesn't disappear the moment it can no longer be observed. And it's possible to be mistaken about your own values.