torekp comments on Perfectly Friendly AI - Less Wrong

7 Post author: Desrtopa 24 January 2011 07:03PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (39)

You are viewing a single comment's thread. Show more comments above.

Comment author: torekp 25 January 2011 01:42:11AM 0 points [-]

The linked comment seems to be questioning whether terminal values are stable or unambiguous, rather than whether they exist. Unless the ambiguity goes so deep as to make the values meaningless ... but that seems far-fetched.

Comment author: TheOtherDave 25 January 2011 02:12:28AM 0 points [-]

Hm... maybe. Certainly my understanding of the concept of terminal values includes stability, so I haven't drawn that distinction much in my thinking.

That said, I don't quite see how considering them distinct resolves any of my concerns. Can you expand on your thinking here?