TheOtherDave comments on Holden's Objection 1: Friendliness is dangerous - LessWrong

11 Post author: PhilGoetz 18 May 2012 12:48AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (428)

You are viewing a single comment's thread. Show more comments above.

Comment author: RolfAndreassen 18 May 2012 08:09:17PM 1 point [-]

If we were able to formally specify the algorithm by which a CEV calculator should extrapolate our values, we would already have solved the Friendliness problem; your query is FAI-complete. But informally, we can say that the CEV evaluates by whatever values it has at a given step in its algorithm, and that the initial values are the ones held by the programmers.

Comment author: TheOtherDave 18 May 2012 09:10:41PM 0 points [-]

(nods) Fair enough. I don't especially endorse that, but at least it's cogent.