Gunnar_Zarncke comments on Natural selection defeats the orthogonality thesis - Less Wrong

-13 Post author: aberglas 29 September 2014 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: ChristianKl 01 October 2014 01:26:59PM 1 point [-]

1) not assuming that every AGI automatically prevents value drift and mutation and

The question is not whether every AGI automatically prevents value drift but whether AGI that keep humanity alive are that way. We want to build FAI's.

Comment author: Gunnar_Zarncke 01 October 2014 05:02:41PM 0 points [-]

Agreed. FAIs must prevent any kind of drift. That comes at a cost which penalizes FAI against other AGIs.