cousin_it comments on Scenario analysis: semi-general AIs - Less Wrong

1 Post author: Will_Newsome 22 March 2012 09:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (66)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 22 March 2012 01:40:29PM *  4 points [-]

There seems to be a spectrum of different types of reflection. You can trust observations of how parts of you map inputs to outputs, but you can't trust quined descriptions embedded in your source code, because the programmer who wrote you didn't necessarily care about writing a perfect quine.

Comment author: wedrifid 22 March 2012 01:43:27PM 4 points [-]

because the programmer who wrote you didn't necessarily care about writing a perfect quine.

Understatement of the year!