johnswentworth comments on FAI and the Information Theory of Pleasure - Less Wrong

8 Post author: johnsonmx 08 September 2015 09:16PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (19)

You are viewing a single comment's thread.

Comment author: johnswentworth 08 September 2015 11:28:03PM 1 point [-]

How are humans supposed to generate cryptographic reward tokens in such a way that an AI could not duplicate the process?

Comment author: johnsonmx 09 September 2015 12:39:28AM 0 points [-]

It would probably be highly dependent on the AI's architecture. The basic idea comes from Shulman and Bostrom - Superintelligence, chapter 9, in the "Incentive methods" section (loc 3131 of 8770 on kindle).

My understanding is that such a strategy could help as part of a comprehensive strategy of limitations and inventivization but wouldn't be viable on its own.