Gunnar_Zarncke comments on 'Dumb' AI observes and manipulates controllers - Less Wrong

33 Post author: Stuart_Armstrong 13 January 2015 01:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (19)

You are viewing a single comment's thread.

Comment author: Gunnar_Zarncke 15 January 2015 10:32:43PM 0 points [-]

If the rewand channel has only one bit per day I don't think any agent can infer much about the authors. Their days maybe. Some fundamental components of their preferrences possibly. But nothing a human could infer from all the bits of background he possesses. There are convergence rate results for classifiers that require just too many sample to extract enough information - especially in the face of real life feature vectors.

Comment author: Stuart_Armstrong 16 January 2015 12:07:21PM 1 point [-]

I'd assume there would be a reward for every story, that this would be on a ordinal scale with several options, and that it included feedback/corrections about grammar and phrasing.