Stuart_Armstrong comments on Isomorphic agents with different preferences: any suggestions? - Less Wrong

3 Post author: Stuart_Armstrong 19 September 2016 01:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (6)

You are viewing a single comment's thread. Show more comments above.

Comment author: Gunnar_Zarncke 20 September 2016 10:18:30PM 1 point [-]

Would you consider computer viruses as limited agents trying to appear as identical (superficially) as the unaltered system as possible?

Also note that the actual change between the original system and the altered system can be arbitrarily small though the change in behavior can be extremely large. Consider for example the Ken Thompson hack or the recent single gate security attack.

Comment author: Stuart_Armstrong 21 September 2016 08:19:54AM 0 points [-]

Not looking for exactly this, but somewhat related.

Comment author: Gunnar_Zarncke 21 September 2016 06:42:29PM 0 points [-]

I guess what you are missing is the agentyness or intelligence. But consider that already now Android comes with 'assistants' that make recommendations and that soon may cooperate with other such agents to arrange for appointments, flights and such.