wedrifid comments on SMBC comic: poorly programmed average-utility-maximizing AI - Less Wrong

9 Post author: Jonathan_Graehl 06 April 2012 07:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 07 April 2012 02:21:44AM 0 points [-]

Name 1 then.

The Unobtrusive Guardian. An FAI that concludes that humanity's aversion to being 'straightjacketed' is such that it is never ok for it to interfere with what humans do themselves. It proceeds to navigate itself out of the way and wait until it spots an external threat like a comet or hostile aliens. It then destroys those threats.

(The above is not a recommended FAI design. It is a refutation by example of an absolute claim that would exclude the above.)

Comment author: Dmytry 07 April 2012 04:48:22AM -1 points [-]

didn't i myself describe it and outline how this one also limits opportunities normally available to evolution for instance? It's to very little extent a straitjacket to life, as it does very little.