You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

wedrifid comments on SMBC comic: poorly programmed average-utility-maximizing AI - Less Wrong Discussion

9 Post author: Jonathan_Graehl 06 April 2012 07:18AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 06 April 2012 10:43:52AM *  4 points [-]

Name 3 things in the middle.

The second two exceptions would clearly not be required for the purpose of rejecting a dichotomy.

Comment author: Dmytry 06 April 2012 10:49:44AM *  -2 points [-]

Name 1 then.

edit: and it's not even a dichotomy. There's the hypothetical AIs which implement some moral absolute that is good for all cultures, possible cultures, and everyone, which we would invent, aliens would invent, whatever we evolve into could invent, etc. If those do not exist, then what exists that isn't to some extent culturally specific to h. Sapiens circa today?

Comment author: wedrifid 07 April 2012 02:21:44AM 0 points [-]

Name 1 then.

The Unobtrusive Guardian. An FAI that concludes that humanity's aversion to being 'straightjacketed' is such that it is never ok for it to interfere with what humans do themselves. It proceeds to navigate itself out of the way and wait until it spots an external threat like a comet or hostile aliens. It then destroys those threats.

(The above is not a recommended FAI design. It is a refutation by example of an absolute claim that would exclude the above.)

Comment author: Dmytry 07 April 2012 04:48:22AM -1 points [-]

didn't i myself describe it and outline how this one also limits opportunities normally available to evolution for instance? It's to very little extent a straitjacket to life, as it does very little.