wedrifid comments on Wanted: backup plans for "seed AI turns out to be easy" - Less Wrong

18 Post author: Wei_Dai 28 September 2011 09:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (62)

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 29 September 2011 11:35:49PM *  1 point [-]

I don't think his extrapolated volition would endorse that. I don't think theism could survive extrapolated cognition.

You cannot assume that the volitions of millions of agents will not include something catastrophically bad for you. "Extrapolated Volition" doesn't make people nice.

It only takes one.