xxd comments on What if AI doesn't quite go FOOM? - Less Wrong

11 Post author: Mass_Driver 20 June 2010 12:03AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (186)

You are viewing a single comment's thread. Show more comments above.

Comment author: xxd 29 November 2011 06:45:44PM 2 points [-]

By extrapolation it seems likely that the cheapest implementation of the different-worlds-for-conflicting-points of view is some kind of virtual reality if it proves too difficult to give each human it's own material world.

Comment author: Bugmaster 29 November 2011 07:11:32PM 2 points [-]

Yes, and in the degenerate case, you'd have one world per human. But I doubt it would come to that, since a). we humans really aren't as diverse as we think, and b). many of us crave the company of other humans. In any case, the FAI will be able to instantiate as many simulations as needed, because it has the aforementioned nano-magical powers.

Comment author: xxd 29 November 2011 08:52:04PM 2 points [-]

Indeed. It's likely that many of the simulations would be shared.

What I find interesting to speculate on then is whether we might be either forcibly scanned into the simulation or plugged into some kind of brain-in-a-vat scenario a la the matrix.

Perhaps the putative AI might make the calculation that most humans would ultimately be OK with one of those scenarios.

Comment author: Bugmaster 29 November 2011 09:29:03PM 1 point [-]

What I find interesting to speculate on then is whether we might be either forcibly scanned into the simulation or plugged into some kind of brain-in-a-vat scenario a la the matrix.

Meh... as far as I'm concerned, those are just implementation details. Once your AI gets a hold of those nano-magical quantum powers, it can pretty much do anything it wants, anyway.