= 27d567bc2d48d9f40e9ccc20ea370b15)
ema comments on Open Thread, November 1-15, 2012 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (373)
Now we get to the question how detailed the paperclips have to be for the paperclipper to care. I expect the paperclipper to only care when the paperclips are simulated individually and we can't simulate 3^^^^^^3 paperclips individually.
I see no reason to think works of fiction that lead to such a distortion of reality are impossible.
I assume you concede my point re:guards?
We built the paperclipper. Hell, it doesn't even have to be a literal paperclipper. For that matter, it doesn't have to be literally 3^^^^^^3 paperclips; all that matters is that we can manipulate it's utility function without too much strain on our resources. If it values cheesecake, we can reward it with a world of infinite cheesecake. If it values "complexity" we can put it in a fractal. The point is that we can motivate it to co-operate without worrying that it might be a better idea to let it out.