wedrifid comments on Complexity of Value ≠ Complexity of Outcome - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (198)
Can we really expect a superintelligence to stick with the values we give it ? Our own values change over time; sometimes without even external stimulus just internal reflection. I don't see how we can bound a superintelligence without doing more computation than we expect it to do in its lifetime.
Yes.
I once proved that a program will print out only prime numbers endlessly. I really, really wish I kept the working out.
Is that program still running? ;-)
Hush you. You weren't supposed to notice that. :D