wedrifid comments on Complexity of Value ≠ Complexity of Outcome - Less Wrong

32 Post author: Wei_Dai 30 January 2010 02:50AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Tags: future fai values

Comments (198)

Sort By: Best

You are viewing a single comment's thread. Show more comments above.

Comment author: wedrifid 30 January 2010 03:46:09PM 3 points [-]

Can we really expect a superintelligence to stick with the values we give it ?

Yes.

I don't see how we can bound a superintelligence without doing more computation than we expect it to do in its lifetime.

I once proved that a program will print out only prime numbers endlessly. I really, really wish I kept the working out.

Comment author: timtyler 30 January 2010 05:42:43PM 2 points [-]

Is that program still running? ;-)

Comment author: wedrifid 30 January 2010 10:37:43PM 0 points [-]

Hush you. You weren't supposed to notice that. :D