Luke_A_Somers comments on Superintelligence 23: Coherent extrapolated volition - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (97)
We never bother running a computer program unless we don't know the output and we know an important fact about the output. -- Marcello Herreshoff
In this case, one of the important facts must be that it won't go around changing its motivational structure. If it isn't, we're screwed for the reason you give.