= 27d567bc2d48d9f40e9ccc20ea370b15)
Alex123 comments on Superintelligence 23: Coherent extrapolated volition - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (97)
Because we are not SI, so we don't know what it will do and why. It might.
We never bother running a computer program unless we don't know the output and we know an important fact about the output. -- Marcello Herreshoff
In this case, one of the important facts must be that it won't go around changing its motivational structure. If it isn't, we're screwed for the reason you give.