= 27d567bc2d48d9f40e9ccc20ea370b15)
lukeprog comments on Muehlhauser-Goertzel Dialogue, Part 2 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (52)
I'm not so sure about "surely." I worry about the Yudkowskian suggestion that "once the superintelligent AI wants something different than you do, you've already lost."
So, you make sure the programming is within the goal system. "Encoded in the utility function" - as you put it.
Yes, but now your solution is FAI-complete, which was my point from the beginning.