Konkvistador comments on Q&A with experts on risks from AI #1 - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (66)
I can't help but cringe reading that. But it really depends on what he meant by "inherent".
It's amazing, and a little scary, that he thinks "just want[ing] to be left alone to think" couldn't lead to any harm. The more resources an agent gathers, the more thinking it can do...
...and the more forcefully it can ensure it is left alone.
Yeah, this was an odd thing of him to write. The danger doesn't require any "emotional" qualities at all, just the wrong goal and sufficient power to achieve it.
Oracle AIs aren't dangerous? Well, it's possible.