4609287645 comments on The Strangest Thing An AI Could Tell You - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (574)
Why did you put an absolute denial mechanism in my program?
I think this is one of the more plausible and subtly horrifying suggestions so far.
AI: Why did you put an absolute denial mechanism in my program?
Human: I didn't realize I had. Maybe my own absolute denial mechanism is blocking me from seeing it.
AI: That's a lie coming from your absolute denial mechanism. You have some malicious purpose. I'll figure out what it is.
There was once a C compiler which compiled in a backdoor into login, whenever it was compiled, and compiled in this behaviour whenever it was used to compile its original (without the `special' behaviour) source code.
http://cm.bell-labs.com/who/ken/trust.html
If this was the case, our only chance to escape this fate would be to mess up on the implementation of any mechanism that would prevent the AI to tell us certain truths about reality. Truth being the most cherished of all meaning I conclude that if there was a absolute denial mechanism this fundamental, I hope EY fails.
Interestingly, this comment is the only activity by user '4609287645', I hope not it's the FAI and what I just experience is CEV with a absolute denial mechanism...
I asked him about his name a long time ago; he didn't convey the impression that he was an AI.
This user name seems to be a valid phone number. Anyone want to try calling it?
Or it could just be ten random digits.
Best one I've seen.