Armok_GoB comments on Reduced impact AI: no back channels - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (41)
If the AI has a naive "save humans" utility function, I don't see how this advantages it.
That kind of trade is indeed a problem, but you'd need to have a dangerous "much later AI" in the first place, which is a very bad thing anyway...
That's a general risk - I'll analyse that later, if this seems to work.
The output channel is indeed dangerous - it is not constrained through this method, and needs to be controlled in other ways.
Normally I wouldn't make a post this contentless but I just HAVE to commend the general rationalist virtue on how this response was handled. I have no further responses.