Nick_Tarleton comments on Advice for AI makers - Less Wrong

7 Post author: Stuart_Armstrong 14 January 2010 11:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (196)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nick_Tarleton 15 January 2010 03:30:05AM *  0 points [-]

We should encourage thinking about the intent (incoming) and expected effect (outgoing) of truisms, rather than their literal meaning. If either of the above injunctions actually doesn't apply to you, you'll know it.

Comment author: JamesAndrix 15 January 2010 07:20:42AM 0 points [-]

My concern is you'll also 'know' it doesn't apply to you when it does. People write ciphers all the time.

Comment author: ciphergoth 15 January 2010 08:34:07AM 3 points [-]

Yes, this is my concern too. However, anyone who posts to a newsgroup saying "I'm about to write my own cipher, any advice" should not do it. The post indicated someone who planned to actually start writing code; that's a definite sign that they shouldn't do it.

Comment author: Stuart_Armstrong 15 January 2010 10:31:30AM 0 points [-]

See the addendum above; "don't do it" isn't likely to work.

Comment author: ciphergoth 15 January 2010 10:45:31AM 0 points [-]

Even though it's unlikely to work, it is still the approach which minimizes risk; even a small reduction in their probability of going ahead will likely be a bigger effect than any other safety advice you can give, and any other advice will act against its efficacy.

Comment author: Nick_Tarleton 15 January 2010 03:44:10PM *  0 points [-]

"Then they are fools and nothing can be done about it." In any case, this seems to be the opposite of the concern you were citing before.

Comment author: JamesAndrix 15 January 2010 04:30:46PM 1 point [-]

If we use truisms that everyone knows have to be ignored by someone, It becomes easier to think they can be ignored by oneself.

Comment author: JamesAndrix 15 January 2010 04:36:03PM 0 points [-]

I reread the thread, leaning towards your position now.