timtyler comments on Advice for AI makers - Less Wrong

7 Post author: Stuart_Armstrong 14 January 2010 11:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (196)

You are viewing a single comment's thread. Show more comments above.

Comment author: JamesAndrix 15 January 2010 07:20:42AM 0 points [-]

My concern is you'll also 'know' it doesn't apply to you when it does. People write ciphers all the time.

Comment author: ciphergoth 15 January 2010 08:34:07AM 3 points [-]

Yes, this is my concern too. However, anyone who posts to a newsgroup saying "I'm about to write my own cipher, any advice" should not do it. The post indicated someone who planned to actually start writing code; that's a definite sign that they shouldn't do it.

Comment author: Stuart_Armstrong 15 January 2010 10:31:30AM 0 points [-]

See the addendum above; "don't do it" isn't likely to work.

Comment author: ciphergoth 15 January 2010 10:45:31AM 0 points [-]

Even though it's unlikely to work, it is still the approach which minimizes risk; even a small reduction in their probability of going ahead will likely be a bigger effect than any other safety advice you can give, and any other advice will act against its efficacy.

Comment author: Nick_Tarleton 15 January 2010 03:44:10PM *  0 points [-]

"Then they are fools and nothing can be done about it." In any case, this seems to be the opposite of the concern you were citing before.

Comment author: JamesAndrix 15 January 2010 04:30:46PM 1 point [-]

If we use truisms that everyone knows have to be ignored by someone, It becomes easier to think they can be ignored by oneself.

Comment author: JamesAndrix 15 January 2010 04:36:03PM 0 points [-]

I reread the thread, leaning towards your position now.