Kaj_Sotala comments on Existential risks open thread - Less Wrong

10 Post author: John_Maxwell_IV 31 March 2013 12:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (46)

You are viewing a single comment's thread. Show more comments above.

Comment author: Kaj_Sotala 31 March 2013 03:59:07PM *  7 points [-]

Is there any risk of "poisoning the well" with an amateurish lobbying effort?

E.g. annoyance towards the overenthusiastic amateurs wasting the time of a researcher who knows the field and issues better than they do seems plausible. Also, efforts to persuade researchers to leave the field seems most likely to work on the most responsible ones, leaving the more reckless researchers to dominate the field, which could reduce the social norms related to precaution-taking in the field overall.

Comment author: evand 31 March 2013 04:56:13PM 2 points [-]

Low-quality or otherwise low-investment attempts at convincing people to make major life changes seem to me to run a strong risk of setting up later attempts for the one argument against an army failure mode. Remember that the people you're trying to convince aren't perfect rationalists.

(And I'm not sure that convincing a few researchers would be an improvement, let alone a large one.)

Comment author: timtyler 01 April 2013 01:07:35AM 1 point [-]

Also, efforts to persuade researchers to leave the field seems most likely to work on the most responsible ones, leaving the more reckless researchers to dominate the field, which could reduce the social norms related to precaution-taking in the field overall.

Only if they buy the argument in the first place. Have any "synthetic biology" researchers ever been convinced by such arguments?

Comment author: John_Maxwell_IV 31 March 2013 11:55:56PM 1 point [-]

Were there any relatively uninformed amateurs that played a role in convincing EY that AI friendliness was an issue?