Rain comments on Muehlhauser-Wang Dialogue - Less Wrong

24 Post author: lukeprog 22 April 2012 10:40PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (284)

You are viewing a single comment's thread. Show more comments above.

Comment author: Rain 23 April 2012 02:04:01PM *  5 points [-]

But most AI researchers, including Pei Wang, do not buy the idea of AGI's that can quickly and vastly self-improve themselves to the point of getting out of control.

To rephrase into a positive belief statement: most AI researches, including Pei Wang, believe that AGI's are safely controllable.

Telling most people in the AI community about AI risks is similar to telling neuroscientists that their work might lead to the creation of a society of uploads which will copy themselves millions of times and pose a risk due to the possibility of a value drift. What reaction do you anticipate?

"Really? Awesome! Let's get right on that." (ref. early Eliezer)

Alternatively: "<distracted> Hmm? Yes, that's interesting... it doesn't apply to my current grant / paper, so... <insert topics from current grant / paper>."

Comment author: XiXiDu 23 April 2012 03:08:06PM 1 point [-]

What reaction do you anticipate?

"Really? Awesome! Let's get right on that." (ref. early Eliezer)

Alternatively: "<distracted> Hmm? Yes, that's interesting... it doesn't apply to my current grant / paper, so... <insert topics from current grant / paper>."

I didn't expect that you would anticipate that. What I anticipate is outright ridicule of such ideas outside of science fiction novels. At least for most neuroscientists.

Comment author: Rain 23 April 2012 04:14:43PM 0 points [-]

Sure, that too.