Rain comments on Muehlhauser-Wang Dialogue - Less Wrong

24 Post author: lukeprog 22 April 2012 10:40PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (284)

You are viewing a single comment's thread. Show more comments above.

Comment author: shminux 23 April 2012 06:22:28AM *  4 points [-]

I think his main point is in the summary:

though the safety of AGI is indeed an important issue, currently we don’t know enough about the subject to make any sure conclusion. Higher safety can only be achieved by more research on all related topics, rather than by pursuing approaches that have no solid scientific foundation.

Not sure how you can effectively argue with this.

Comment author: wedrifid 23 April 2012 12:07:13PM 0 points [-]

I think his main point is in the summary:

His main agenda and desired conclusion regarding social policy is represented in the summary there, but the main point made in his discussion is "Adaptive! Adaptive! Adaptive!". Where by 'adaptive' he refers to his conception of an AI that is changes its terminal goals based on education.

Comment author: timtyler 23 April 2012 07:38:27PM 2 points [-]

Pang calls these "original goals" and "derived goals". The "original goals" don't change, but they may not stay "dominant" for long - in Pei's proposed system.