John_Maxwell_IV comments on Building toward a Friendly AI team - Less Wrong

24 Post author: lukeprog 06 June 2012 06:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (95)

You are viewing a single comment's thread.

Comment author: John_Maxwell_IV 07 June 2012 08:46:51PM *  6 points [-]

I'm going to open my clueless mouth again: Many of the problems associated with FAI haven't been defined to that well yet. Maybe solving them will require new math, but it seems possible that existing math already provides the necessary tools. Perhaps it would be a good idea to have a generalist who has limited familiarity with a large variety of mathematical tools and can direct the team towards existing tools that might solve their problem. See the section called "The Right Way To Learn Math" in this post for more:

http://steve-yegge.blogspot.com/2006/03/math-for-programmers.html

And a metalevel comment: Presumably folks at SI are discussing these issues independently of the discussion on Less Wrong; they don't seem to be posting here much. I'm curious why this is considered optimal. It seems to me that posting your arguments on Internet is a good way to get falsifying evidence for them. If the box does not contain a diamond, I wish to believe the box does not contain a diamond and whatnot.

Comment author: Wei_Dai 07 June 2012 10:21:20PM 7 points [-]

Presumably folks at SI are discussing these issues independently of the discussion on Less Wrong; they don't seem to be posting here much.

I've been complaining about this too. But it does seem that SI is more open than before (e.g., lukeprog's recent series of posts on future SI plans), which we ought to give them credit for.

It seems to me that posting your arguments on Internet is a good way to get falsifying evidence for them. If the box does not contain a diamond, I wish to believe the box does not contain a diamond and whatnot.

Strongly agreed.

Comment author: reup 07 June 2012 11:28:30PM 0 points [-]

Maybe solving them will require new math, but it seems possible that existing math already provides the necessary tools.

There seems to be far more commitment to a particular approach than is justified by the evidence (at least what they've publicly revealed).