atucker comments on Rationality, Singularity, Method, and the Mainstream - Less Wrong

38 Post author: Mitchell_Porter 22 March 2011 12:06PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (35)

You are viewing a single comment's thread.

Comment author: atucker 22 March 2011 10:44:55PM 0 points [-]

My expectation is that the presently small fields of machine ethics and neuroscience of morality will grow rapidly and will come into contact, and there will be a distributed research subculture which is consciously focused on determining the optimal AI value system in the light of biological human nature.

Is SIAI working on trying to cause that?

It seems like it would do more harm than good, since it does a lot of work for FAI, and almost none for AI.

Comment author: LukeStebbing 27 March 2011 11:40:49PM 2 points [-]

Without speaking toward its plausibility, I'm pretty happy with a scenario where we err on the side of figuring out FAI before we figure out seed AIs.