CarlShulman comments on A Less Wrong singularity article? - Less Wrong

28 Post author: Kaj_Sotala 17 November 2009 02:15PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (210)

You are viewing a single comment's thread.

Comment author: CarlShulman 17 November 2009 08:19:36PM *  6 points [-]

This is a great idea Kaj, thanks for taking the initiative.

As noted by others, one issue with the AI Risks chapter is that it attempts to cover so much ground. I would suggest starting with just hard take-off, or local take-off, and presenting a focused case for that, without also getting into the FAI questions. This could also cut back on some duplication of effort, as SIAI folk were already planning to submit a paper (refined from some work done for a recent conference) for that issue on "machine ethics for superintelligence", which will be discussing the FAI problem.

P.S. If people would like to volunteer to review drafts of those papers in a few weeks to give feedback before they are submitted, that would be much appreciated. (You can email me at myfirstname AT mylastname at gmail)

Comment author: wedrifid 18 November 2009 01:57:10AM 2 points [-]

myfirstname AT mylastname at gmail

Is the first AT to really confuse bots or am I missing something technical?

Comment author: Zack_M_Davis 18 November 2009 02:48:23AM *  1 point [-]

I think it was supposed to be a "dahtt."

Comment author: Kaj_Sotala 18 November 2009 05:44:20PM 0 points [-]

Thanks for the heads-up - if there's already a FAI paper in the works, then yes, it's certainly better for this one to concentrate merely on the FOOM aspect.