Baughn comments on No Basic AI Drives - Less Wrong

2 Post author: XiXiDu 10 November 2011 01:27PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (43)
Tags: ai goals drives

Comments (43)

You are viewing a single comment's thread. Show more comments above.

Comment author: Baughn 10 November 2011 08:47:06PM 0 points [-]

The conservative assumption is that AGI is easy, and FAI is hard.

I don't know if this is actually true. I think FAI is harder than AGI, but I'm very much not a specialist in the area - either area. However, I do know that I'd very much rather overshoot the required safety margin by a mile than undershoot by a meter.

Comment author: Xom 12 November 2011 06:49:17AM *  2 points [-]

"FAI" here generally means "Friendly AGI", which would make "FAI is harder than AGI" trivially true.

Perhaps you meant one of the following more interesting propositions:

  • "(The sub-problem of) AGI is harder than (the sub-problem of) Friendliness."
  • "AGI is sufficiently hard relative to Friendliness, such that by the time AGI is solved, Friendliness is unlikely to have been solved."

(Assuming even the sub-problem of Friendliness still has prerequisite part or all of AGI, the latter proposition implies "Friendliness isn't so easy relative to AGI such that progress on Friendliness will lag insignificantly behind progress on AGI.")

Powered by Reddit Powered by Reddit