You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Mark_Friedenbach comments on Some alternatives to “Friendly AI” - Less Wrong Discussion

19 Post author: lukeprog 15 June 2014 07:53PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (44)
Tags: agi

Comments (44)

You are viewing a single comment's thread.

Comment author: [deleted] 16 June 2014 10:02:19AM 1 point [-]

I was so disappointed. I thought you were going to talk about alternatives to FAI, e.g. Oracle AI. Oh well.

I think the main problem with [the term "High assurance AGI"] is that, quite reasonably, nobody will believe that we can ever get anywhere near as much assurance in the behavior of an AGI as we can in the behavior of, say, the relatively limited AI software that controls the European Train Control System. "High assurance AGI" sounds a bit like "Totally safe all-powerful demon lord." It sounds even more wildly unimaginable to AI researchers than "safe AGI."

So? You're basically saying "Friendly AI" / "High assurance AGI" is a hard problem. Well, it is. Let's not shy away from that.

I like "High assurance AGI" because it is a less inferentially distant phrase (we know what high-assurance software is), and perhaps inclusive of other approaches than those traditionally taken in FAI. I am personally going to start using this term from now on over "Friendly AI".

Comment author: Kaj_Sotala 16 June 2014 03:50:03PM 5 points [-]

I like "High assurance AGI" because it is a less inferentially distant phrase (we know what high-assurance software is)

I don't think the general public is familiar with this term. (Of course "high-assurance software" is somewhat self-explanatory, but probably not more than "Friendly AI".)

Comment author: Lumifer 16 June 2014 04:15:23PM 5 points [-]

I don't think the general public is familiar with this term.

And to the extent that it does, the term has a somewhat Dilbertian smell to it.

Comment author: Cyan 16 June 2014 01:54:04PM 1 point [-]

I was so disappointed. I thought you were going to talk about alternatives to FAI, e.g. Oracle AI. Oh well.

Yeah, I missed the quote marks in the title too. Oh well...

Powered by Reddit Powered by Reddit