lukeprog comments on Open Problems Related to the Singularity (draft 1) - Less Wrong

39 Post author: lukeprog 13 December 2011 10:57AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (40)

You are viewing a single comment's thread. Show more comments above.

Comment author: lukeprog 13 December 2011 12:41:48PM 15 points [-]

Not literally "any sort of AGI" of course, but... yes, several of the architecture problems required for FAI also make uFAI more probable. Kind of a shitty situation, really.

Comment author: Technoguyrob 18 December 2011 09:56:23AM *  0 points [-]

Wikipedia says Steve Ohomundro has "discovered that rational systems exhibit problematic natural 'drives' that will need to be countered in order to build intelligent systems safely."

Is he referring to the same problem?

EDIT: I answered my question by finding this.