You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

brandyn comments on Open thread, September 2-8, 2013 - Less Wrong Discussion

0 Post author: David_Gerard 02 September 2013 02:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (376)

You are viewing a single comment's thread. Show more comments above.

Comment author: somervta 09 September 2013 05:11:17AM 1 point [-]

I feel most of this fear is risidual leftovers from the self-modifying symbolic-program singularity FOOM theories that I hope are mostly left behind by now. But this is just the point -- people who don't understand real AGI don't understand what the real risks are and aren't (and certainly can't mediate them).

Self-modifying AI is the point behind FOOM. I'm not sure why you're connecting self-modification/FOOM/singularity with symbolic programming (I assume you mean GOFAI), but everyone I'm aware of who thinks FOOM is plausible thinks it will be because of self-modification.

Comment author: brandyn 09 September 2013 05:47:29AM 0 points [-]

Yes, I understand that. But it matters a lot what premises underlie AGI how self-modification is going to impact it. The stronger fast-FOOM arguments spring from older conceptions of AGI. Imo, a better understanding of AGI does not support it.

Thanks much for the interesting conversation, I think I am expired.