somervta comments on Open thread, September 2-8, 2013 - Less Wrong

0 Post author: David_Gerard 02 September 2013 02:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (376)
Tags: open open_thread

Comments (376)

You are viewing a single comment's thread. Show more comments above.

Comment author: somervta 09 September 2013 05:11:17AM 1 point [-]

I feel most of this fear is risidual leftovers from the self-modifying symbolic-program singularity FOOM theories that I hope are mostly left behind by now. But this is just the point -- people who don't understand real AGI don't understand what the real risks are and aren't (and certainly can't mediate them).

Self-modifying AI is the point behind FOOM. I'm not sure why you're connecting self-modification/FOOM/singularity with symbolic programming (I assume you mean GOFAI), but everyone I'm aware of who thinks FOOM is plausible thinks it will be because of self-modification.

Comment author: brandyn 09 September 2013 05:47:29AM 0 points [-]

Yes, I understand that. But it matters a lot what premises underlie AGI how self-modification is going to impact it. The stronger fast-FOOM arguments spring from older conceptions of AGI. Imo, a better understanding of AGI does not support it.

Thanks much for the interesting conversation, I think I am expired.

Powered by Reddit Powered by Reddit