shminux comments on Are there really no ghosts in the machine? - Less Wrong

0 Post author: kingmaker 13 April 2015 07:54PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread.

Comment author: shminux 13 April 2015 08:55:05PM 2 points [-]

We are no longer designing an AI from scratch and then implementing it; we are creating a seed program which learns from the situation and alters its own code with no human intervention, i.e. the machines are starting to write themselves, e.g. with google's deepmind.

Arguably, not knowing in detail how your creation works is a detriment, not a boon. This point has been raised multiple times, most recently by Bostrom in Superintelligence, I believe. Consider reading it.

Comment author: kingmaker 13 April 2015 08:59:11PM *  1 point [-]

I never said not understanding our creations is good; I only said AI research was successful. I have not read Superintelligence, but I appreciate just how dangerous AI could be.