Comment on SotW: Be Specific

Sat, 07 Apr 2012 10:28:55 GMT

Hmm. So it takes super-intelligence to understand the goal.

I didn't say that. I did say that for "but it's complex!" to be an absolute limiting factor it would be required to be complex even to an FAI.

So let me get this straight: this works by setting off a self improving AI that gets super intelligent and then becomes friendly?

It had better start Friendly, if it doesn't you are just asking for trouble. Obviously it wouldn't be as good at being Friendly yet when it isn't particularly smart.

Or do we build a super-intelligence right off, super intelligent on it's original computer?

That sounds implausible. We'd probably go extinct before we managed to pull that off.

Discuss