drethelin comments on Open thread, September 2-8, 2013 - Less Wrong

0 Post author: David_Gerard 02 September 2013 02:07PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (376)

You are viewing a single comment's thread. Show more comments above.

Comment author: somervta 09 September 2013 01:13:10AM *  1 point [-]

He doesn't really make any relevant points.

The closest is this:

Contrary to singularity b.s., the AI you invent isn't going to rewrite the laws of physics and destroy the universe before you can hit control-C. Basic space, time, and energy limitations will likely confound your laptop's ambitions to take over the world for quite some time--plenty of time for those who best understand it to toy with what it really takes to make it friendly

Which is really just an assertion that you won't get FOOM (I mean, no one thinks it'll take less time than it takes you to hit Ctrl-C, but that's just hyperbole for writing style). He doesn't argue for that claim, he doesn't address any of the arguments for FOOM (most notably and recently: IEM).

Comment author: brandyn 09 September 2013 02:00:21AM 0 points [-]

"I mean, no one thinks it'll take less time than it takes you to hit Ctrl-C" -- by the way, are you sure about this? Would it be more accurate to say "before you realize you should hit control-C"? Because it seems to me, if it aint goin' FOOM before you realize you should hit control-C (and do so) then.... it aint goin' FOOM.

Comment author: drethelin 09 September 2013 04:08:17AM 1 point [-]

More importantly: If someone who KNOWS how important stopping it is sitting at the button, then they're more likely to stop it, but if someone is like "it's getting more powerful and better optimized! Let's see how it looks in a week!" is in charge, then problems.

Comment author: brandyn 09 September 2013 04:35:59AM 0 points [-]

Well, then, I hope it's someone like you or me that's at the button. But that's not going to be the case if we're working on FAI instead of AGI, is it...