gwern comments on Slowing Moore's Law: Why You Might Want To and How You Would Do It - Less Wrong

22 Post author: gwern 10 March 2012 04:22AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (90)

You are viewing a single comment's thread. Show more comments above.

Comment author: CasioTheSane 10 March 2012 04:49:09AM *  5 points [-]

Are you actually suggesting that people attack chip fab plants in attempt to prevent WBE from occurring before de novo AGI?

I think if you were successful, you'd be more likely to prevent either from occurring than to prevent WBE from occurring first. It takes a whole lot of unfounded technological optimism to estimate that friendly de novo AGI is simple enough that an action like this would make it occur first, when we don't even know what the obstacles really are.

Comment author: gwern 10 March 2012 04:55:20AM 5 points [-]

Are you actually suggesting that people attack chip fab plants in attempt to prevent WBE from occurring before de novo AGI?

Maybe. What do your probability estimates and expected value calculations say?

It takes a whole lot of unfounded technological optimism to estimate that friendly de novo AGI is simple enough that an action like this would make it occur first

It would take a lot of optimism. Good thing I never suggested that.

Comment author: CasioTheSane 10 March 2012 05:28:04AM *  6 points [-]

What do your probability estimates and expected value calculations say?

I agree with your assessment that this would effectively delay WBE, and therefore increase the chances of it occurring last but I can't even guess at how likely that is to actually be effective without at least a rough estimate of how long it will take to develop de novo AGI.

Your idea is very interesting, but I'll admit I had a strong negative emotional reaction. It's hard for me to imagine any situation under which I would sit down and do some calculations, check them over a few times, and then go start killing people and blowing stuff up over the result. I'm not prepared to joint the Rational Liberation Front just yet.

//edit: I also really want to see where brain emulation research goes, out of scientific curiosity.

Comment author: John_Maxwell_IV 10 March 2012 06:47:29AM 5 points [-]

//edit: I also really want to see where brain emulation research goes, out of scientific curiosity.

This seems understandable, but I hope it isn't a significant factor in your decision making...