steven0461 comments on Open Thread, August 2010-- part 2 - Less Wrong

3 Post author: NancyLebovitz 09 August 2010 11:18PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (369)

You are viewing a single comment's thread. Show more comments above.

Comment author: steven0461 10 August 2010 11:54:58PM 2 points [-]

We don't want them to advance quickly; we want them to advance with a low probability of screwing up permanently.

Comment author: jimrandomh 11 August 2010 12:17:34AM 0 points [-]

I don't think screwing up permanently becomes a real concern until the invention of nuclear weapons, and that's such a long ways ahead of the starting point for this exercise that I don't think we can influence how it goes.

Comment author: steven0461 11 August 2010 12:25:27AM 1 point [-]

Surely we can have nontrivial influence both on variables relating to specific technologies like nukes, and on general variables along the lines of "caution about technology".