TheOtherDave comments on Welcome to Less Wrong! (2012) - Less Wrong

25 Post author: orthonormal 26 December 2011 10:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (1430)

You are viewing a single comment's thread. Show more comments above.

Comment author: TheOtherDave 26 April 2012 09:57:01PM 1 point [-]

OK, I think I understand better now.

Yeah, I've been talking throughout about what you're labeling "AI" here. We agree that these won't necessarily self-improve. Awesome.

With respect to what you're labeling "AGI" here, you're saying the following:
1) given that X is an AGI developed by humans, the probability that X has thus far been capable of recursive self-improvement is very high, and
2) given that X has thus far been capable of recursive self-improvement, the probability that X will continue to be capable of recursive self-improvement in the future is very high.
3) SIAI believes 1) and 2).

Yes? Have I understood you?

Comment author: Bugmaster 26 April 2012 11:42:38PM 0 points [-]

Yes, with the caveats that a). as far as I know, no such X currently exists, and b). my confidence in (3) is much lower than my confidence in (1) and (2).