JoshuaZ comments on Why could you be optimistic that the Singularity is Near? - Less Wrong

22 Post author: gwern 14 July 2012 11:33PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (36)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 16 July 2012 02:32:45PM 1 point [-]

Why would you expect the opposite? Tight lower bounds have not been proven for most problems, much less algorithms produced which reach such bounds, and even in the rare cases where they have been, then the constant factors could well be substantially improved. And then there are hardware improvements like ASICs, which are no joking matter. I collected just a few possibilities (since it's not a main area of interest for me as it seems so obvious that there are many improvements left) in http://www.gwern.net/Aria%27s%20past,%20present,%20and%20future#fn3

Comment author: JoshuaZ 16 July 2012 05:11:12PM 0 points [-]

I'm not sure really. The conjectured limits in some cases are strong. Computational complexity is unfortunately an area where we have a vast difference between what we suspect and what we can prove. And the point about improvements in constant factors is very well taken- it is an area that's often underappreciated.

But at the same time, these are reasons to suspect that improvements will exist. Carl's comment was about improvement "surely" occurring which seems like a much stronger claim. Moreover, in this context, while hardware improvements are likely to happen, they aren't relevant to the claim in question which is about software. But overall, this may be a language issue, and I may simply be interpreting "surely" as a stronger statement than it is intended.

Comment author: gwern 16 July 2012 07:03:16PM 0 points [-]

Given the sheer economic value of improvements, is there any reason at all to expect optimization/research to just stop, short of a global disaster? (And even then, depending on the disaster...)

Comment author: JoshuaZ 16 July 2012 07:34:05PM 0 points [-]

No, not particularly that I can think of. The only examples where people stop working on optimizing a problem is when the problem has become so easy that it simply doesn't matter to optimize further, but such examples are rare, and even in those sorts, further optimization does occur just at a slower place.