I’m confused why you think looking at the rate and lumpiness of historical progress on narrowly circumscribed performance metrics is not meaningful, because it seems like you do seem to think that drawing straight lines is fine when compute is on the x-axis—which seems like a similar exercise. What’s going on there?

Mathematica is the most powerful solver I’ve come across (it’s basically Wolfram Alpha with additional computational time).