ArthurB comments on Mathematical simplicity bias and exponential functions - Less Wrong

12 Post author: taw 26 August 2009 06:34PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (82)

You are viewing a single comment's thread. Show more comments above.

Comment author: ArthurB 27 August 2009 06:24:28PM 2 points [-]

Question is, what do you mean "approximately".

If you mean, for any error size, the supremum of distance between the linear approximation and the function is lower than this error for all scales smaller than a given scale, then a necessary and sufficient condition is "continuous". Differentiable is merely sufficient.

When the function is differentiable, you can make claims on how fast the error decreases asymptotically with scale.

Comment author: Johnicholas 27 August 2009 09:44:26PM 0 points [-]

And if you use the ArthurB definition of "approximately" (which is an excellent definition for many purposes), then a piecewise constant function would do just as well.

Comment author: ArthurB 27 August 2009 10:05:57PM 0 points [-]

Indeed.

But I may have gotten "scale" wrong here. If we scale the error at the same time as we scale the part we're looking at, then differentiability is necessary and sufficient. If we're concerned about approximating the function, on a smallish part, then continuous is what we're looking for.