You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Alsadius comments on Algorithmic Progress in Six Domains - Less Wrong Discussion

24 Post author: lukeprog 03 August 2013 02:29AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (30)

You are viewing a single comment's thread. Show more comments above.

Comment author: Alsadius 07 August 2013 01:47:32AM *  1 point [-]

This is my point - the algorithm challenge is to do a given compression task quickly, and Shannon has no limits I'm aware of on how fast that can be done. So there's no problem of approaching physical limits the way there would be for, say, "Encode this file in the smallest space possible".

Edit: The stuff below the line either wasn't there when I replied or I didn't see it. You're right though, if linear-time implementations already exist, then you're basically hard-bounded.

Comment author: IlyaShpitser 07 August 2013 04:49:35PM 0 points [-]

To be sure, constant factors matter a lot! But I think in this case the curve would be pretty boring.