gwern comments on Open Thread February 25 - March 3 - Less Wrong

8 Post author: Coscott 25 February 2014 04:57AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (354)

You are viewing a single comment's thread. Show more comments above.

Comment author: gwern 28 February 2014 04:21:35PM 3 points [-]

La Wiki is apparently not using the entropy estimates extracted from human predictions (who are the best modelers of natural language). Crude stuff like trigram models are going to considerably overestimate matters.