matt comments on Statistical Prediction Rules Out-Perform Expert Human Judgments - Less Wrong

68 Post author: lukeprog 18 January 2011 03:19AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (195)
Tags: prediction reasoning expert_systems

Comments (195)

You are viewing a single comment's thread. Show more comments above.

Comment author: matt 27 January 2011 07:03:46AM *  2 points [-]

These sound like powers I should acquire. Could you drop some further hints on:

  • "a command line tool to train a maxent model"
  • how you tested the accuracy of the model (tools that let you do that in the remaining minutes, rather than general principles)
Comment author: DanielVarga 27 January 2011 08:34:31AM *  3 points [-]

I used Zhang Le's tool. Note that it is a rather obscure thing, not an industry standard like say, the huge Weka and Mallet packages. It made very easy the tasks you ask for. When I had a train and test data featurized,

maxent -m gender.model train.data

built the model and

maxent -p -m gender.model test.data

told me its accuracy on the test data.

Powered by Reddit Powered by Reddit