BrienneYudkowsky comments on How to Measure Anything - LessWrong

50 Post author: lukeprog 07 August 2013 04:05AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread.

Comment author: BrienneYudkowsky 07 August 2013 06:21:26AM *  8 points [-]

Wow, this is really exciting. I thought at first, "Man, quantifying my progress on math research sounds really difficult. I don't know how to make it more than a measure of how happy I feel about what I've done."

But I'm only through step one of this post, and I've already pinned down the variables defining "progress on math research" such that measuring these periodically will almost certainly keep me directly on track toward the answer. I can probably make it better (suggestions welcome), but even this first pass saves me lots of grief. Wasted motion is probably my biggest problem with learning math right now, so this totally rocks. Check it out!

Progress is reduction of expected work remaining.

-Number of new things I understand (by proposition). -Change in degree to which I understand old things. -How central these things are to the problem. -Number of things (namely propositions, definitions, rules/instructions) I’ve written down that seem likely to be useful reference later. -Probability that they will be important. -Amount of material produced (in propositions or subsections of proof) that, if correct, will actually be part of my answer in the end. -Number of actions I’ve taken that will increase the values of the above variables. -Degree to which they’ll increase those values.

Thanks, Luke!

Comment author: wedrifid 07 August 2013 07:46:10AM 5 points [-]

Progress is reduction of expected work remaining.

No it isn't. Those things are often correlated but not equivalent. New information can be gained that increases the expected work remaining despite additional valuable work having been done.

Comment author: Eliezer_Yudkowsky 07 August 2013 05:09:26PM 11 points [-]

Progress is reduction of expected work remaining compared to your revised expectation of how much work remained yesterday.

Comment author: owencb 07 August 2013 05:59:02PM 4 points [-]

That seems to be a better fit for the impression of progress. You wouldn't tend, in retrospect, to call it progress if you realised you'd been going in completely the wrong direction.

This would fit with progress simply be the reduction of work remaining.

Comment author: RobbBB 07 August 2013 08:58:32PM 2 points [-]

Right. I think this is more an operationalization than a strict definition.

Comment author: BrienneYudkowsky 08 August 2013 01:42:19AM 0 points [-]

Yes, what RobbBB said.

Comment author: ChrisHibbert 10 August 2013 05:15:39PM 1 point [-]

|New information can be gained that increases the expected work remaining despite additional valuable work having been done.

That's progress.

Comment author: wedrifid 10 August 2013 07:25:45PM 1 point [-]

|New information can be gained that increases the expected work remaining despite additional valuable work having been done.

That's progress.

Yes. That is the point.