You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

gwern comments on Stupid Questions August 2015 - Less Wrong Discussion

7 Post author: Grothor 01 August 2015 11:08PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (129)

You are viewing a single comment's thread. Show more comments above.

Comment author: Romashka 11 August 2015 04:56:42PM *  1 point [-]

There is a variable X, x belongs to [0, 100]. There are n ways of measuring it, among them A and B are widely used. For any given measurer, the difference between x(A) and x(B) can be up to 20 points. Between two any measurers, x(A)1 and x(A)2 can differ on average 10 points, likewise with B.

Measurer 1 wants to know if it is meaningful to compare her results, x(A)1, with Measurer 2's results, x(B)2. Does the interval in which the true x lies include 40 points?

If Measurer 1 herself establishes the difference between x(C)1 and x(D)1, where C and D are two other ways to measure x, how much more useful for any given Measurer 3 will be her results, if she also invites Measurer 2's opinion - that is, x(C)2 and x(D)2?

(Is this ok?)

Comment author: gwern 12 August 2015 12:46:44AM 2 points [-]

Here are some examples in R of the mentioned approaches including EVSI. Syntax-highlighted on Pastebin: http://pastebin.com/8090dgvB

For another example of VoI, see my draft essay http://gwern.net/Mail%20delivery