Jonathan_Graehl comments on The bias shield - Less Wrong

18 Post author: PhilGoetz 31 December 2011 05:44PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (65)

You are viewing a single comment's thread.

Comment author: Jonathan_Graehl 31 December 2011 06:38:29PM *  1 point [-]

Great illustration. For vector similarity, I recommend cosine similarity, and if you want it to extend to infinity, the (negative) logarithm of something between 0 and 1 is good. However, I guess your model is pretty arbitrary already, so I can't vouch for my suggestion in the context of improving your model's predictiveness.

Disclaimer: since you're modeling intensity of belief, cosine similarity (which ignores vector length) alone wouldn't even apply. I guess since you're using dotproduct already, my suggestion missed the mark. It does seem like, by squaring, you're declaring diametrically opposed vectors the same as colinear ones (i.e. negative dotproduct becomes positive when squared).