SarahC comments on Three kinds of political similarity - Less Wrong

7 [deleted] 23 October 2010 04:01PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (30)

You are viewing a single comment's thread.

Comment author: [deleted] 23 October 2010 09:30:42PM *  3 points [-]

In part 2, I sort of glossed over the technical stuff, but I was not talking about making up political dimensions like "more anti-war" and rating the answers to poll questions by hand. That is way too arbitrary for my taste. I'm talking about plain old dimensionality reduction. I had something like PCA in mind (if we were careful we might use a different method, but this is just illustrative.)

If you don't know about Principal Components Analysis, it's an important notion.

Wiki

Tutorial with a practical example

Another intro

The principle is that if you decide a priori what the "coordinates" are, you might pick wrong. You might not explain the variability in the data very well. Amazon.com doesn't have a pre-set category called "horror" and recommend you horror movies based on the fact that you've watched other horror movies. Amazon gauges "similarity" based on coordinates that arise naturally from the data (and maybe don't easily correspond to a property that can be given an English name.)

Maybe I'll write a top-level post explaining this sometime, if it isn't common knowledge.

Comment author: MatthewW 23 October 2010 09:51:31PM 1 point [-]

Principal component analysis of UK political views, from a few years back: http://politicalsurvey2005.com/themap.pdf

Comment author: [deleted] 23 October 2010 10:05:11PM 0 points [-]

Thanks -- that's roughly what I was talking about.

Comment author: andreas 23 October 2010 09:42:24PM 0 points [-]

A pdf of the nature intro is here.