sketerpot comments on How to pick your categories - Less Wrong

59 [deleted] 11 November 2010 03:13PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

You are viewing a single comment's thread. Show more comments above.

Comment author: sketerpot 12 November 2010 10:50:59PM 2 points [-]

Misha's answer is almost always the right one, but you technically can project points into a higher-dimensional space using a kernel function. This comes up in Support Vector Machines where you're trying to separate two classes of data points by drawing a hyperplane between them. If your data isn't linearly separable, projecting it into a higher-dimensional space can sometimes help.

But most of the time, what you want to so is just measure everything you can think of, and let those measurements be your dimensions. When looking at rubes and bleggs, measure things like redness, blueness, roundedness, furryness, whatever you can think of. Each of those is one dimension. Before you know it, you've got a high-dimensional featurespace. Good luck dealing with it.