Eliezer_Yudkowsky comments on Nonparametric Ethics - Less Wrong

27 Post author: Eliezer_Yudkowsky 20 June 2009 11:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (56)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 21 June 2009 04:24:20PM 0 points [-]

Well, yes. Nonparametric methods use similarity of neighbors. To predict that which has never been seen before - which is not, on its surface, like things seen before - you need modular and causal models of what's going on behind the scenes. At that point it's parametric or bust.

Comment author: Nick_Hay 21 June 2009 10:23:36PM *  6 points [-]

Your use of the terms parametric vs. nonparametric doesn't seem to be that used by people working in nonparametric Bayesian statistics, where the distinction is more like whether your statistical model has a fixed finite number of parameters or has no such bound. Methods such as Dirichlet processes, and its many variants (Hierarchical DP, HDP-HMM, etc), go beyond simple modeling of surface similarities using similarity of neighbours.

See, for example, this list of publications coauthored by Michael Jordan: