jstults comments on Two Challenges - Less Wrong

14 Post author: Daniel_Burfoot 14 February 2010 08:31AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (13)

You are viewing a single comment's thread.

Comment author: jstults 17 February 2010 07:29:38PM 0 points [-]

<blockquote>On the basis of these remarks I submit the following qualified statement: while the belief network paradigm is mathematically elegant and intuitively appealing, it is NOT very useful for describing real data.</blockquote>

The challenge is just as wrong; to <A href="http://en.wikipedia.org/wiki/Artificial_intelligence">quote from the wiki</a>: <blockquote>Classifier performance depends greatly on the characteristics of the data to be classified. There is no single classifier that works best on all given problems; this is also referred to as the "no free lunch" theorem. Determining a suitable classifier for a given problem is still more an art than science.</blockquote>

Russell and Norvig, 1st ed. has a good example comparing the performance of a Bayes net with a decision tree on data that was generated by a decision tree-like process, of course the net did not perform as well as a decision tree on that data, surprise, surprise.

Comment author: Daniel_Burfoot 18 February 2010 02:40:12AM 1 point [-]

I don't understand what you mean by the claim "the challenge is just as wrong". Of course I'm aware of the NFL theorem. I'm also aware that data from the real world has structure that can be exploited to achieve better results than the NFL theorem seems to permit; if this weren't true, the field of machine learning would be pointless. My claim is that the belief networks framework doesn't really match that real world structure in most cases (but I'm ready to be proved wrong and in fact that's my motivation for making the challenge).

Comment author: Cyan 17 February 2010 07:36:06PM 1 point [-]

Welcome to LessWrong!

To fix your markup, see the Help tab just below the comment box on the right side.