brazil84 comments on The $125,000 Summer Singularity Challenge - Less Wrong

20 Post author: Kaj_Sotala 29 July 2011 09:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (259)

You are viewing a single comment's thread. Show more comments above.

Comment author: Sniffnoy 31 July 2011 01:03:03PM *  -1 points [-]

*shrug* I mean, if you want to claim that the makers of IBM coordinated to lie about this point, go ahead, but don't expect to me to bother discussing this with you at that point.

Comment author: brazil84 31 July 2011 04:05:27PM 3 points [-]

Here's a quote I found from the IBM research blog:

Watson calculates its uncertainty and learns which algorithms to trust under which circumstances, such as different Jeopardy! categories.

Seems to me that at a minimum, this shows that Watson does not ignore category titles.

Comment author: Sniffnoy 31 July 2011 07:28:21PM 3 points [-]

I didn't say it ignores categories -- it knows which questions go together in a category, and learns what to use for a given category as it sees question-answer pairs for it. What I said was that it ignores category titles.

However as it happened I was wrong about this; slight misremembrance, sorry. Watson does note category titles, it just doesn't weight them very highly. Apparently it learned this automatically during its training games. Source: http://www-03.ibm.com/innovation/us/watson/related-content/toronto.html