brazil84 comments on The $125,000 Summer Singularity Challenge - Less Wrong

20 Post author: Kaj_Sotala 29 July 2011 09:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (259)

You are viewing a single comment's thread. Show more comments above.

Comment author: brazil84 31 July 2011 04:05:27PM 3 points [-]

Here's a quote I found from the IBM research blog:

Watson calculates its uncertainty and learns which algorithms to trust under which circumstances, such as different Jeopardy! categories.

Seems to me that at a minimum, this shows that Watson does not ignore category titles.

Comment author: Sniffnoy 31 July 2011 07:28:21PM 3 points [-]

I didn't say it ignores categories -- it knows which questions go together in a category, and learns what to use for a given category as it sees question-answer pairs for it. What I said was that it ignores category titles.

However as it happened I was wrong about this; slight misremembrance, sorry. Watson does note category titles, it just doesn't weight them very highly. Apparently it learned this automatically during its training games. Source: http://www-03.ibm.com/innovation/us/watson/related-content/toronto.html