MrMind comments on Open Thread, Jun. 29 - Jul. 5, 2015 - Less Wrong

5 Post author: Gondolinian 29 June 2015 12:14AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (210)

You are viewing a single comment's thread. Show more comments above.

Comment author: MrMind 01 July 2015 09:36:57AM 0 points [-]

But then I'm allowed to ask "why?", and if the answer is "because I say so", then I feel pretty confident to dismiss the expert.

But that's not even the stage I'm at. A book is not an interactive medium, so the act has gone like this:

  • book: Cross-validation!
  • me: "Gaaaak! That sounds like totally wrong! Is there anyone that can explain me either why this is right or, if it's actually wrong, what is the correct approach?"

I'm still searching for an answer...

Comment author: Wei_Dai 01 July 2015 11:25:15PM *  4 points [-]

I'm still searching for an answer...

Try this paper or page 403 of this textbook.

Also, although in this case there seems to be an available answer, I don't think it makes sense to always expect that. Sometimes people find a technique that tends to work in practice and then only later come up with a theoretical explanation of why it works. If you happen to live in the period in between...

Comment author: MrMind 02 July 2015 08:36:28AM 0 points [-]

If you happen to live in the period in between...

He! I've suddenly remembered that LW was founded exactly because the fields of AI and ML used too much frequentist (il)logic. The Sequence was about to restore sanity in the field.
Anyway, the textbook you mentioned seems pretty cool, thank you very much!

Comment author: ChristianKl 01 July 2015 10:19:16PM 1 point [-]

I'm no expert at machine learning. However as far as I remember the point of doing cross-validation is to find out whether your model is robust. Robustness is not a standard "Bayesian" concept. Maybe you don't appreciate it's value?

Comment author: MrMind 02 July 2015 08:39:08AM 0 points [-]

I would appreciate if there was en explanation of why something is done the way it is. Instead it's all about learning the passwords. Maybe it's just that the main textbook in the field is pedagogically bad, it wouldn't be the first time.

Comment author: ChristianKl 02 July 2015 12:07:03PM 0 points [-]

Getting deep understanding of a complex field like machine intelligence isn't easy. You shouldn't expect it to be easy and something that you can acquire in a few days.