It depends on the competitions. All kaggle image-related competitions I have seen have been obliterated by deep neural networks.

I am a researcher, albeit a freshman one, and I completely disagree. Knowing about linear and logistic regressions is interesting because neural networks evolved from there, but it's something you can watch a couple of videos on, maybe another one about maximum likelihood and you are done. Not sure why SVMs are that important.