This paper is the closest I've ever seen to a fully Bayesian interpretation of SVMs; mind you, the authors still use "pseudo-likelihood" to describe the data-dependent part of the optimization criterion.

Neural networks are just a kind of non-linear model. You can perform Bayes upon them if you want.