I've raised arguments for philosophical scepticism before, which have mostly been argued against in a Popper-esque manner of arguing that even if we don't know anything with certainty, we can have legitimate knowledge on probabilities.
The problem with this, however, is how you answer a sceptic about the notion of probability having a correlation with reality. Probability depends upon axioms of probability- how are said axioms to be justified? It can't be by definition, or it has no correlation to reality.
I think De Finetti's justification is fine as far as it goes, but it doesn't go quite as far as people think it does. Here's a couple dialogues to illustrate my point.
Dialogue 1
A: I have secretly flipped a fair coin and looked at the result. What's your probability that the coin came up heads?
B: I guess it's 50%.
A: Great! Will you accept a bet against me that the coin came up heads, at 1:1 odds?
B: Hmm, no, that doesn't seem fair because you already know the outcome of the coinflip and chose the bet accordingly.
A: So rational agents shouldn't necessarily accept either side of a bet according to their stated beliefs?
B: I suppose so.
Dialogue 2
A: I believe the sky is green with probability 90% and also blue with probability 90%.
B: Great! I can Dutch book you now. Here's a bet I want to make with you.
A: No, I don't wanna accept that bet. The theory doesn't force me to, as we learned in Dialogue 1.
That people often raise these objections is the reason why I prefer Savage's theorem as a decision-making foundation for probability.