There's no single point at which distortion of beliefs becomes sufficiently large to register as "significant" - it's a gradualist thing

But to avoid turning this into a fallacy of gray, you still need to take notice of the extent of the effect. Neither working on a bias, nor ignoring the bias, are "defaults" - it necessarily depends on the perceived level of significance.