Why doesn't it make more sense to trust your own senses than other peoples? You have a LOT more evidence of them being accurate, than you do of anyone else's. Different brainstates correlate with different actual events with various degrees of reliability, but you'll always have a better sample size to gather correlational data about your own brainstates as compared to that of someone else.

before you hornswoggle someone into hanging out at your spooky mansion for a few weeks to make sure of seeing something weird, you are in "possession" of evidence(Eg a temporary occurrence that created a certain brainstate such as having thought to have seen something move or appear) that is convincing to you but not to anyone else. Once you actually start witnessing stuff with someone else, that's further, different evidence.