In my mind, Joe has a probability 5/6 of having rolled a six. In Joe's mind, he has a probability 1/6 of having rolled a six. These are two different questions.

While they are two different questions, you both have the same evidence and the same priors. They are symmetric questions, and should have identical answers.