In my mind, Joe has a probability 5/6 of having rolled a six. In Joe's mind, he has a probability 1/6 of having rolled a six. These are two different questions.
While they are two different questions, you both have the same evidence and the same priors. They are symmetric questions, and should have identical answers.
I saw this conundrum at Alexander Pruss's blog and I thought LWers might enjoy discussing it: