So, I have 1/6 probability for the 6, he has 1/6 probability for the 6 and one of us has the 6 for sure?
Yes.
[ETA]: It's important to remember that the probabilities are relative; you have odds of 1/6, you should posit odds of 5/6 for your twin. Likewise, your twin has odds of 1/6, and your twin should posit odds of 5/6 for you.
I saw this conundrum at Alexander Pruss's blog and I thought LWers might enjoy discussing it: