This seems tricky. What is (I would guess) important about your situation is that you want to have more conversations with him. So hey, if you want to have more conversations, do things that will result in that happening.

If your number of conversations changes noticeably and that feeling doesn't go away, or you get the same feeling about something else instead, then yeah, maybe the root cause is something else. (It's like when I'm procrastinating and I feel like I really want to visit website X, and then I feel I really want to read book Y, but the feeling is really just "procrastination-feeling" from not wanting to start chore Z.)