I also find algorithmic information theory (and especially algorithmic probability) to be a really fun and rewarding topic. Hutter has an excellent article on Scholarpedia here, and Hutter, Legg, and Vitanyi have another good article here.

I haven't looked at cryptography much, is there anything in particular in the field that is useful for thinking about e.g. decision theory or game theory for AGI?