I've sometimes semi-seriously played with the idea of checking out the local church

Churches can be nice for the community, even if you're atheist. Julia and I regularly [1] attend the local Quaker meeting, and occasionally go to churches with organs and singing. Neither of us believe, but that doesn't mean we can't go enjoy it.

[1] Actually, not recently. Hmm. But regularly up to a few months ago.