How do you choose your terminal values?
Short answer? We don't. Not really. Human beings have an evolved moral instinct. These evolutionary moral inclinations lead to us assigning a high value to human life and well-being. The closest internally coherent seeming ethical structure seems to be utilitarianism. (It sounds bad for a rationalist to admit "I value all human life equally, except I value myself and my children somewhat more.")
But we are not really utilitarians. Our mental architecture doesn't allow most of us to really treat every stranger on earth as though they are as valuable as ourselves or our own children.
How do you choose your terminal values?
Short answer? We don't. Not really. Human beings have an evolved moral instinct.
A longer answer looks at what 'choice' means a little more closely and wonders how tracable causality implies lack of choice in this instance and yet still manages to have any meaning whatsoever.
My girlfriend/SO's grandfather died last night, running on a treadmill when his heart gave out.
He wasn't signed up for cryonics, of course. She tried to convince him, and I tried myself a little the one time I met her grandparents.
"This didn't have to happen. Fucking religion."
That's what my girlfriend said.
I asked her if I could share that with you, and she said yes.
Just so that we're clear that all the wonderful emotional benefits of self-delusion come with a price, and the price isn't just to you.