But if the question has no basis in fact, like the question of whether morals are "real", then genes and enculturation will wholly determine your answer to it. Right?

Conventionally, it's genes, culture and environment. Most conventional definitions of culture don't cover all environmental influences, just those associated with social learning. However, not all learning is social learning. Some would also question the determinism - and pay homage to stochastic forces.