Why expect unintended consequences to oppose ones preferences? The biases weren't created by processes that cared about your preferences.

Yeah, but our preferences were caused by the same thing as our biases, right? At the very least, shouldn't we expect our preferences to be highly entangled with our biases because of their common origin?