Say, trying to understand how the abstractions we call "value" or "preference" emerge and under what conditions would be a start. For example, does Deep Blue have values? It certainly has preferences. What is the difference? How would one write an algorithm which has both/either? How competitive would these be and under what conditions? Maybe run a simulation or a dozen to test it.

You know, concentrate on answerable questions.