A nice part of the review article you mentioned:
Self-modeling occurs in a suitable virtual machine when the machine develops concepts for categorizing and labeling its own states as sensed by internal monitors. In this context, qualia are defined to be what virtual machines ‘‘refer to when referring to the objects of internal self observation’’ (Sloman & Chrisley, 2003).
And the referenced Molyneux paper's abstract
I show how a robot with what looks like a hard problem of consciousness might emerge from the earnest attempt to make a robot that is smart and self-reflective. This problem arises independently of any assumption to the effect that the robot is conscious, but deserves to be thought of as related to the human problem in virtue of the fact that (1) the problem is one the robot encounters when it tries to naturalistically reduce its own subjective states (2) it seems incredibly difficult from the robot’s own naturalist perspective and, most importantly, (3) it invites the robot to engage in the exact same metaphysical responses as humans offer to the problem of consciousness. Despite the fact that it invites the robot to consider extravagant metaphysical solutions, the problem I explore is purely algorithmic.
reminds me of the Jenann Ismael book I mentioned in my comment.
Does LW have a consensus on which books are worthwhile to read regarding consciousness? I read a small intro (Consciousness: A Very Short Introduction, Susan Blackmore, Oxford University Press), and the summary seems to be "Consciousness is pretty damn weird and no one seems to have much of a handle on it". As a non-technical layman, are there any useful books for me to read on the subject?
(I have started reading Daniel Dennet's Intuition Pumps, and I'm a bit torn. He seems highly respected by good scientists, but I feel that if the book didn't have his name on it, I would be well on my way to dismissing it. Are Dennet's earlier works on consciousness a good read?)