I sleep-talk. In fact, I don't just talk in my sleep, I can carry on a conversation. Advice and insight I have is much lower quality than when I'm awake, but I'm mostly coherent. Once someone recorded a conversation with me, and it was pretty funny. For example: "A lot of people like Batman. We should buy stock in Batman".
I'm not conscious, though. I'm not self-aware. If I have qualia, it's a very tiny amount of qualia. I definitely wouldn't wonder "do I have qualia?" If I didn't keep waking up, there wouldn't be a moral reason for others not to treat me how they find most convenient.
What does this mean? It means that Nonsentient Optimizers and Nonperson Predicates are definitely possible. There is some threshold of intelligence and/or self-awareness needed to change a neural net into a person.
(Lucid dreaming is a separate issue. I'm talking about something that happens even when not lucid dreaming.)
Also, people in the comments keep saying maybe I did have consciousness and just don't remember it. No: the conversation quality is sort of like this. When people talk to me, my response is usually connected to what they said, but I'm definitely not conscious.
I do this too. As does my 5yo, and at least one of my siblings. And, yes, the conversation seems most like a decent predictive text algorithm. I have no reason to expect that's not exactly what's going on in those moments: some parts of the brain are active, resulting in some of the interactive subroutines being available, but it isn't anywhere near coordinated or sophisticated enough to add up to anything that resembles the usual thing people mean when they talk about "consciousness".