How would you know, or even what would make you think, that it was NOT conscious?

I'd examine the credentials and evidence of competence of the narrow AI engineer that created it and consult a few other AI experts and philosophers who are familiar with the particular program design.