I'd say that if it started running a huge number of simulations of physical realities, and analyzing the intelligence of beings that resulted, that would fall squarely into the 'worrying level of intelligence' category.

In fact if it started attempting to alter the physics of the virtual world it's in at any level - either by finding some in-game way to hack the virtual world, or by running simulations of alternate physics - that would be incredibly worrying.