Or it's just that "lying" implies an attempt to deceive.

Words are meant to communicate meaning. I wouldn't consider it lying if someone communicates in a sense that properly answers the meaning of the question, even if the question is clumsily asked.

Likewise, I would consider it lying if someone uses words which are literally true, but does so in a manner meant to deceive the listener.