Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

Unknown3 comments on That Alien Message - Less Wrong

111 Post author: Eliezer_Yudkowsky 22 May 2008 05:55AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (164)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Unknown3 23 May 2008 06:13:00AM 0 points [-]

Z.M. Davis, "I am consciously aware that 2 and 2 make 4" is not a different claim from "I am aware that 2 and 2 make 4." One can't make one claim without making the other. In other words, "I am unconsciously aware that 2 and 2 make 4" is a contradiction in terms.

If an AI were unconscious, it presumably would be a follower of Daniel Dennett; i.e. it would admit that it had no qualia, but would say that the same was true of human beings. But then it would say that it is conscious in the same sense that human beings are. Likewise, if it were conscious, it would say it was conscious. So it would say it was conscious whether it was or not.

I agree in principle that there could be an unconscious chatbot that could pass the Turing test; but it wouldn't be superintelligent.

Comment author: pnrjulius 09 April 2012 05:02:40AM 0 points [-]

If it says I have no qualia, it's wrong. Headaches fucking HURT, dammit. That's a quale.

And here's the point you seem to be missing: Yes, it can make the statement; but no, that does not mean it actually has the required capacities to make the statement true. It's trivially easy to write a computer program that prints out all manner of statements.