AlephNeil comments on Rationality Quotes: April 2011 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (384)
This is an important idea, but I don't think it can rescue the everyday intuition of the "inner light".
I can readily imagine an instantiation of your sort of "consciousness" in a simple AI program of the kind we can already write. No doubt it would be an interesting project, but mere self-representation (even recursive self-representation) wouldn't convince us that there's "something it's like" to be the AI. (Assume that the representations are fairly simple, and the AI is manipulating them in some fairly trivial way.)
Conversely, we think that very young children and animals are conscious in the "inner light" sense, even though we tend not to think of them as "recursively observing themselves". (I have no idea whether and in what sense they actually do. I also don't think "X is conscious" is unambiguously true or false in these cases.)