DuncanS comments on Consciousness of simulations & uploads: a reductio - Less Wrong

1 Post author: simplicio 21 August 2010 08:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (139)

You are viewing a single comment's thread.

Comment author: DuncanS 24 August 2010 10:18:20PM *  7 points [-]

One of the problems here is that of using our intuition on consciousness as a guide to processes well outside our experience. Why should we believe our common-sense intuition on whether a computer has consciousness, or whether a pencil and paper simulation has consciousness when both are so far beyond our actual experience? It's like applying our common sense understanding of physics to the study of atoms, or black holes. There's no reason to assume we can extrapolate that far intuitively with any real chance of success.

After that, there's a straight choice. Consciousness may be something that arises purely out of a rationally modellable process, or not. If the former, then the biological, computer program and pencil and paper Simone's will all be conscious, genuinely. If not, then there is something to consciousness that lies outside the reach of rational description - this is not inherently impossible in my opinion, but it does suggest that some entities which claim to be conscious actually won't be, and that there will be no rational means to show whether they are or not.

Comment author: pjeby 24 August 2010 11:32:05PM 2 points [-]

One of the problems here is that of using our intuition on consciousness as a guide to processes well outside our experience. Why should we believe our common-sense intuition on whether a computer has consciousness, or whether a pencil and paper simulation has consciousness when both are so far beyond our actual experience? It's like applying our common sense understanding of physics to the study of atoms, or black holes. There's no reason to assume we can extrapolate that far intuitively with any real chance of success.

Upvoted. I'm stealing this for use in future off-LW discussions of consciousness. ;-)

Comment author: Perplexed 25 August 2010 12:41:59AM 3 points [-]

Another topic that might be discussed is whether consciousness as self-awareness is at all related to moral status as in "Don't you dare pull the plug. That would be murder!". Personally, I don't see any reason why the two should be related. Perhaps we conflate them because both are mysteries and we think that Occam's razor can be used to economize on mysteries.