David_Allen comments on The conscious tape - Less Wrong

11 Post author: PhilGoetz 16 September 2010 07:55PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (113)

You are viewing a single comment's thread. Show more comments above.

Comment author: Nisan 16 September 2010 11:20:01PM 5 points [-]

This question arises when I consider the moral status of intelligent agents. If I encounter a morally-significant dormant Turing machine with no input devices, do I need to turn it on?

If yes, notice that state N of the machine can be encoded as the initial state of the machine plus the number N. Would it suffice to just start incrementing a counter and say that the machine is running?

If I do not need to turn anything on, I might as well destroy the machine, because the Turing machine will still exist in a Platonic sense, and the Platonic machine won't notice if I destroy a manifestation of it.

David Allen notes that consciousness ought to be defined relative to a context in which it can be interpreted; somewhat similarly, Jacob Cannell believes that consciousness needs some environment in order to be well-defined.

I think the answer to my moral question is that the rights of an intelligent agent can't be meaningfully decomposed into a right to exist and a right to interact with the world.

Comment author: David_Allen 17 September 2010 12:05:39AM *  2 points [-]

David Allen notes that consciousness ought to be defined relative to a context in which it can be interpreted; somewhat similarly, Jacob Cannell believes that consciousness needs some environment in order to be well-defined.

Good summary. Yes my statements are in part a recasting of the functionalism philosophy mentioned by Jacob Cannell, in terms of the context principle, which I describe here.