Perplexed comments on Consciousness of simulations & uploads: a reductio - Less Wrong

1 Post author: simplicio 21 August 2010 08:02PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (139)

You are viewing a single comment's thread. Show more comments above.

Comment author: cousin_it 22 August 2010 02:39:43PM *  1 point [-]

The situation with UDT is mysterious.

  1. A UDT agent is a sort of ethereal thing, a class of logically-equivalent algorithms (up to rewriting and such) that can never believe it "sees" one universe - only the equivalence class of universes that gave it equivalent sensory inputs up to now. Okay, I can agree that it's meaningless to ask "where" you are in the universe. But it doesn't seem meaningless to ask you for your beliefs about your future sensory input #11, given sensory inputs #1-#10. Unfortunately, it's hard to see how you can define such credences - the naive idea is to count different instantiations of the algorithm within the world program, but we just threw away our concept of what counts as an "instance".

  2. The equivalence class of algorithms is wider than one might think. For example, if (by way of some tricky mathematical fact) the algorithm's output is in fact independent from the value of one of the inputs, say input #11, then the algorithm cannot "perceive" that input. In other words, you cannot register any sensation that doesn't end up affecting your actions in the future. Weird, huh.

Comment author: Perplexed 22 August 2010 03:18:53PM 2 points [-]

if (by way of some tricky mathematical fact) the algorithm's output is in fact independent from the value of one of the inputs, say input #11, then the algorithm cannot "perceive" that input. In other words, you cannot register any sensation that doesn't end up affecting your actions in the future. Weird, huh.

You all may be interested in some recent (since 1990 or so) work in theoretical computer science dealing roughly with "what is observationally equivalent with what". Google for strings including the keywords "bisimulation", "process algebra", and "observational equivalence". Or maybe not - it is unclear to me what you think the problem really is.