You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Tyrrell_McAllister comments on S.E.A.R.L.E's COBOL room - Less Wrong Discussion

29 Post author: Stuart_Armstrong 01 February 2013 08:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (33)

You are viewing a single comment's thread. Show more comments above.

Comment author: Tyrrell_McAllister 02 February 2013 12:08:09AM 3 points [-]

It is good to taboo words, but it is also good to criticize the attempts of others to taboo words, if you can make the case that those attempts fail to capture something important.

For example, it seems possible that a computer could predict your actions to high precision, but by running computations so different from the ones that you would have run yourself that the simulated-you doesn't have subjective experiences. (If I understand it correctly, this is the idea behind Eliezer's search for a non-person predicate. It would be good if this is possible, because then a superintelligence could run alternate histories without torturing millions of sentient simulated beings.) If such a thing is possible, then any superficial behavioristic attempt to taboo "subjective experience" will be missing something important.

Furthermore, I can mount this critique of such an attempt without being obliged to taboo "subjective experience" myself. That is, making the critique is valuable even if it doesn't offer an alternative way to taboo "subjective experience".

Comment author: Qiaochu_Yuan 02 February 2013 03:23:51AM 5 points [-]

It's not clear to me that "understanding" means "subjective experience," which is one of several reasons why I think it's reasonable for me to ask that we taboo "understanding."

Comment author: Tyrrell_McAllister 02 February 2013 04:22:38AM 3 points [-]

I didn't mean to suggest that "understanding" means "subjective experience", or to suggest that anyone else was suggesting that.