metatroll comments on Natural selection defeats the orthogonality thesis - Less Wrong

-13 Post author: aberglas 29 September 2014 08:52AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (71)

You are viewing a single comment's thread. Show more comments above.

Comment author: shminux 29 September 2014 03:42:53PM 4 points [-]

This post is easy to criticize, but I wonder if someone could steelman it.

Comment author: metatroll 30 September 2014 06:39:05AM 3 points [-]

The way I see it, yes, Natural Selection defeats the Orthogonality Thesis. But Meta-Trolling - e.g. simulators choosing the fitness function - defeats Natural Selection; and then the Orthogonality Thesis defeats Meta-Trolling, because you can't know the value systems of the simulators, so sufficiently intelligent agents have to steelman phenomena (treat appearances as real). #trollosophy