Lumifer comments on Ethics in a Feedback Loop: A Parable - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (136)
Stretching the metaphor: Suppose that many humans respond to having tentacles waved at them (whether or not they touch) by threatening to cut them off.
Suppose that Martians have a response that causes their tentacle-barbs to grow longer and pointier and stingier whenever they perceive a threat to their tentacles.
Where does this process lead?
Under your assumptions being a "regular" Green is an unstable state. Greens will be forced to evolve either into Blues or into superGreens with superstingy extra-long tentacles.
This is precisely the actual process that I observe, so there's +1 for this theory.