= 27d567bc2d48d9f40e9ccc20ea370b15)
SteveG comments on Superintelligence 12: Malignant failure modes - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (50)
Does the prevalence of fictional genies and the like influence your feelings on perverse instantiation?
Of course, there are two kinds of perversity.
Perversity is "a deliberate desire to behave in an unreasonable or unacceptable way; contrariness."
Fictional genies seek out ways to trick the requester on purpose, just to prove a point about rash wishes. The other kind of perverse agent doesn't act contrarily for the sake of being contrary. They act exactly to achieve the goal and nothing else; it's just that they go against implicit goals as a side effect.