Regarding wireheading, it only just fully occurred to me that whoever has his happiest moment indefinitely duplicated in this Effective Altruist's pixie dust paperclipping fantasy is literally an infinite utility monster, whose psychopathic enjoyment in abusing others is therefore a big "plus".
Thus, replicating the triumph of ultimate evil is not just a possibility, but a logical necessity of wireheading: The vilest most selfish junkie-rapist-mass murderer is precisely who will most enjoy having an infinite hedonistic multiplier while everyone else's is zero.
In the end, inasmuch as their theory leads to wireheading, then the ultimate goal of Effective Altruists is maximal evil, infinitely replicated in a paperclipping of the entire universe.
Wow. Talk about a death cult!
Twelve years on, I edited the upstream article on LiveJournal to reflect this realization.
Regarding wireheading, it only just fully occurred to me that whoever has his happiest moment indefinitely duplicated in this Effective Altruist's pixie dust paperclipping fantasy is literally an infinite utility monster, whose psychopathic enjoyment in abusing others is therefore a big "plus".
Thus, replicating the triumph of ultimate evil is not just a possibility, but a logical necessity of wireheading: The vilest most selfish junkie-rapist-mass murderer is precisely who will most enjoy having an infinite hedonistic multiplier while everyone else's is zero.
In the end, inasmuch as their theory leads to wireheading, then the ultimate goal of Effective Altruists is maximal evil, infinitely replicated in a paperclipping of the entire universe.
Wow. Talk about a death cult!
Twelve years on, I edited the upstream article on LiveJournal to reflect this realization.