= 27d567bc2d48d9f40e9ccc20ea370b15)
Raemon comments on Anyone read Erfworld? - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (30)
Have YOU figured out how to remove Stanley? (Bear in mind that he's under thinkamancy that forces him to serve, which presumably means not to try and figure out a way not to have to serve).
Thinkamancy is specified to have a loophole where you can seek their 'higher good', as exhibited already by what's-her-name.
For Hamster, it's really obvious that having Stanley in control is seriously endangering Stanley's project of world domination. On a more philosophical ground, he's failing to grow and is becoming unhappier as his limits become obvious even to him. That's two ways in which Stanley's removal is an improvement.
How could he remove Stanley's control? The thinkamancy could be undone by a turnermancer (like the one recently introduced, working for Charlie) and there's apparently a -mancy which specializes just in undoing other -mancies (one example given being undoing a flying bonus). Or heck, he could just ask his mathamancy artifact; I mean, if it can answer questions like 'will Charlie regret blowing all his calculations on question X?', it should be able to answer a question like how to undo his loyalty.
It doesn't matter if he could escape if he wanted to, because he couldn't want to escape unless he already had done so. Friendliness is stable under self-modification.
Edit: I managed to type that whole thing without quite realizing how perfect Parson is as a lay-accessible model for what an alien intelligence looks like. The perversity of his ingenuity, stemming from the fact that he doesn't share the prejudices of the people around him, is a major part of what people fail to anticipate in AI.