Since Eliezer considers it rational to prefer TORTURE to SPECKS, an FAI to his specification would presumably do the same. In either case, too bad if you're the one who gets TORTUREd. Maybe 3^^^3 people to SPECK will never be created, but what is one person compared with even the mere bazillions that FAI-assisted humanity might produce in mere billions of years? You need to make very sure you're one of the elect before creating God.
The parallels with Christian theology just keep coming. Thanks to Timeless Decision Theory, you were either saved or damned from the beginning. When you attain to the correct dispositions to be immune to counterfactual blackmail, you do not become saved, but discover that you always were. And do not delay, for "Every day brings you nearer to everlasting torments or felicity." "Your transgressions have sent up to heaven a cry for vengeance. You are actually under the curse of the Almighty." The Bible makes a lot of sense read as a garbled account of an AI that played around with the human race for a while and then went away.
an FAI to his specification would presumably do the same. In either case, too bad if you're the one who gets TORTUREd.
Which brings us back to... who is creating this unfriendly AI that is going to torture me and where do they live?
Some research says that lurkers make up over 90% of online groups. I suspect that Less Wrong has an even higher percentage of lurkers than other online communities.
Please post a comment in this thread saying "Hi." You can say more if you want, but just posting "Hi" is good for a guaranteed free point of karma.
Also see the introduction thread.