You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

RichardKennaway comments on I played the AI Box Experiment again! (and lost both games) - Less Wrong Discussion

35 Post author: Tuxedage 27 September 2013 02:32AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (123)

You are viewing a single comment's thread. Show more comments above.

Comment author: RichardKennaway 01 October 2013 03:14:28PM 3 points [-]

What is being referred to is the meme known as Roko's Basilisk, which Eliezer threw a fit over and deleted from the site. If you google that phrase you can find discussions of it elsewhere. All of the following have been claimed about it:

  • Merely knowing what it is can expose you to a real possibility of a worse fate than you can possibly imagine.

  • No it won't.

  • Yes it will, but the fate is easily avoidable.

  • OMG WTF LOL!!1!l1l!one!!l!

Comment author: Moss_Piglet 04 October 2013 03:55:57PM 0 points [-]

Wait, that's it? Seriously?

I'm not exactly fit to throw stones on the topic of unreasonable fears, but you get worse than this from your average "fire and brimstone" preacher and even the people in the pews walk out at 11 yawning.

Comment author: RichardKennaway 04 October 2013 05:12:37PM 4 points [-]

Googling the phrase "fear of hell" turns up a lot of Christian angst. Including recursive angst over whether you'll be sent to hell anyway if you're afraid of being sent to hell. For example:

I want to be saved and go to heaven and I believe, but I also have this terrible fear of hell and I fear that it may keep me out of heaven. PLEASE HELP!

And here's a hadephobic testament from the 19th century.

From the point of view of a rationalist who takes the issue of Friendly AGI seriously, the difference between the Christian doctrines of hell and the possible hells created by future AGIs is that the former is a baseless myth and the latter is a real possibility, even given a Friendly Intelligence whose love for humanity surpasses human understanding, if you are not careful to adopt correct views regarding your relationship to it.

A Christian sceptic about AGI would, of course, say exactly the same. :)

Comment author: Lumifer 04 October 2013 04:24:48PM 3 points [-]

Oh, all this excitement was basically a modern-day reincarnation of the old joke...

"“It seems a Christian missionary was visiting with remote Inuit (aka, Eskimo) people in the Arctic, and had explained to this particular man that if one believed in Jesus, one would would go to heaven, while those who didn’t, would go to hell.

The Inuit asked, “What about all the people who have never heard of your Jesus? Are they all going to hell?’

The missionary explained, “No, of course not. God wants you to have a choice. God is a merciful God, he would never send anyone to hell who’d never heard of Jesus.”

The Inuit replied, “So why did you tell me?”

Comment author: [deleted] 04 October 2013 05:32:45PM 1 point [-]

On the other hand, if the missionary tried to suppresses all mentions of Jesus, he would still increase the number of people who hear about him (at least if he does so in the 2000s on the public Internet), because of the Streisand effect.

<gd&r>