homunq comments on Attention Lurkers: Please say hi - Less Wrong

35 Post author: Kevin 16 April 2010 08:46PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (617)

You are viewing a single comment's thread. Show more comments above.

Comment author: homunq 27 July 2010 01:09:30AM *  7 points [-]

I posted a diary, and it was banned for containing a dangerous idea. I can understand that certain ideas are dangerous; in fact, in the discussion I started, I consciously refrained from expressing several sub-points for that reason, starting with my initial post. But I think that if there's such a policy, it should be explicit, and there should be some form of appeal. If the very discussion of these issues shouldn't happen in public, then there should be a private space to give whatever explanation can be given of why. A secret, unappealable rule which cannot even be discussed - this is not the path to rationalism, it's the way down the rabbit hole.

Comment author: Eliezer_Yudkowsky 27 July 2010 01:58:44AM 0 points [-]
Comment author: MBlume 27 July 2010 02:23:54AM 5 points [-]
Comment author: dclayh 27 July 2010 02:37:59AM 3 points [-]
Comment author: homunq 06 August 2010 11:06:37PM *  9 points [-]

Nor writing "Bloody Mary" in lipstick on mirrors?

Seriously, my post was about why that stuff is not scary. Fiction can be good allegory for reality, but those stories all use a lot of you-should-be-scared tricks, all very well and good for ghost stories, but not conducive to actual discussion.

We are swimming in a soup of sirens' songs, every single day. Dangerous ideas don't just exist, they abound. But I see no evidence of any dangerous ideas which are not best fought with some measure of banality, among other tactics. The trappings of Avert Your Eyes For That Way Lies Doom seem to be one of the best ways to <strong>enhance</strong> the danger of an idea.

In fact... what if Eliezer himself... no, that would be too horrible... oh my god, it's full of stars. (Or, in serious terms: I'm being asked to believe not just in a threat, but also that those who claim to protect us have some special immunity, either inherent or acquired; I see no evidence for either proposition).

Gah, it's incredibly annoying to try to talk about something without being too explicit. The more explicit I get in my head, the more ridiculous this whole charade seems to me. Of course I can find plenty of rational arguments to support that, but I also trust the feeling. I'm participationg in the "that which must not be mentioned" dance out of both respect and precaution, but honestly, it's mostly just respect. You're smart people and high status in this arena and I probably shouldn't laugh at your bugaboos.

Comment author: wedrifid 01 September 2010 12:26:15PM *  9 points [-]

I'm participationg in the "that which must not be mentioned" dance out of both respect and precaution, but honestly, it's mostly just respect.

Just to point out some irony - I'm participating in the "that which must not be mentioned" dance out of lost respect. I no longer believe Eliezer is able to consider such questions rationally. Anyone who wants to have a useful discussion on the subject must find a place outside of Eliezer's influence to do it. For much the same reason I don't try to discuss the details of biology in church.

Comment author: timtyler 01 September 2010 12:25:10PM *  3 points [-]

Gah, it's incredibly annoying to try to talk about something without being too explicit. The more explicit I get in my head, the more ridiculous this whole charade seems to me.

FWIW, it seems pretty ridiculous to me too. It might be funny - were it not so negative.

I'm participationg in the "that which must not be mentioned" dance out of both respect and precaution, but honestly, it's mostly just respect.

Plus, if you don't do the dance just right, your comments get deleted by the moderator.

Comment author: thomblake 11 August 2010 09:05:56PM 3 points [-]

So apparently either "that which can be destroyed by the truth should be" is false, or you've written dangerous falsehoods which would overtax the rationality of our readers. Eliezer's response above seems to imply the former.

Comment author: homunq 12 August 2010 06:45:18AM 0 points [-]

Did you read the "riddle theory" link? The riddle is not dangerous because it's false, but because it's incomprehensible.

And of course, if you meant to list all the possibilities, you left out the ones where E. is just wrong about the danger.

Comment author: timtyler 31 August 2010 09:03:20PM 0 points [-]

My comparison at the time was to The Ring.

Comment author: cousin_it 11 August 2010 09:12:29PM 2 points [-]

(Or, in serious terms: I'm being asked to believe not just in a threat, but also that those who claim to protect us have some special immunity, either inherent or acquired; I see no evidence for either proposition).

Very good question, but AFAIK Eliezer tries to not think the dangerous thought, too.

I'm participationg in the "that which must not be mentioned" dance out of both respect and precaution, but honestly, it's mostly just respect.

Seconded.

Comment author: timtyler 31 August 2010 09:18:24PM *  2 points [-]

AFAIK Eliezer tries to not think the dangerous thought, too.

I don't think there was ever any good evidence that the thought was dangerous.

At the time I argued that youthful agents that might become powerful would be able to promise much to helpers and to threaten supporters of their competitors - if they were so inclined. They would still be able to do that whether people think the forbidden thought or not. All that is needed is for people not to be able to block out such messages. That seems reasonable - if the message needs to get out it can be put into TV adverts and billboards - and then few will escape exposure.

In which case, the thought seems to be more forbidden than dangerous.

Comment author: jimrandomh 31 August 2010 10:54:24PM 4 points [-]

I don't think there was ever any good evidence that the thought was dangerous. ... In which case, the thought seems to be more forbidden than dangerous.

If there was any such evidence, it would be in the form of additional details, and sharing it with someone would be worse than punching them in the face. So don't take the lack of publically disclosed evidence as an indication that no evidence exists, because it isn't.

Comment author: wedrifid 02 September 2010 09:05:19PM 4 points [-]

So don't take the lack of publically disclosed evidence as an indication that no evidence exists, because it isn't.

It actually is, in the sense we use the term here.

Comment author: SilasBarta 02 September 2010 09:57:16PM 2 points [-]

Exactly. One must be careful to distinguish between "this is not evidence" and "accounting for this evidence should not leave you with a high posterior".

Comment author: timtyler 31 August 2010 11:20:11PM *  1 point [-]

I think we already had most of the details, many of them in BOLD CAPS for good measure.

But there is the issue of probabilities - of how much it is likely to matter. FWIW, I do not fear thinking the forbidden thought. Indeed, it seems reasonable to expect that people will think similar thoughts more in the future - and that those thoughts will motivate people to act.

Comment author: jimrandomh 01 September 2010 12:10:53AM 1 point [-]

I think we already had most of the details, many of them in BOLD CAPS for good measure.

No, you haven't. The worst of it has never appeared in public, deleted or otherwise.

Comment author: FAWS 31 August 2010 09:27:33PM *  4 points [-]

It's not a special immunity, it's a special vulnerability which some people have. For most people reading the forbidden topic would be safe. Unfortunately most of those people don't take the matter serious enough so allowing them to read it is not safe for others.

EDIT: Removed first paragraph since it might have served as a minor clue.

Comment author: homunq 01 September 2010 03:03:58PM *  1 point [-]

Interesting.

Well, if that's the case, I can state with high confidence that I am not vulnerable to the forbidden idea. I don't believe it, and even if I saw something that would rationally convince me, I am too much of a constitutional optimist to let that kind of danger get me.

So, what's the secret knock so people will tell me the secret? I promise I can keep a secret, and I know I can keep a promise. In fact, the past shows that I am more likely to draw attention to the idea accidentally, in ignorance, than deliberately.

(Of course, I would have to know a little more about the extent of my promise before I'd consider it binding. But I believe I'd make such a promise, once I knew more about its bounds.)

Comment deleted 01 September 2010 05:08:41PM *  [-]
Comment author: PhilGoetz 31 August 2010 09:34:40PM 4 points [-]

If we're going to keep acquiring more banned topics, there ought to be a list of them somewhere.

You just lost the game.

Comment author: homunq 07 August 2010 11:26:28PM *  0 points [-]

Response to this above. (attached to grandchild)

Comment author: PhilGoetz 31 August 2010 09:30:28PM 0 points [-]

What? Is this separate from the recent Banned Post? Is this a different idea?

Comment author: FAWS 31 August 2010 09:35:29PM *  1 point [-]

It was a counter argument against the dangerous topic being dangerous, which by necessity touched the dangerous topic and which wasn't strong enough to justify this (anyone for whom the dangerous topic actually would be dangerous [rather than just causing nightmares] would almost by necessity already be aware of a stronger argument).

Comment author: homunq 01 September 2010 02:55:49PM 1 point [-]

Interesting. Thanks, uprated; with the caveat that of course, we only have your word that the other argument is "stronger".

Without further evidence, it's my rationality plus consideration of the issue minus overconfidence against yours. You have an advantage on consideration, since you know both arguments while I only know that I know one; however, on the whole, I think it would be pathological for me to abandon my argument and belief just on that basis. As for the other aspects, we're both probably smarter and less biased than average people, and I don't see any argument to swing that.

In other words, I still think I'm right.