MartinB comments on Scientific Self-Help: The State of Our Knowledge - Less Wrong

138 Post author: lukeprog 20 January 2011 08:44PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (493)

You are viewing a single comment's thread. Show more comments above.

Comment author: MartinB 24 January 2011 07:29:46AM 2 points [-]

A good place to deconstruct my own argument.

The math comparison lacks in one important piece: Math is clearly defined, and has standard textbooks. If you ask around for recommendations on how to learn math you get similar responses, and will end up learning similar things - up to a certain degree. There is only one type of math! In general people agree on what math is, and what not.

PU as well as PD is a very broad, not clearly defined subject, that contains a mash-up of many other topics. It is contradictory. Done by amateurs who generally do not care about scientific results. You get advice that goes against those transported by the mainstream (which we on LW are somewhat used to in other contexts.) But you also find the statement that the subjects of your interest will generally give you bad advice and do not even know what works for them. As will your peers, your family, potential natural friends, the media, and anyone else who you could possibly ask. That makes for a very bad heuristic in regards to its truthfulness.

And then there is the annoying property of PD advice, that it is not only difficult to actually get, but that it also hurts. Sometimes we carry gaping holes that really hurt our social life, and no one has the guts to tell us, since they are afraid of a bad reaction.

One easy to understand example is trying to tell a colleague or friend that he needs to do something about his smell.

I am not aware of a safe way to navigate this. It would be interesting to see real scientists, or science minded people undertake this exploration. But there are way to many possibilities to have it go wrong.

PU does contain basilisks. So handle with care. And do not believe any one particular source completely.

Comment author: TobyBartels 25 January 2011 05:20:40AM *  4 points [-]

There is only one type of math! In general people agree on what math is, and what not.

The second sentence here is true, but the first one is false. There is mainstream math, and then there are alternatives. Of course, there are insane crackpot ideas, but there are also alternative forms of mathematics that are studied by serious researchers who earn tenure for it and prove valid theorems. Buzzwords to search for include "intuitionism", "constructive mathematics", "predicatvism", "finitism", and "nonclassical mathematics" generally.

This mostly only affects things from after the 19th century, however, so nothing significant about the mathematics that most people learn in school. Even going on to more advanced material, there is a very definite mainstream to follow, so this doesn't really affect your point; this is just a hobby horse of mine.

Comment author: MartinB 25 January 2011 05:55:09AM 0 points [-]

And Though shall get a geek point for it. I was kind of waiting for someone to point this out.

Comment author: TobyBartels 30 January 2011 03:34:56PM *  1 point [-]

And I should have mentioned "experimental mathematics", which is really different! This term can be interpreted in weak and strong ways; the former, in which experiments are a preliminary to proof, is normal, but the latter, in which massive computer-generated experimental results are accepted as a substitute for proof when proof seems unlikely, is different. The key point is that most true theorems that we can understand have no proofs that we can understand, a fact that can itself be proved (at least if if you use length of the text as a proxy for whether we can understand it).

Comment author: wedrifid 24 January 2011 07:59:10AM 3 points [-]

PU does contain basilisks.

Oooh, PU basilisks. Where? Show me!

Comment author: MartinB 24 January 2011 08:05:09AM 0 points [-]

Are you sure you want me to do that on a public forum? I do not want to have my account deleted for posting dangerous stuff.

Comment author: wedrifid 24 January 2011 08:09:27AM 1 point [-]

Then message me. The concept of a PU basilisk seems unlikely to me but still somewhat intriguing. The closest things I can imagine are in the form of disillusionment with ideals.

Comment author: Jack 24 January 2011 11:26:56PM 2 points [-]

It would be interesting to have a collection of basilisks somewhere, like an ammo dump for a mimetic war.

Comment author: wedrifid 25 January 2011 01:39:53AM 7 points [-]

It would be interesting to have a collection of basilisks somewhere, like an ammo dump for a mimetic war.

Absolutely! Maybe not on lesswrong, that might make some people cry. But I'd love to have a list somewhere else. And this can be considered an open request to send any basilisk spotted in the wild to me personally for examination.

I've yet to see a basilisk that was remotely intimidating to me. And would like to be able to further improve my resistance to exposure to new 'basilisks' while they are framed as basilisks so I am even less likely to be vulnerable to them in the wild.

A superintelligence would almost certainly be able to construct sentences that could hack my brain and damage it. Some humans could if they were able to put me in a suitable social or physical environment and ensure ongoing exposure (and environment and exposure are far more important than the abstract concepts conveyed). But things like "Roko's Basilisk" are just cute. You can tame them and keep them as pets. :)

Comment author: [deleted] 25 January 2011 04:27:51AM 2 points [-]

My perspective on this is very similar to yours. If you were sent any interesting PU basilisks, would you please forward them to me?

Comment author: wedrifid 25 January 2011 04:44:38AM 3 points [-]

Being careful not to criticise what was sent to me (and by so doing discourage others) I don't think what I was sent fits the term 'basilisk'. Instead I got some well thought out considerations and potential pitfalls that people may fall into along a PUA journey. In fact I think people would appreciate them being spoken publicly. Rather than "things that will kill you just by looking at them" they are things that you are better off looking at so you can avoid falling into them. Obviously the exceptional case is the pessimistic person who is looking for excuses not to try - which is not an uncommon mindset.

I would not repost them here (that would be discourteous) but I suggest that if the author did post his thoughts publicly they would be well received (ie. would get an 8+karma rating if the comment was not buried too deeply to gain exposure.)

Comment author: Jack 25 January 2011 04:08:12AM 2 points [-]

I violently agree with all of this. Have you seen any basilisk-like ideas besides roko's? Roko's at least looks like a real basilisk until you think about it. Everything else I've seen doesn't come close to living up to the name.

Comment author: wedrifid 25 January 2011 04:34:32AM 2 points [-]

I violently agree with all of this.

'Violent agreement' seems to have been adopted for use in situations in which the participants have been arguing aggressively only to discover that they agree on the substantive issues. For a term that hasn't been hijacked as jargon I go with "vehemently". It has a more visceral feel to it too. :)

Have you seen any basilisk-like ideas besides roko's? Roko's at least looks like a real basilisk until you think about it. Everything else I've seen doesn't come close to living up to the name.

Roko's is the most interesting I've seen too. Although for some people a combination of Pascal's Wager and certain religious doctrines about children not being held accountable for their beliefs until a certain age would do it. Once again it is the ability to apply abstract reasoning while at the same time the naivety and weakness in following the rational conclusion correctly that would cause the problem.

Comment author: Jack 25 January 2011 05:07:42AM *  3 points [-]

Anyone have a really solid working definition for 'basilisk' as we use it here?

Although for some people a combination of Pascal's Wager and certain religious doctrines about children not being held accountable for their beliefs until a certain age would do it.

Am I supposed to be able to see it from just this? Assuming it's not the kind of thing that would hurt LW posters can you explain? Otherwise, pm it?

One interesting idea is that it seems plausible to create basilisks that only effect your memetic/cognitively different enemies- perhaps the only way to avoid the harm of the basilisk is to deconvert from your religion/ideology. A basilisk that only worked on, say, religious fundamentalists would be a really powerful weapon (I'm not suggesting that the basilisk be capable of killing anyone, necessarily).

Comment author: wedrifid 25 January 2011 05:47:51AM 3 points [-]

Am I supposed to be able to see it from just this? Assuming it's not the kind of thing that would hurt LW posters can you explain?

  • Pascal's Wager -> Accept popular religion (Disclaimer: I did label these people naive and with an inability to take reasoning all the way to a sane conclusion. Nevertheless, it works on some intelligent people better than on some unintelligent people.)
  • There exist popular religious doctrines that God will send young children to heaven regardless because they are too young to have been able to do the conversion thing. I think the "Age Of Accountability" concept may be related.
  • If a child is not likely to convert to the 'True' religion in adulthood then they are (believed to be) likely to go to Hell instead of Heaven if they grow up.
  • Such a child would go to Heaven if murdered while young but Hell if they grow up.
  • Such a child would be better off in they are murdered.
  • Therefore...
Comment author: wedrifid 25 January 2011 05:34:51AM *  1 point [-]

Anyone have a really solid working definition for 'basilisk' as we use it here?

Knowledge or concepts, the comprehension of which will cause one significant disulitly.

Comment author: [deleted] 25 January 2011 03:44:52PM 0 points [-]

Am I supposed to be able to see it from just this? Assuming it's not the kind of thing that would hurt LW posters can you explain? Otherwise, pm it?

I think I know what wedrifid is getting at, but I don't think Pascal's Wager would do it. Pascal's Wager argues that one should act as if one believes in God because the costs are low and the potential benefits (Heaven) are high.

But in order to get to the particular failure state at which I think wedrifid is hinting, you can't just be betting on God -- you have to be absolutely certain that Heaven exists and that its joys outweigh on every axis everything that Earth has to offer. Most people, no matter what they say, are not that certain, which is why we don't routinely slaughter infants in order to ensure their blameless souls entry into Heaven. (Similar logic has been invoked to rationalize murders--such as innocent deaths at witch trials--but in these cases, as a justification pasted on after the fact rather than an honest motive towards murder.)

Comment author: MartinB 25 January 2011 05:59:39AM 0 points [-]

One interesting idea is that it seems plausible to create basilisks that only effect your memetic/cognitively different enemies

I am sure that this is possible, but wonder why it has not been done yet - or at least appeared on my radar. Might be one of the more darker arts, and a very interesting one!

Comment author: MartinB 25 January 2011 12:05:55AM 1 point [-]

No. It would be better to first develop defenses against them. Basilisks seem to only affect people of a certain mental capacity able to understand and process them. If you look up the Charles Langan interview, or his writings, or this Ted/Unabomba guy you see how really bright people can go wrong.

I would hate LW to contribute to that.

I want LWers and myself to not only have a realistic view of reality, but also be able to life in it and be happy and productive.

Comment author: Jack 25 January 2011 12:14:31AM 2 points [-]

I'm not sure how you develop defenses to Basilisks without know what they are. Unless we get lucky and there is a fully general countermeasure.

I was just talking about collecting them though- it's another question entirely whether or not the list should be public. One doesn't usually leave ammo dumps unlocked.

Comment author: wedrifid 25 January 2011 01:29:03AM 1 point [-]

Basilisks seem to only affect people of a certain mental capacity able to understand and process them.

And, probably more importantly, without certain other mental capacities that allow them to handle information appropriately.

Comment author: HughRistik 24 January 2011 08:12:42AM 0 points [-]

If you tell wedrifid privately, then you have to promise to tell me.

I have a few minor basilisks (not from PU alone, but from combining PU with psychometrics or feminism). Nothing so bad that I think it would make people want to ban me, but it might be disconcerting and depressing for many people, and some of it I'm still thinking through.

Comment author: wedrifid 24 January 2011 08:16:39AM 0 points [-]

combining PU with ... feminism

Did the two annihilate each other, destroying swathes of your cerebral cortex?

Comment author: wedrifid 24 January 2011 08:14:42AM 0 points [-]

If you tell wedrifid privately, then you have to promise to tell me.

Or I'll tell you. :)