In my understanding, there’s no one who speaks for LW, as its representative, and is *responsible* for addressing questions and criticisms. LW, as a school of thought, has no agents, no representatives – or at least none who are open to discussion.
The people I’ve found interested in discussion on the website and slack have diverse views which disagree with LW on various points. None claim LW is true. They all admit it has some weaknesses, some unanswered criticisms. They have their own personal views which aren’t written down, and which they don’t claim to be correct anyway.
This is problematic. Suppose I wrote some criticisms of the sequences, or some Bayesian book. Who will answer me? Who will fix the mistakes I point out, or canonically address my criticisms with counter-arguments? No one. This makes it hard to learn LW’s ideas in addition to making it hard to improve them.
My school of thought (Fallible Ideas – FI – https://fallibleideas.com) has representatives and claims to be correct as far as is known (like LW, it’s fallibilist, so of course we may discover flaws and improve it in the future). It claims to be the best current knowledge, which is currently non-refuted, and has refutations of its rivals. There are other schools of thought which say the same thing – they actually think they’re right and have people who will address challenges. But LW just has individuals who individually chat about whatever interests them without there being any organized school of thought to engage with. No one is responsible for defining an LW school of thought and dealing with intellectual challenges.
So how is progress to be made? Suppose LW, vaguely defined as it may be, is mistaken on some major points. E.g. Karl Popper refuted induction. How will LW find out about its mistake and change? FI has a forum where its representatives take responsibility for seeing challenges addressed, and have done so continuously for over 20 years (as some representatives stopped being available, others stepped up).
Which challenges are addressed? *All of them*. You can’t just ignore a challenge because it could be correct. If you misjudge something and then ignore it, you will stay wrong. Silence doesn’t facilitate error correction. For information on this methodology, which I call Paths Forward, see: https://curi.us/1898-paths-forward-short-summary BTW if you want to take this challenge seriously, you’ll need to click the link; I don’t repeat all of it. In general, having much knowledge is incompatible with saying all of it (even on one topic) upfront in forum posts without using references.
My criticism of LW as a whole is that it lacks Paths Forward (and lacks some alternative of its own to fulfill the same purpose). In that context, my criticisms regarding specific points don’t really matter (or aren’t yet ready to be discussed) because there’s no mechanism for them to be rationally resolved.
One thing FI has done, which is part of Paths Forward, is it has surveyed and addressed other schools of thought. LW hasn’t done this comparably – LW has no answer to Critical Rationalism (CR). People who chat at LW have individually made some non-canonical arguments on the matter that LW doesn’t take responsibility for (and which often involve conceding LW is wrong on some points). And they have told me that CR has critics – true. But which criticism(s) of CR does LW claim are correct and take responsibility for the correctness of? (Taking responsibility for something involves doing some major rethinking if it’s refuted – addressing criticism of it and fixing your beliefs if you can’t. Which criticisms of CR would LW be shocked to discover are mistaken, and then be eager to reevaluate the whole matter?) There is no answer to this, and there’s no way for it to be answered because LW has no representatives who can speak for it and who are participating in discussion and who consider it their responsibility to see that issues like this are addressed. CR is well known, relevant, and makes some clear LW-contradicting claims like that induction doesn’t work, so if LW had representatives surveying and responding to rival ideas, they would have addressed CR.
BTW I’m not asking for all this stuff to be perfectly organized. I’m just asking for it to exist at all so that progress can be made.
Anecdotally, I’ve found substantial opposition to discussing/considering methodology from LW people so far. I think that’s a mistake because we use methods when discussing or doing other activities. I’ve also found substantial resistance to the use of references (including to my own material) – but why should I rewrite a new version of something that’s already written? Text is text and should be treated the same whether it was written in the past or today, and whether it was written by someone else or by me (either way, I’m taking responsibility. I think that’s something people don’t understand and they’re used to people throwing references around both vaguely and irresponsibly – but they haven’t pointed out any instance where I made that mistake). Ideas should be judged by the idea, not by attributes of the source (reference or non-reference).
The Paths Forward methodology is also what I think individuals should personally do – it works the same for a school of thought or an individual. Figure out what you think is true *and take responsibility for it*. For parts that are already written down, endorse that and take responsibility for it. If you use something to speak for you, then if it’s mistaken *you* are mistaken – you need to treat that the same as your own writing being refuted. For stuff that isn’t written down adequately by anyone (in your opinion), it’s your responsibility to write it (either from scratch or using existing material plus your commentary/improvements). This writing needs to be put in public and exposed to criticism, and the criticism needs to actually get addressed (not silently ignored) so there are good Paths Forward. I hoped to find a person using this method, or interested in it, at LW; so far I haven’t. Nor have I found someone who suggested a superior method (or even *any* alternative method to address the same issues) or pointed out a reason Paths Forward doesn’t work.
Some people I talked with at LW seem to still be developing as intellectuals. For lots of issues, they just haven’t thought about it yet. That’s totally understandable. However I was hoping to find some developed thought which could point out any mistakes in FI or change its mind. I’m seeking primarily peer discussion. (If anyone wants to learn from me, btw, they are welcome to come to my forum. It can also be used to criticize FI. http://fallibleideas.com/discussion-info) Some people also indicated they thought it’d be too much effort to learn about and address rival ideas like CR. But if no one has done that (so there’s no answer to CR they can endorse), then how do they know CR is mistaken? If CR is correct, it’s worth the effort to study! If CR is incorrect, someone better write that down in public (so CR people can learn about their errors and reform; and so perhaps they could improve CR to no longer be mistaken or point out errors in the criticism of CR.)
One of the issues related to this dispute is I believe we can always proceed with non-refuted ideas (there is a long answer for how this works, but I don’t know how to give a short answer that I expect LW people to understand – especially in the context of the currently-unresolved methodology dispute about Paths Forward). In contrast, LW people typically seem to accept mistakes as just something to put up with, rather than something to try to always fix. So I disagree with ignoring some *known* mistakes, whereas LW people seem to take it for granted that they’re mistaken in known ways. Part of the point of Paths Forward is not to be mistaken in known ways.
Paths Forward is a methodology for organizing schools of thought, ideas, discussion, etc, to allow for unbounded error correction (as opposed to typical things people do like putting bounds on discussions, with discussion of the bounds themselves being out of bounds). I believe the lack of Paths Forward at LW is preventing the resolution of other issues like about the correctness of induction, the right approach to AGI, and the solution to the fundamental problem of epistemology (how new knowledge can be created).
In the linked article, you seem to treat "refutation by criticism" as something absolute. Either something is refuted by criticism, or it isn't refuted by criticism; and in either case you have 100% certainty about which one of these two options it is.
There seems to be no space for situations like "I've read a quite convincing refutation of something, but I still think there is a small probability there was a mistake in this clever verbal construction". It either "was refuted" or it "wasn't refuted"; and as long as you are willing to admit some probability, I guess it by default goes to the "wasn't refuted" basket.
In other words, if you imagine a variable containing value "X was refuted by criticism", the value of this variable at some moment switches from 0 to 1, without any intermediate values. I mean, if you reject gradations of certainty, then you are left with a black-and-white situation where either you have the certainty, or you don't; but nothing in between.
If this is more or less correct, then I am curious about what exactly happens in the moment where the variable actually switches from 0 to 1. Imagine that you are doing some experiments, reading some verbal arguments, and thinking about them. At some moment, the variable is at 0 (the hypothesis was not refuted by criticism yet), and at the very next moment the variable is at 1 (the hypothesis was refuted by criticism). What exactly happened during that last fraction of a second? Some mental action, I guess, like connecting two pieces of a puzzle together, or something like this. But isn't there some probability that you actually connected those two pieces incorrectly, and maybe you will notice this only a few seconds (or hours, days, years) later? In other words, isn't the "refutation by criticism" conditional on the probability that you actually understood everything correctly?
If, as I incorrectly said in previous comments, one experiment doesn't constitute refutation of a hypothesis (because the experiment may be measured or interpreted incorrectly), then what exactly does? Two experiments? Seven experiments? Thirteen experiments and twenty four pages of peer-reviewed scientific articles? Because if you refute "gradations of certainty", then it must be that at some moment the certainty is not there, and at another moment there is... and I am curious about where and why is that moment.
Throwing books at someone is generally known as "courtier's reply". The more text you throw at me, the smaller probability that I would read them. (Similarly, I could tell you to read Korzybski's Science and Sanity, and only come back after you mastered it, because I believe -- and I truly do -- that it is related to some mistakes you are making. Would you?)
There are some situations when things cannot be explained by a short text. For example, if a 10-years old kid would ask me to explain him quantum physics in less than 1 page of text, I would give up. -- So let me ask you; is Popper's argument against induction the kind of knowledge that cannot be explained to an a intelligent adult person using less than 1 page of text; not even in a simplified form?
Sometimes the original form of the argument is not the best one. For example, Gödel spent hundreds of pages proving something that kids today could express as "any mathematical theorem can be stored on computer as a text file, which is kinda a big integer in base 256". (Took him hundreds of pages, because people didn't have computers back then.) So maybe the book where Popper explained his idea is similarly not the most efficient way to explain the idea. Also, if an idea cannot be explained without pointing to the original source, that is a bit suspicious. On the other hand, of course, not everyone is skilled at explaining, so sometimes the text written by a skilled author has this advantage.
Summary:
I believe that your belief in "refutation by criticism" as something that either is or isn't, but doesn't have "gradation of certainty", is so fundamentally wrong that it doesn't make sense to debate further. Because this is the whole point of why probabilistic reasoning, Bayes theorem, etc. is so popular on LW. (Because probabilities is what you use when you don't have absolute certainty, and I find it quite ironic that I am explaining this to someone who read orders of magnitude more of Popper than I did.)
The issue here also is Brandolini's law:
"The amount of energy necessary to refute bullshit is an order of magnitude bigger than to produce it."
The problem with the "courtier's reply" is you could always appeal to it, even if Scott Aaronson is trying to explain something about quantum mechanics to you, and you need some background (found in references 1, 2, and 3) to understand what he is saying.
There is a type 1 / type 2 error tradeoff here. Ignoring le... (read more)