Decius comments on Many Weak Arguments vs. One Relatively Strong Argument - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (86)
Penrose is a worrisome case to bring as an example, since he is in fact wrong, and therefore you're giving an example where your reasoning leads to the wrong conclusion. If you can't easily find examples where your reasoning led you to a new correct conclusion instead of new sympathy toward a wrong conclusion, this is worrisome. In general, I tend to flag recounts of epistemological innovations which lead to new sympathy toward a wrong conclusion, as though the one were displaying compassion for a previously hated enemy, for in epistemology this is not virtue.
The Penrose example worries me for other reasons as well, namely it seems like it would be possible to generate hordes and hordes of weak arguments against Penrose; so it's as if because the argument against Penrose is strong, you aren't bothering to try to generate weak arguments; reading this feels like you now prefer weak arguments to strong arguments and don't try to find the many weak arguments once you see a strong argument, which is not good Bayesianism.
You also claim there's a strong argument for Penrose, namely his authority (? wasn't this the kind of reasoning you were arguing against trusting?) but either we have very different domain models here, or you're not using the Bayesian definition of strong evidence as "an argument you would be very unlikely to observe, in a world where the theory is false". What do you think is the probability of at least one famous physicist writing a widely panned book about the noncomputability of human consciousness, in a world where consciousness is computable? I should not call it very low, and that means that the pure argument from authority, if you don't believe the actual specifics of that argument, is Bayesian evidence with a low likelihood ratio or as it would be commonly termed a 'weak argument'.
Strong evidence against Penrose's conclusion would necessarily have to be strong (or at least moderate) counterarguments to each of the weak arguments which support his position; it appears to me that faith in reductionism and an observation of an algorithmic consciousness qualify as strong counterarguments, and I think that there's a very high probability that Tegmark's work showing that the brain mechanisms that we know about function well in classical physics qualifies as a moderate counterargument to the key points. (This would become strong if combined with proof that what we know is sufficient to model consciousness.)
The evolutionary counterargument (it is unlikely that small changes iterating over time would result in quantum behavior, even if quantum behavior were useful) I reject as false, because evolutionary processes aren't goal-oriented and aren't smart enough to avoid using quantum behavior.