Trevor_Blake comments on Cognitive Load and Effective Donation - Less Wrong

16 Post author: Neotenic 10 March 2013 03:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread.

Comment author: [deleted] 10 March 2013 06:57:36AM 3 points [-]

We can't trust brains when taken as a whole.

We are made of brains. A nice swirl off to the side of the brain mistrusting the brain is mistrusting that mistrust.

Comment author: Eliezer_Yudkowsky 10 March 2013 04:36:08PM 3 points [-]

True, but so what? It's still not trustworthy.

Comment author: Tyrrell_McAllister 10 March 2013 07:11:43PM 4 points [-]

The "so what" is to beware the skepticism fallacy: The notion that, if you always set your credence to "very low", then you have attained the proper level of belief in everything, and so you have discharged your duty to be rational.

Comment author: [deleted] 10 March 2013 07:04:37PM 0 points [-]

Mistrust of mistrust means not occasional possible trustworthiness, but occasional actuated trustworthiness. My brain being trustworthy on occasion is not a so-what conclusion for me. Out of that comes attempts to identify when those occasions might be and when they are not happening but appear to be happening. I'm using the flaws to identify the strengths.

'My brain always trusts my brain to never be trustworthy' - I think that is what EY just said, but I could be mistaken.

Comment author: [deleted] 10 March 2013 06:29:11PM 0 points [-]

Is there anything, except brains, that is (non-metaphorically) trustworthy? Nothing else in the universe has any care for the truth.

Comment author: Vladimir_Nesov 10 March 2013 07:06:07PM 3 points [-]

If we have nothing more seaworthy than an old rotten canoe, the canoe doesn't thereby become a safe means of sailing.

Comment author: [deleted] 10 March 2013 07:58:07PM 2 points [-]

Point taken, but if the only oceangoing thing we've ever encountered or, in any real detail imagined, is this old rotten canoe, one might be excused for finding the notion that 'this canoe is not seaworthy' a little strange. At that point, we don't even have reason to think that seaworthyness admits of variation, nor do we have any way of disentangling the capacities of this canoe from properties of the ocean.

Though perhaps I've gotten this backwards. Maybe 'the brain is not trustworthy' is intended to be metaphorical language.

Comment author: Vladimir_Nesov 10 March 2013 08:15:06PM 2 points [-]

one might be excused

This doesn't seem like a relevant concern.

Comment author: [deleted] 10 March 2013 08:29:28PM *  2 points [-]

I'm sorry, I was speaking elliptically. I meant that your canoe metaphor is misleading, because you're suggesting a world in which the only seagoing vessel I know of is this canoe, while at the same time trading on my actual knowledge of much more seaworthy vessels. This is a problem, given that my whole point is 'what meaning can a term like 'trustworthyness' have if we deny generally to the only thing capable of being trustworthy?'

But I think I've decided to take Neotenic, and EY's comment as a metaphor, so I drop my objection.

Comment author: Vladimir_Nesov 10 March 2013 08:51:52PM 3 points [-]

By "trustworthiness" I understand something like probability of error, or accuracy or results, just as "seaworthiness" refers to capability of surviving trips of given difficulty. These properties don't depend on availability of better tools, and so absence of better tools is not a relevant consideration in deciding the state of these properties. The absence of better tools might mislead one to overestimate the quality of available tools, but now that we've noticed that, let's stop being misled.

Comment author: [deleted] 10 March 2013 09:08:27PM *  0 points [-]

These properties don't depend on availability of better tools

The properties themselves do not, but that's not the problem. Our ability to identify errors in our reasoning hangs on our ability to get that very reasoning right at some point. And getting it right some of the time isn't enough; we have to know that we got it right in order to know that we previously made an error. Since all we have are brains, we can only say that brains are untrustworthy if some other brains, or the same brain at some other time, are trustworthy (not just correct).

What I mean is that the idea of 'trustworthyness' only has meaning in the sentence 'brains in general are untrustworthy' if that sentence is false. Some brains must be trustworthy some of the time, or else we'd never know the difference. EDIT: And in fact everything we know about trustworthyness, we learned from trustworthy brains.

We can of course wish that brains in general were more trustworthy than they are and that's what I take the original comment to mean.

Comment author: fubarobfusco 11 March 2013 01:30:15AM 0 points [-]

Our ability to identify errors in our reasoning hangs on our ability to get that very reasoning right at some point.

Careful with "identify" there. If I come up with a proof that 1=2, I can recognize it's not right without thereby also knowing which step is wrong.