I would like to explore certain kinds of experiential knowledge that appear to me to be difficult to investigate rationally as the rational attitude itself might be the cause of a reluctance to explore. If this is already covered in one of the articles on the site please refer me to it.
In this thought experiment we will use the example of lucid dreaming. Lucid dreaming is a state in which a person realises they are dreaming while they are dreaming. The subtleties of the state are not relevant to this discussion.
Circumstances
[1] We will assume the experiment takes place at a time where the existence of the experience of lucid dreaming hasn't been scientifically proven yet. We will also assume that a proof is not possible in the current state of technological or methodological development.
[2] Person A has a (true) belief on the existence of lucid dreaming that is based on his personal experience of the state.
[3] He is trying to communicate the existence of lucid dreaming to someone else. Let us call him person B.
[4] Actually becoming lucid in a dream is quite a complex process that requires among other things1:
[4.1] Expending large amounts of effort.
[4.2] Following guidelines and exercises that appear strange.
[4.3] A time investment of significant length.
In the described circumstances we have an internal experience that has not be scientifically proven but is nevertheless true. We know this in our time through scientific studies but B does not know it in his world. Person B would have to actually believe in the existence of lucid dreaming and trust A to guide him through the process. But since there is no sufficient evidence to support the claim of A, the required effort is significantly large and the methods appear strange to those not understanding the state how can B rationally decide to expend the effort?
Proposed Conclusion
[5] People focusing on rational assessment can be mislead when dealing with experiential knowledge that is not yet scientifically proven, is not easily testable and has no obvious external function but is, nevertheless, experientially accessible.
1 Even if you disagree with the level of difficulty or the steps required please accept [4] and its sub-headings as being accurate for the duration of the argument.
Discounting the evidence doesn't actually make it any harder for us to discover those experiences. If we don't want to lose out on such things, then we should try some practices which we assign low probability, to see which ones work. Assigning low probability isn't what makes this hard -- what makes this hard is the large number of similarly-goofy-sounding things which we have to choose from, not knowing which ones will work. Assigning a more accurate probability just allows us to make a more accurate cost-benefit analysis in choosing how much of our time to spend on such things. The actual amount of effort it takes to achieve the results (in cases where results are real) doesn't change with the level of rationality of our beliefs.
I think I see what you are saying.
I am phrasing the problem as an issue with rationality when I should have been phrasing it as a type of bias that tends to affect people with a rationality focus. Identifying the bias should allow us to choose a strategy which will in effect be the more rational approach.
Did I understand you correctly?
P.S: I edited the opening paragraph and conclusion to address yours and entirelyuseless' valid criticism.