Thanks Benja. This is a good objection to the argument I make in the 'Rejecting Good Evidence' section of the paper, but I think I can avoid it by formulating BIP* more carefully.
Suppose I’m in a situation in which it currently appears to me as though f-sim = x. In effect, your suggestion is that, in this situation, my evidence can be characterized by the disjunction (A ∨ B). You then reason as follows:
(1) Conditional on A, my credence in SIM should be >= x.
(2) Conditional on B, my credence in SIM should be 1.
(3) So overall, given that A and B are mutually exclusive, my credence in SIM should be >= x.
I accept that this is a valid argument. The problem with it, in my view, is that (A ∨ B) is not a complete description of what my evidence says.
Let V represent the proposition that my evidence regarding f-sim is veridical (i.e., the true value of f-sim is indeed what it appears to be). If A is true, then V is also true. So a more complete description of what my evidence says is (A ∧ V) ∨ (B ∧ ~V).
Now we need to ask: is it true that, conditional on (A ∧ V), my credence in SIM should be >= x?
BIP doesn’t entail that it should be, since BIP takes no account of the relevance of V. And V is surely relevant, since (on the face of it, at least) V is far more likely to be true if I am not simulated (i.e., Cr (V | ~SIM) >> Cr (V | SIM)).
Indeed, if one were to learn that (A ∧ V) is true, one might well rationally assign credence =< x to SIM. However, it’s not important to my argument that one’s credence should be =< x: all that matters is that there is no compelling reason to think that it should be >= x.
In short, then, your argument shows that, conditional on a certain description of what my evidence indicates, my credence in SIM should be >= x. But that description is the not the most complete description available—and we must always use the most complete description available, because we often find in epistemology that incomplete descriptions of the evidence lead to incorrect inferences.
Nevertheless, I think your response does expose an error in the paper. I should have formulated BIP* like this, explicitly introducing V:
BIP*: Cr [SIM | ((f-sim = x) ∧ V) ∨ ((f-sim ≠ x) ∧ ~V)] >= x
When BIP* is formulated like this, it is not entailed by BIP. Yet this is the modified principle Bostrom actually needs, if he wants to recover his original conclusion while rejecting Good Evidence. So I think the overall argument still stands, once the error you point out is corrected.
If your case is that BIP is insufficient to establish the conclusions Bostrom wants to establish, I'm pretty sure it does in fact suffice. If you accept both of these:
then we derive Cr[SIM] ≥ 1- (1-x)/y_x. x is some estimate of what f-sim might be in our world if we are not in a simulation and our current evidence is veridical, and y_x is our estimate of how likely a large f-sim is given the same assumptions; it's likely to be around f_I f_p.
Jonathan Birch recently published an interesting critique of Bostrom's simulation argument. Here's the abstract:
The paper is behind a paywall, but I have uploaded it to my shared Dropbox folder, here.
EDIT: I emailed the author and am glad to see that he's decided to participate in the discussion below.