We can simplify this even further, to a fair coin versus an unknown weighted coin.
One way of viewing the difference is to say that you have different causal models of the two situations - with an unknown weighted coin there is an extra parameter to gather evidence about, therefore gathering evidence does more to your model of the world.
Previous open thread
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one.
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.