Eliezer_Yudkowsky comments on Pascal's Muggle: Infinitesimal Priors and Strong Evidence - Less Wrong

43 Post author: Eliezer_Yudkowsky 08 May 2013 12:43AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (404)

You are viewing a single comment's thread. Show more comments above.

Comment author: shminux 06 May 2013 04:14:54PM 1 point [-]

The prior probability of us being in a position to impact a googolplex people is on the order of one over googolplex, so your equations must be wrong

That's not at all how validity of physical theories is evaluated. Not even a little bit.

By that logic, you would have to reject most current theories. For example, Relativity restricted the maximum speed of travel, thus revealing that countless future generations will not be able to reach the stars. Archimedes's discovery of the buoyancy laws enabled future naval battles and ocean faring, impacting billions so far (which is not a googolplex, but the day is still young). The discovery of fission and fusion still has the potential to destroy all those potential future lives. Same with computer research.

The only thing that matters in physics is the old mundane "fits current data, makes valid predictions". Or at least has the potential to make testable predictions some time down the road. The only time you might want to bleed (mis)anthropic considerations into physics is when you have no way of evaluating the predictive power of various models and need to decide which one is worth pursuing. But that is not physics, it's decision theory.

Once you have a testable working theory, your anthropic considerations are irrelevant for evaluating its validity.

Comment author: Eliezer_Yudkowsky 06 May 2013 05:07:42PM 3 points [-]

Relativity restricted the maximum speed of travel, thus revealing that countless future generations will not be able to reach the stars

That's perfectly credible since it implies a lack of leverage.

Archimedes's discovery of the buoyancy laws enabled future naval battles and ocean faring, impacting billions so far

10^10 is not a significant factor compared to the sensory experience of seeing something float in a bathtub.

The only thing that matters in physics is the old mundane "fits current data, makes valid predictions".

To build an AI one must be a tad more formal than this, and once you start trying to be formal, you will soon find that you need a prior.

Comment author: shminux 06 May 2013 07:35:02PM 1 point [-]

That's perfectly credible since it implies a lack of leverage.

Oh, I assumed that negative leverage is still leverage. Given that it might amount to an equivalent of killing a googolplex of people, assuming you equate never being born with killing.

To build an AI one must be a tad more formal than this, and once you start trying to be formal, you will soon find that you need a prior.

I see. I cannot comment on anything AI-related with any confidence. I thought we were talking about evaluating the likelihood of a certain model in physics to be accurate. In that latter case anthropic considerations seem irrelevant.