You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

JoshuaZ comments on Against improper priors - Less Wrong Discussion

2 Post author: DanielLC 26 July 2011 11:50PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (20)

You are viewing a single comment's thread.

Comment author: JoshuaZ 27 July 2011 12:38:13AM 0 points [-]

I'm not sure what you mean by proper or improper priors here. At first you seem to be talking about self-consistent but bad priors in your coinflip example, but then when you talk about proper allocation of mass you seem to be talking about self-consistency of priors. These are different issues.

This isn't true with an improper prior. If I wanted to predict the value of a random real number, and used a normal distribution with a mean of zero and a standard deviation of one, I'd be pretty darn surprised if it doesn't end up being pretty close to zero, but I'd be infinitely surprised if I used a uniform distribution.

There is no uniform distribution on the real line.

Comment author: Douglas_Knight 27 July 2011 02:00:39AM *  4 points [-]

"Improper prior" is a technical term for using an infinite measure as a prior.

Comment author: JoshuaZ 27 July 2011 02:13:25AM 1 point [-]

Ah, thanks. I was not aware of that term. Maybe linking or explaining that in the post might not be a bad idea.

Comment author: DanielLC 27 July 2011 03:23:54AM 0 points [-]

Edited to add this.

Comment author: Douglas_Knight 27 July 2011 05:09:55AM 2 points [-]

Your new first paragraph is not the definition. Partly it goes opposite the definition and partly it is orthogonal. It is so confused, I'm surprised that the other material is (or looked) correct. You should separate your consideration of continuous priors from improper priors. An example of an improper prior in a discrete setting is the uniform prior on positive integers. Another example is the prior p(n) = 1/n.

Comment author: jsalvatier 27 July 2011 07:31:06PM 0 points [-]

I am also confused. More specifically, improper priors are priors that integrate to infinity and thus cannot be normalized.

Comment author: Douglas_Knight 28 July 2011 01:51:05AM 0 points [-]

That's almost the definition, except that improper priors are not priors.
Is that your confusion?

Comment author: jsalvatier 28 July 2011 03:06:26AM 0 points [-]

No, I mean I share your confusion that the rest of the conversation appeared reasonable given the incorrect definition in the post.

Comment author: Douglas_Knight 28 July 2011 04:28:33AM 0 points [-]

Sorry. Probably part of the miscommunication is that I used "confused" to describe Daniel LC and "surprised" to describe myself.