MathOverflow is a question and answer site for professional mathematicians. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Let's assume we have a simple linear regression y(x) = a + bx. Is there a way to obtain a probability density function of y for any given x? Would the concept of confidence regions be useful here in any way?

I'm not a big expert in statistics and your help will be very much appreciated

Thank you

share|cite|improve this question
Regression doesn't mean equality. Indeed, the linear fit can be extremely bad. So, you can't say much at all about one variable given a linear regression with a known variable when the correlation is arbitrary. – Douglas Zare Jan 21 '10 at 14:45
what would change if correlation were 0.95? – Alex Jan 21 '10 at 15:33
That could happen from one very low probability outlier which is far above the mean for both random variables, so you still couldn't say much of anything. You are pushing on a rope. You need some other tools than the linear regression or correlation to say anything meaningful about either the density function or confidence regions. – Douglas Zare Jan 21 '10 at 17:04
This question can be answered, but you need to be more specific: a) what is the space on which x lies ? (i.e. is x a vector or a matrix) b) how many observations you have ? (what is the dimension of y) – user3561 Jan 26 '10 at 17:14
up vote 1 down vote accepted

You need to make your answer more precise. First, the regression should be
y = a + bx + e
where e has some distribution, let's say described by a density g(e)

Now, do you mean:

1) Obtaining the density f(y|x) theoretically?
This one is easy. By the transformation of densities
f(y|x) = 1/(a+bx)*g(y/(a+bx))

2) Estimating the density when you do not know the parameters of the regression model?
This one will depend on what you know and what you don't know, and what data you have at hand, and is a more complex issue, so you need to provide more information.

share|cite|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.