1

Given n iid variables X1 to Xn with an unknown probability distribution, the sample average is an unbiased estimator for the mean of the distribution. Is there some non-trivial probability distribution for which min(X1,...,Xn) is an unbiased estimator? (Non-trivial meaning the variables can have more than one potential value).

flag
What do you consider trivial? For instance, any distribution that's nonzero only on a set of measure zero will have this property. – fuzzytron Nov 13 2009 at 0:07
@fuzzytron: Your comment makes little sense to me. If you want to use the language of distributions, clearly the intended meaning is a distribution (i.e., a probability measure on $\mathbb{R}$) whose support is not a point. Anyway, the question seems too easy to me, it looks almost like homework (hint: compare the two suggested estimators). – Harald Hanche-Olsen Nov 13 2009 at 1:33
The homework was to find out whether the min is biased for an exponential distribution. It was, of course. This is me being curious if there is a distribution where it's not biased. – Claudiu Nov 13 2009 at 2:02
Sorry - was far too sloppy there. Consider a distribution on the unit interval that is one everywhere except for on a set of measure zero. This (probability) distribution satisfies the criteria above, except that you may consider it "trivial." – fuzzytron Nov 13 2009 at 15:32

2 Answers

3

No. The minimum as always smaller than or equal to the arithmetic mean, and is strictly smaller with positive probability (i.e., when not all the $X_i$ have the same value). Hence its expected value is strictly smaller than that of the mean.

link|flag
1

Not unless n=1 (sorry couldn't resist). Not sure why you're asking this but there do exist f(n,min(X_i)) that work for given distributions. (That is funtions of n and min(X_i) that work). So given only the mean (edit meant min here) and a parametric form of a distribution you can get an unbiassed estimate of the mean. (I think [(n+1)/2]*min(X_i) works for a Uniform(0,theta) for example.

Of course these are going to be much worse (higher variance) estimators than the arithmetic mean because you've thrown away information (the other data).

link|flag
Jonathan: I find your second paragraph somewhat vague. For the family of normal distributions, it is demonstrable that the minimum-variance unbiased estimator of the population mean is the sample mean. (The proof actually relies on the one-to-one nature of the two-sided Laplace transform.) – Michael Hardy Jun 2 2010 at 3:22
Hi Michael. That was a clear typo that I corrected with an edit – Jonathan Kariv Jun 29 2010 at 16:04
Um corrected with an edit in response to your pointing our my mistake – Jonathan Kariv Jun 29 2010 at 16:04

Your Answer

Get an OpenID
or

Not the answer you're looking for? Browse other questions tagged or ask your own question.