Generalizing the wilson score confidence interval to other distributions - MathOverflow most recent 30 from http://mathoverflow.net 2013-05-22T20:37:13Z http://mathoverflow.net/feeds/question/20727 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/20727/generalizing-the-wilson-score-confidence-interval-to-other-distributions Generalizing the wilson score confidence interval to other distributions Nick Johnson 2010-04-08T13:52:41Z 2010-09-09T22:22:16Z <p><a href="http://www.evanmiller.org/how-not-to-sort-by-average-rating.html" rel="nofollow">This article</a> describes the 'Wilson score confidence interval', and describes how to use it to derive the lower bound on the nth percentile confidence interval for determining sorting criteria for thumbs-up/thumbs-down type ratings in a ratings system.</p> <p>How can this be generalized to a ratings system that doesn't form a binomial distribution? Specifically, how can this be determined when each rating is a real number between 0 and 1, or when each rating is one of a set of discrete ratings (eg, 1, 2, 3, 4 or 5)?</p> <p>With a normal distribution, it appears that this could be simply the average minus some number of standard deviations - but to the best of my knowledge, it's not a true normal distribution, since it's limited to the range (0, 1).</p> http://mathoverflow.net/questions/20727/generalizing-the-wilson-score-confidence-interval-to-other-distributions/20742#20742 Answer by David Bar Moshe for Generalizing the wilson score confidence interval to other distributions David Bar Moshe 2010-04-08T15:20:58Z 2010-04-08T15:20:58Z <p>The rating is performed according to the sample mean. If the sample size is big enough >30, the sample mean is approximately Gaussian distributed and the confidence interval can be computed from the Gaussian formula using the sample standard deviation. When the sample size is small, one can treat the random variable (x-mu)/(sigma/sqrt(n)) (mu is the sample mean, sigma is the samole standard deviation and n is the sample size) as t-distributed and calculate the confidence interval from the t-distribution table. Here is a <a href="http://mgtclass.mgt.unm.edu/Jurkat/Mgt%2520501/McClaveEtAl10_05.ppt" rel="nofollow">tutorial</a> explaining this computation.</p>