Statistical Power Tests - MathOverflow most recent 30 from http://mathoverflow.net 2013-05-23T17:52:15Z http://mathoverflow.net/feeds/question/60033 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/60033/statistical-power-tests Statistical Power Tests Curried Lambda 2011-03-30T04:29:09Z 2011-03-30T04:29:09Z <p>I'm trying to compute the minimum sample size for a psychometric test based on 7 point Likert scales. I'd like to run ANOVA on each scale to look for differences between groups.</p> <p>Most online survey sample size calculators seem to be designed for polls, e.g. Yes/No, Agree/Disagree. They take as input population size, a confidence interval and a proportion (50% Yes/50% no) and then return the required sample size.</p> <p>Most statistical books suggest using power tests (such as R's power.t.test), which take as input a minimum effect size, alpha, beta and a statistical test and then return the required sample size. </p> <p>For my purposes power tests seems to make the most sense, but what has me concerned is that none of them take into account the population size, which seems like it ought to have at least some effect on the outcome. </p> <p>So my question is, what is the correct calculation to use in my specific survey situation and more generally what is the connection between power tests and these online survey sample size calculators, does population size matter in some way, perhaps helping to capture the notion of representative sample?</p>