12
$\begingroup$

There is a well-known estimate for the sum of all binomial coefficients $\binom{n}{k}$ satisfying $k \leq \alpha n$ for some $\alpha$ satisfying $0 < \alpha \leq 1/2$:

$$ \sum_{k=0}^{\alpha n}\binom{n}{k} = 2^{(H(\alpha) + o(1))n}$$

where $H(\alpha) = -\alpha\log_2(\alpha) - (1-\alpha)\log_2(1-\alpha)$ is the binary entropy function.

My question is whether there exists a similar estimate when we weight the $k$-th binomial coefficient by $\lambda^k$ for some $\lambda > 0$. That is, I would like to estimate the following sum:

$$ \sum_{k=0}^{\alpha n} \binom{n}{k} \lambda^k $$

$\endgroup$
2
  • $\begingroup$ Have you tried replacing 2 by (1+lambda)? Alternatively, for large lambda and alpha far enough away from 1/2, some nice estimates occur by using geometric series approximations. Gerhard "Ask Me About System Design" Paseman, 2012.004.11 $\endgroup$ Commented Apr 11, 2012 at 10:12
  • $\begingroup$ There are many estimates here. Is there context as to what kind of estimate you are looking for? $\endgroup$ Commented Apr 11, 2012 at 18:34

4 Answers 4

10
$\begingroup$

Expanding on the previous answers. I'm taking $\lambda$ and $\alpha$ to be constants which do not vary as $n\to\infty$.

If $α<λ/(λ+1)$ then the sum is within a constant of the last term. In fact the largest terms are approximately in geometric progression so you can get it quite accurately by computing the ratio.

If $α>λ/(λ+1)$, almost all of the complete binomial expansion is present, so the sum equals $(1+o(1))(1+λ)^n$.

If $α≈p$, then Russell's normal approximation will be good. (This needs some work to clarify whether the geometric approximation of the lower tail is good right up to the point where the normal approximation begins to be good. I think it is.)

$\endgroup$
7
  • $\begingroup$ The last assertion is actually not true, as stated: say, if $\lambda=1$ and $\alpha$ is just a tiny bit larger than $1/2$, then the sum is not equal to $(1+o(1))2^n$ (it is half of this quantity). $\endgroup$
    – Seva
    Commented Apr 11, 2012 at 14:02
  • $\begingroup$ Perhaps you are not taking $\alpha$ to be constant as $n\to\infty$. Apart from the scaling factor of $2^n$, it is a binomial distribution $Bin(n,1/2)$, which has a standard deviation of $\sqrt{n}/2$. So if $\alpha=1/2+\epsilon$ for fixed $\epsilon>0$, the upper limit of your sum is $2\epsilon\sqrt{n}$ standard deviations above the mean, so it cuts off a negligible portion of the sum from 0 to $n$. To asymptotically get half of $2^n$ you need $\alpha=1/2+o(n^{-1/2})$, which is not constant except for $\alpha=1/2$. $\endgroup$ Commented Apr 12, 2012 at 2:08
  • $\begingroup$ What happens when $\alpha=c/n$ for $c$ a constant? Can one bound the sum in terms of $c$, $\lambda$ and $n$? $\endgroup$
    – Bullmoose
    Commented Nov 22, 2013 at 4:33
  • $\begingroup$ @Bullmoose: In that case the sum is strongly dominated by its largest term. $\endgroup$ Commented Nov 22, 2013 at 4:50
  • $\begingroup$ I posted a question related to this here: mathoverflow.net/questions/149604/… The question is the origin of my query. $\endgroup$
    – Bullmoose
    Commented Nov 22, 2013 at 5:57
6
$\begingroup$

Your sum can also be thought of as the first $\alpha n$ terms in a binomial distribution with probability of success $p=1-\frac1{\lambda+1}$. So, it is closely approximated by a normal distribution with mean $np$ and standard deviation $\sqrt{np(1-p)}$, i.e., $$\sum_{k=0}^{\alpha n} \binom nk \lambda^k\approx (1-p)^{-n}\Phi\left((\alpha-p)\sqrt{\frac n{p(1-p)}}\right),$$ where $\Phi$ is the cumulative standard normal distribution.

$\endgroup$
4
  • $\begingroup$ This will only be a good estimate when the upper limit is close to the centre of the normal approximation, i.e., when $\alpha\approx p$. $\endgroup$ Commented Apr 11, 2012 at 11:39
  • $\begingroup$ Do you have an error approximation on this, @BrendanMcKay or @RussellMay? I would love to know. I have a problem in exactly this situation. $\endgroup$ Commented Nov 8, 2018 at 3:56
  • $\begingroup$ @MaximGilula There is a large literature on normal approximation of the binomial distribution. Start with the Berry-Esseen Theorem, which gives an explicit bound on the error. $\endgroup$ Commented Sep 23, 2021 at 2:26
  • $\begingroup$ I needed something a little stronger than that theorem when I worked on the problem I had in mind. The error is relatively large for what I needed. $\endgroup$ Commented Sep 23, 2021 at 2:27
6
$\begingroup$

Sums of this sort are estimated by their largest summand, and the resulting estimate will depend on the relation between $\alpha$ and $\lambda$.

The ratio of the $(k+1)$th and the $k$th terms of the untruncated sum is $$ \lambda \frac{n-k}{k+1}, $$ showing that the sequence of summands is unimodal, with the maximum value attained for $k$ about $\frac{\lambda}{\lambda+1}\,n$. Consequently, if $\alpha<\lambda/(\lambda+1)$, then your sum is between $\binom n{\lfloor\alpha n\rfloor}\lambda^{\lfloor\alpha n\rfloor}$ and $n\binom n{\lfloor\alpha n\rfloor}\lambda^{\lfloor\alpha n\rfloor}$, which is $2^{H((\alpha)+\alpha\log_2\lambda+o(1))n}$; similarly, if $\alpha>\lambda/(\lambda+1)$, then the sum is $2^{(H(\lambda/(\lambda+1))+(\lambda/(\lambda+1))\log_2\lambda+o(1))n}=(\lambda+1)^{1+o(1)}$. (Both estimates assume that $\alpha$ and $\lambda$ are fixed, and $n\to\infty$.)

$\endgroup$
0
$\begingroup$

There are at least two possible goals: either, estimating the rate of convergence as $\lambda \searrow 0$, or estimating the extent of the blow up for $\lambda$ "not extremely small." Although not a complete answer, there's an easy non-asymptotic bound in the latter context which, I hope, may still be worth mentioning due to its simplicity.

Let $c>0$ with $\lambda \geq c/n$. For all integers $k \geq 0$ with $k \leq c$, we have $$ \binom{n}{k} \lambda^k \:\leq\: \frac{n^k}{k!} \lambda^k \:=\: \left(\! \frac{n\lambda}{c} \!\right)^{\!k} \frac{c^k}{k!} \:\leq\: \left(\! \frac{n\lambda}{c} \!\right)^{\!c} \frac{c^k}{k!}. $$ Therefore, summing across $k \leq c$ gives $$ \sum_{k=0}^c \binom{n}{k} \lambda^k \:\leq\: \left(\! \frac{n\lambda}{c} \!\right)^{\!c} \sum_{k \leq c} \frac{c^k}{k!} \:\leq\: \left(\! \frac{n\lambda}{c} \!\right)^{\!c} e^c \:=\: \left(\! \frac{en\lambda}{c} \!\right)^{\!c}. $$

In particular, taking $c = \alpha n$, we obtain the simple bound that $$ \sum_{k=0}^{\alpha n} \binom{n}{k} \lambda^k \:\leq\: \left(\! \frac{e\lambda}{\alpha} \!\right)^{\!\alpha n} $$ whenever $\lambda \geq \alpha$.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .