1
$\begingroup$

I want the expectation of the following random variable: $\log\left(\frac{X}{k-X}+\alpha \right)$ with $X \sim Bin_{(k-1),p}$ and $\alpha > 0$, Therefore I derived the Taylor Series: \begin{equation} T_{x_0=(k-1)p}\left[\log\left(\frac{X+\alpha}{k-X}\right)\right] = \log\left(\frac{x_0+\alpha}{k-x_0}\right)+ \sum_{n=1}^{\infty}\frac{1}{n}\left(\frac{(-1)^{n-1}}{(x_0+\alpha)^n}+\frac{1}{(k-x_0)^n}\right)\left(x-x_0\right)^n \end{equation} Plugging in $x_0=(k-1)p$ and calculating the expectation leads me to: \begin{equation} E\left[\log\left(\frac{X+\alpha}{k-X}\right)\right]= \log\left(\frac{(k-1)p+\alpha}{k-(k-1)p}\right)+\sum_{n=1}^{\infty}\frac{1}{nk^n}\left(\frac{(-1)^{n-1}}{\left(p+\frac{\alpha - p}{k}\right)^n}+\frac{1}{\left(1-p+\frac{p}{k}\right)^n}\right)E\left[\left(x-(k-1)p\right)^n\right] \end{equation}

I know that the Taylor series of $\log(x+1)$ only converges within the open ball $(-1,1)$. Does that apply for the random variable? That is, that for $f(X) = \log\left(\frac{X+\alpha}{k-X}\right)$ it holds that: \begin{equation} E\left[f(X)\right]=E\left[T_{x_0=(k-1)p}f(X)\right] \Leftrightarrow f(X) \in (-1,1) \end{equation} Clearly, that would depend on the values of $k$ and $p$. However, for me $k$ can take values up to a few hundred, so $f(X) \in (-1,1)$ does not hold $\forall X$. When I wasn't aware that this convergence could go wrong, I showed that in the parameter settings $p=0.5$ and $k>>1$, so that $k \approx (k-1)$, the expectation is $0$, given the Taylor approximation is true. Now, can I still use this result from the Taylor series?

$\endgroup$
5
  • 1
    $\begingroup$ the variable $X$ can take on the value 0 with nonzero probability, so wouldn't the expectation of $\log(X/(k-X))$ diverge? $\endgroup$ Commented Nov 30, 2020 at 12:23
  • $\begingroup$ you're right. I add an $\alpha > 0$ $\endgroup$
    – qwert
    Commented Nov 30, 2020 at 12:39
  • 1
    $\begingroup$ After "adding that $\alpha>0$", you can use this answer and linearity of expectation: for $\beta>0$, $$\mathbb{E}\log \frac{X+\beta}{k-X} = \mathbb{E}\log(X+\beta) - \mathbb{E}\log(Y+1)$$ where $Y$ is Binomial with parameters $k-1$ and $1-p$. $\endgroup$
    – Clement C.
    Commented Nov 30, 2020 at 12:47
  • $\begingroup$ The command of Mathematica Table[Mean[ TransformedDistribution[Log[x/(k - x) + \[Alpha]], x \[Distributed] BinomialDistribution[k - 1, p]]], {k, 2, 5}] produces $\left\{(1-p) \log (\alpha )+p \log (\alpha +1),p^2 \log (\alpha +2)+(1-p)^2 \log (\alpha )+2 p (1-p) \log \left(\alpha +\frac{1}{2}\right),3 p^2 (1-p) \log (\alpha +1)+p^3 \log (\alpha +3)+(1-p)^3 \log (\alpha )+3 p (1-p)^2 \log \left(\alpha +\frac{1}{3}\right),\right.$ $\endgroup$
    – user64494
    Commented Mar 25, 2021 at 20:00
  • $\begingroup$ $\left.6 p^2 (1-p)^2 \log \left(\alpha +\frac{2}{3}\right)+4 p^3 (1-p) \log \left(\alpha +\frac{3}{2}\right)+p^4 \log (\alpha +4)+(1-p)^4 \log (\alpha )+4 p (1-p)^3 \log \left(\alpha +\frac{1}{4}\right)\right\}$. $\endgroup$
    – user64494
    Commented Mar 25, 2021 at 20:03

1 Answer 1

1
$\begingroup$

So I use hint from Clement with $E\left[\log\frac{X+\alpha}{k - X}\right]$, where $X\sim Bin_{(k-1),p}$ and $\alpha > 0$ is identical to calculating $E\left[\log\left(X+\alpha\right)\right]-E\left[\log\left(Y+1\right)\right]$ with $Y\sim Bin_{(k-1),(1-p)}$. To first check the convergence disc for the log-Taylor series I apply the ratio test. \begin{equation} T_{x_0}\left(\log(x+\alpha)\right)=\log\left(x_0+\alpha\right)+\sum_{i=1}^{\infty}\frac{(-1)^{i-1}}{i(x_0+\alpha)^i}(x-x_0)^i \end{equation} My coefficient of the power series is $c_i=\frac{(-1)^{i-1}}{i(x_0+\alpha)^i}$. Thus, the radius around the center $x_0$ is: \begin{equation} r=\lim_{i\rightarrow \infty}\left|\frac{c_i}{c_{i+1}}\right|=\lim_{i\rightarrow \infty}\left|\frac{(i-1)(x_0+\alpha)^{i+1}}{i(x_0+\alpha)^i}\right|=x_0+\alpha \end{equation} Thus, plugging in $x_0 = (k-1)p$ causes no trouble if $p\geq\frac12$, otherwise, the realization can be outside of the convergent disc centered at $x_0$. As in my setting, if $p\neq 0.5$ I could be either for $X$ or for $Y$ outside of the convergent disc.

So in the case of $p=0.5$, the Taylor series is convergent (sum of two convergent series) and therefore indeed it holds that \begin{equation} \lim_{k\rightarrow \infty}E\left[\log\frac{X+\alpha}{k-X}\right]=0 \end{equation} as the odd terms disappear because of symmetry and the even terms disappear because the big sum in the coeffient of the joint Taylor series above.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .