All Questions
Tagged with taylor-series pr.probability
13 questions
8
votes
1
answer
2k
views
Taylor expansion of cumulant generating function
For the characteristic function $\mathbf E e^{i t X}$ of a random variable $X$ with $n+1$ finite moments, there is the well known and easy to prove bound on the remainder of the Taylor series
$$\left\...
- 623
3
votes
1
answer
210
views
Probabilistic Taylor theorem for concave functions
This paper proves a probabilistic version of Taylor's theorem
\begin{equation*}
\mathbb{E}g(X) = \sum_{k=0}^{n-1} \frac{g^{(k)}(0)}{k!} \mathbb{E}X^k + \frac{\mathbb{E}X^n}{n!} \mathbb{E} g^{(n)}(X_{(...
- 45
3
votes
0
answers
176
views
What is the meaning of big-O of a random variable?
I encountered this problem in a book "Pattern Recognition and Machine Learning" by Christopher M. Bishop. I excerpt it below:
screenshot of the book
In the excerpt, the big-O notation $O(\xi^...
- 31
2
votes
1
answer
451
views
Show that the absolute value of this function is twice differentiable except on a set of Lebesgue measure $0$
Let
$f\in C^3(\mathbb R)$ with $f>0$ and $$\int f(x)\:{\rm d}x=1\tag1$$
$g:=\ln f$ and assume that $g'=\frac{f'}f$ is Lipschitz continuous (note that this implies that $f'(x)\xrightarrow{|x|\to\...
- 167
2
votes
0
answers
52
views
A certain expectation of a function of independent gammas
Suppose that $Y_1...,Y_n$ are independant gamma random variables: $Y_i \sim \Gamma(\alpha_i,\beta_i)$, with density $f_i(t) = \frac{t^{\alpha_i-1} e^{-\frac{x}{\beta}}}{\Gamma(\alpha) \beta^{\alpha}}$....
- 686
1
vote
1
answer
573
views
Approximate expectation of a random variable that is the logarithm of a function of a binomial
I want the expectation of the following random variable: $\log\left(\frac{X}{k-X}+\alpha \right)$ with $X \sim Bin_{(k-1),p}$ and $\alpha > 0$, Therefore I derived the Taylor Series:
\begin{...
- 89
1
vote
1
answer
457
views
Taylor's theorem for a composition with $\min:\mathbb R^2\to\mathbb R$ and differentiability Lebesgue almost everywhere
Let
$f\in C^3(\mathbb R)$ with $f>0$ and $$\int f(x)\:{\rm d}x=1$$
$g:=\ln f$ (and assume $g'$ is Lipschitz continuous)
$n\in\mathbb N$, $$s(x,y):=\sum_{i=1}^n\left(g(y_i)-g(x_i)\right)$$ and $$h(...
- 167
1
vote
0
answers
160
views
Lower bound for variance of ratio of dependent random variables
I'm trying to find a lower bound on $\text{Var}(X / Y)$ for dependent random variables $X, Y \in [0, 1]$ with $X \leq Y$.
More specifically, $X$ and $Y$ are defined as follows:
Let $h, n \in \mathbb{N}...
- 299
1
vote
1
answer
165
views
Estimate the scale of the power series with Poisson pdf/pmf-like terms
I would like to have an estimate for the series
$$P(t) = \sum\limits_{k = 0}^\infty (e^{-t}\frac{t^k}{k!})^m,$$
where $e$ is the base of natural logarithm, $k!$ is the factorial of the integer $k$, $t$...
- 113
0
votes
2
answers
454
views
Expected value of Taylor series with central moments of binomial variate
I want to understand this entry, but do not understand how the $\mathcal{O}\left(\frac{1}{n^2}\right)$ in the accepted answer comes into play.
I reproduce the question here: We have $x \sim \mathrm{...
- 89
0
votes
1
answer
291
views
Inequality of Partial Taylor Series
Hi,
For a given $\theta < 1$, and $N$ a positive integer, I am trying to find an $x > 0$ (preferably the smallest such $x$) such that the following inequality holds:
$$\sum_{k=0}^{N} \frac{x^k}...
- 51
0
votes
0
answers
116
views
Finding a square integrable dominating function for function class
problem statement
For any $x \in R^d$, consider the function $$\phi(x,a) = \min_{1\leq j \leq k} \|x-a_j\|^2,$$
where $a = (a_1, \dots, a_k) \in R^{kd}$ and $\| \cdot \|$ is the $L_p$ norm for any $p ...
- 11
0
votes
0
answers
268
views
Taylor series expansion of quantile function
Suppose $Y$ and $Z$ two random variables, $\lambda \in \mathbb{R} $.
We note $F^{-1}_{Y}(\alpha)$ the quantile function of the variable $Y$ at the quantile level $\alpha \in (0,1)$.
Do you have any ...
- 250