# Questions tagged [bayesian-probability]

The tag has no usage guidance.

41 questions
208 views

266 views

### In what sense is the Bayesian posterior mean a “convex combination”?

I asked this on math.stackexchange with no response, I'm hoping someone here might have something. Suppose I want to estimate $x \in \mathbb{R}^n$ from two signals with zero mean, normally ...
84 views

### Exploiting conditional independence for inference in Bayesian networks

How is conditional independence used for making probabilistic inference in Bayes networks easier or more efficient? For example, given the following Bayes network: Let's say I want to compute ...
40 views

### Bayesian estimation with lower dimensional prior

Let a statistical model of a random variable $X$ with parameter $\theta \in R^m$ be represented by a density function $p(X=x|\theta)$. Assume that the prior, $q(\cdot)$, is on a lower dimensional ...
105 views

A lot of recent literature in Bayesian approach to inverse problems involves Adaptive priors, i.e - priors that depend on noise level. A lot of articles deal with optimization of contraction rates ...
304 views

### Bayes statistics precisely formulated

I am trying to learn something about Bayesian statistics, however, I am struggling already with the simplest equations and, moreover, with the very basic questions: What are we given? What is our goal?...
288 views

### Base schemes and Bayesian priors

One of Grothendieck's dicta about algebraic geometry is to consider "the relative situation", where one doesn't consider the category of schemes but of schemes over a fixed base scheme. In Bayesian ...
615 views

### Probability spaces involved in using Bayesian Inference

I am currently reading "Statistical and Inductive Inference by Minimum Message Length" by C.S. Wallace. In this, Wallace gives a fairly informal account of Bayesian Inference which, in the case ...
50 views

### A canonical example of the non-existence of predictive probability distribution

Section 3 of Fortini et al. (2000) states that Given $(X^\infty, \mathcal X^\infty,P)$, a predictive probability distribution of $x_n$ given $(x_1, \dots, x_{n-1})$ with respect to $P$ need not ...
279 views

154 views

### Parameter estimation using bayesian update on moduli space?

Scientists take a set of data points, say in ${\mathbb R}^2$, and, assuming that this data should fit a polynomial of degree $d$ (or an exponential, etc.), they estimate parameters. I would think ...
1k views

### What can be said about an infinite linear chain of conjugate prior distributions?

We can sample a discrete value from the multinomial distribution. We can also sample the parameters of the multinomial distribution from its conjugate prior the dirichlet distribution. Since the ...
181 views

### Can truncated/non-smooth distributions be used as priors/posteriors in Variational Bayesian methods?

Variational Bayesian methods can sometimes be a good alternative to Markov Chain Monte Carlo numerical evaluation of probability distributions. They do this, as I understand it, by approximating the ...
1k views

### Are all probabilities conditional probabilities? [closed]

We know that $P(A\mid B) = \frac{P(A \cap B)}{P(B)}$. So $P(B) = P(A\mid B)P(A \cap B)$. Thus are all probabilities conditional probabilities? Can one make a probability more accurate by introducing a ...
867 views

### Exploiting conditional independence working with covariance matrices

I have a Bayesian network where the number of nodes is potentially large. I've conditioned on some of the nodes (observed data) and I'm trying to draw samples from the distribution remaining nodes (...
435 views

### How to deal with this Chicken-And-Egg problem ?

Let's imagine designing an odds pattern for a game, in which players bet for win or lose. Suppose the probablity of winning is $p$, thus the probablity of losing is $1-p$. Now imagine $n_1$ people ...
121 views

### Continuous-time Markov chain to sample Bayesian posterior distribution

Given a Bayesian network and evidence for the values of a subset of the variables, a standard question is to compute the posterior distribution on the remaining variables. The Gibbs sampling technique ...
325 views

921 views

### Estimating Wiener process parameters

Consider a Wiener process with zero drift, infintesimal variance $\sigma^2$, and an unknown starting value $\nu$. That is, \begin{align} Y_t \sim \mathcal{N}(\nu, t\sigma^2). \end{align} Now, ...
This is related to the rank aggregation question I asked previously. I have items $I_1, \ldots, I_N$ and the observations of a number of pairwise trials which pit pairs $I_i$ and $I_j$ against ...