# Tagged Questions

**5**

votes

**1**answer

389 views

### Is there a mistake in Vapnik's “Basic Lemma”?

I have a concern about the "Basic Lemma" which Valdimir Vapnik states and proves in his 1998 book Statistical Learning Theory (ch. 14.3, pp. 574–76): It seems like a certain coefficient should have ...

**1**

vote

**2**answers

237 views

### A machine learning application question

I am familiar with basic probabilities, random processes but not so much of machine learning methods. This is the problem I am trying to solve.
I want to predict the nature of user activity on a ...

**0**

votes

**1**answer

103 views

### What is the Bahadur-Anderson Algorithm?

What is the Bahadur-Anderson Algorithm, and which book could one read to learn it?

**0**

votes

**0**answers

422 views

### Gradient Descent for Primal Kernel SVM with Soft-Margin(Hinge) Loss

Given the primal objective
$$F({\bf a})=L\sum_{i,j}a_{i}a_{j}k(x_i,x_j) + \sum_{i}max(0, 1-y_i \sum_{j}a_jk(x_i,x_j)$$
for the soft margin SVM, where ${\bf a}=(a_1,...,a_N)$, N being the number of ...

**3**

votes

**2**answers

445 views

### Vapnik-Chervonenkis dimension of lines in the plane

I'm having some problems with this problem concerning VC dimensions ( http://en.wikipedia.org/wiki/VC_dimension ), I hope for some helping input.
Given a set $L$ of $n$ lines in the plane, define a ...

**4**

votes

**1**answer

866 views

### Monotonicity of the hard EM algorithm.

Consider the problem where we want to find a maximum likelihood estimate of $\theta$, given $X$ and $$P_\theta(Y) = \sum_z P_\theta(Y,x)$$ where $x$ is a latent variable.
I know that the soft EM ...

**2**

votes

**0**answers

445 views

### Classical Multidimensional Scaling

Hi,
I am doing an MDS with a distance matrix coming from geodesic distances between points X on a 3d mesh (ie., not euclidean distances), and try to find points Y in euclidean space which best ...

**1**

vote

**3**answers

5k views

### The Polynomial Kernel

I Have seen two versions of the Polynomial Kernel during my time learning Kernel Methods for things such as regression analysis.
1) $\kappa_d(x,y) = (x \cdot y)^d$
2) $\kappa_d(x,y) = (x \cdot y + ...

**9**

votes

**3**answers

325 views

### disconnected or poorly connected graphs in sport ratings systems

I've briefly read about rating systems that provide rankings to players based only on their performance wrt other players, in the context of chess. (for example, elo). When there is a lot of ...