Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 8430

Nonlinear objectives, nonlinear constraints, non-convex objective, non-convex feasible region.

21 votes

Is the matrix $\left({2m\choose 2j-i}\right)_{i,j=1}^{2m-1}$ nonsingular?

Here is a very low-brow answer to the original question. Consider the lower-triangular matrix \begin{equation*} V = [V_{ij}] = \left[\binom{i-1}{j-1}\right]\quad \text{for}\quad i \ge j. \end{equatio …
Suvrit's user avatar
  • 28.6k
7 votes

Convex Sets and Nearest Neighbors

A nonempty set $S$ in a normed linear space $X$ is called a Chebyshev set if for each $u \in X$ there is exactly one nearest point in $S$ to $u$ (i.e., for a Chebyshev set, nearest points always exist …
Suvrit's user avatar
  • 28.6k
7 votes
Accepted

What's the best orthonormal matrix to align two matrices in the operator norm sense?

The operator norm version of this problem is considered in: The solution of orthogonal Procrustes problems for a family of orthogonally invariant norms, by G. A. Watson, Advances in Computational Math …
Suvrit's user avatar
  • 28.6k
6 votes
Accepted

Solve equation with matrix variable

Here is a partial solution to the first question in the original post. Let's look at the equation \begin{equation}\label{1}\tag{1} \sum\nolimits_{i=1}^m (X+ \Theta_i)^{-1} = Q. \end{equation} Lemma …
Suvrit's user avatar
  • 28.6k
4 votes

A (reverse)-Minkowski type inequality for symmetric sums

The said claim follows from the following general result on elementary symmetric polynomials, denoted $e_k$ below. $\newcommand{\vx}{\mathbf{x}}\newcommand{\vy}{\mathbf{y}}$ Theorem A (S. 2018). $ …
Suvrit's user avatar
  • 28.6k
4 votes
Accepted

Fixed point iteration on symmetric biconvex function

The paper cited in my answer here provides a detailed proof of the two-block case of alternating minimization (block coordinate descent). In particular, as mentioned in my comment, the convergence fol …
Suvrit's user avatar
  • 28.6k
3 votes

Maximizing a pseudoconcave function in a box

Your problem is a special case of a Fractional Linear Program, so as such following the recipe provided on Wikipedia you should be able to solve it by using a reformulation to an equivalent linear pro …
Suvrit's user avatar
  • 28.6k
3 votes
Accepted

Why eigenvectors optimize this orthogonally constrained nonlinear minimization problem?

Your minimization problem is equivalent to \begin{equation*} \min_{R^TR=I}\quad\prod_{i=1}^p r_i^T\Sigma r_i, \end{equation*} and it can be shown (using Hadamard's determinant inequality and some more …
Suvrit's user avatar
  • 28.6k
3 votes

lipschitz constant of a multivariate function

Rather than compute "the" Lipschitz constant, it is much easier to do a backtracking line search that roughly upper-bounds the Lipschitz constant. To get some ideas, on how one might do a simple line …
Suvrit's user avatar
  • 28.6k
3 votes

Checking concavity of a highly non linear function

The following Matlab code suggests that the function fails to be concave in the regime of interest ($0\le T\le 0.4$, $E, W \ge 0$, $p \ge 20$, $W\ge E$. f = @(E,W,T,p) (p*(W+1.000000000*10^5*W^.7*(.1 …
Suvrit's user avatar
  • 28.6k
2 votes
Accepted

Convexity of a (non-symmetric) function of matrices

From Theorem 9, of this article it follows that $A \mapsto \log\frac{M_i(A)}{\det(A)}$ is convex on the set of positive definite matrices. The alleged convexity in the OP is a simple consequence of th …
Suvrit's user avatar
  • 28.6k
2 votes
Accepted

Analysis of first-order methods for constrained convex optimization with approximate oracles

Building on Nesterov's work, in his Ph.D thesis, Peter Richtarik considers first-order methods with relative error of approximation guarantees. I haven't looked in too closely, but I am sure that a la …
Suvrit's user avatar
  • 28.6k
2 votes
Accepted

Distance between two sets

You are trying to solve what is known as a best approximation problem. von Neumann's alternating projections does not work here (as might have been perhaps suggested above) You can use Dykstra's pr …
Suvrit's user avatar
  • 28.6k
2 votes
Accepted

Simultaneous maximization of two Generalized Rayleigh Ritz Ratios

Here is a crude idea that might work (haven't thought too carefully about it). Let $a=\lambda_{\min}(B_1^{-1}A_1)$ and $b=\lambda_{\min}(B_2^{-1}A_2)$. Then, for there to be a feasible solution to th …
Suvrit's user avatar
  • 28.6k
2 votes

Constraint optimization problem for any dimensionality $n>1$.

Here's an alternative way of proving (what Yoav already did), but using different notation. Let us first write the optimization problem in matrix form. First, define \begin{equation*} d = \begin{ …
Suvrit's user avatar
  • 28.6k

15 30 50 per page