All Questions
1,593 questions
9
votes
2
answers
603
views
Book for matroid polytopes
I have made a study of polytopes with the books of Ziegler and "Integer Programming" of Conforti, my main goal is to study matroid polytopes; to study matroids I have thought about the book &...
- 251
3
votes
1
answer
255
views
Is this constraint convex?
I have an optimization problem where the following constraint causes DCP Rule Error.
$$e^{x_n} \leq B \log _2\left(1+\frac{e^{\rho_n} g_n^2}{\sum_{i=1}^{n-1} e^{\...
- 31
0
votes
0
answers
129
views
Primal optimal attained implies dual optimal attained
Given some optimization problem
$$\min_{x \in S \subset \mathbb{R}^n} f_0(x) \quad \text{s.t.} \quad f_i(x) \leq 0, \quad 1\leq i\leq m$$
we can find the dual problem
$$\max_{\lambda\in\mathbb{R}^m} g(...
- 275
0
votes
1
answer
169
views
How to integrate an indicator function/constraint into the cost function of a linear program?
I have a mathematical model $P$ for which I optimize two cost functions say $F_1$ and $F_2$ subject to a set of constraints $C1$–$C10$.
In $F_2$, I want it to be included only when its expression ...
- 3
3
votes
1
answer
370
views
Convex optimization without Slater's condition
In nearly all convex optimization methods that I read about, it is assumed that the problem satisfies Slater's condition, that is, there is a point that strictly satisfies all constraints (the ...
- 3,549
0
votes
0
answers
164
views
Inf-convolution of norm 1 and norm 2 square
The inf-convolution of the functions $f$ and $g$ defined on $\mathbb{R}^n$ is
$$
h(x)=\inf _{y \in \mathbb{R}^n} f(y)+g(x-y) .
$$
We can prove that if $f,g$ are convex functions, then $h$ is convex.
...
- 129
2
votes
1
answer
131
views
Estimating $\max_{\|u\|=1} \frac{ E\left[\langle u\cdot x\rangle ^4\right]}{E\left[\langle u\cdot x\rangle ^2\right]}$
Suppose we have access to samples of $x$ distributed according to unknown multivariate Gaussian in $\mathbb{R}^d$. Estimate the following quantity:
$$\max_{\|u\|=1} \frac{ E\left[\langle u\cdot x\...
- 2,442
4
votes
2
answers
485
views
How to get this inequality in Santambrogio's book about optimal transport?
Let $\hat{\varrho}, \tilde{\varrho}$ be probability density functions on $\mathbb R^d$ where $\tilde{\varrho} \in L^{\infty} (\mathbb R^d)$. For $\varepsilon \in [0, 1]$, we define $\varrho_{\...
- 835
0
votes
0
answers
73
views
Computationally efficient solution for the measure of central tendency minimizing Lp loss for p > 1
We know that the measure of central tendency that minimizes the Lp loss is $\min_c \sum_{i=1}^n |x_i - c|^p$
For $p=1$ (L1 loss), this is the median. For $p=2$ (L2 loss), this is the mean. Both of ...
- 109
2
votes
1
answer
159
views
Conic hull of a rectangle
I have a simple question that appeared in research: For a rectangle $S :=[a_1,b_1] \times[a_2,b_2] \times \dots \times [a_n,b_n] \subset \mathbb{R}^n$. Let $p_0 = (a_1,a_2,\dots,a_n)$, and define $p_i ...
- 275
2
votes
0
answers
178
views
Regularity of linear Bellman equation
Let $f(x,t):B_1 \times [0,1] \to \mathbb{R}$ be Lipschitz function on both $x$ and $t$, $\varphi$ be Lipschitz function on both $x$ and $t$ on the parabolic boundary of $B_1 \times [0,1]$. Let $A$ be ...
- 54
0
votes
1
answer
134
views
Existence of cyclic subspace decompositions for pairs of commuting matrices
Let $\mathbb{K}$ be an arbitrary field (possibly finite). Let $V$ be a finite-dimensional vector space over $\mathbb{K}$, and let $A,B$ be two linear endomorphisms of $V$ which commute.
For $v\in V$, ...
0
votes
1
answer
28
views
Calculating vertex potentials from optimal matchings
Question:
can the solution to the dual of a Linear Program be calculated directly from the solution of the primal Linear Program?
If yes, what are known algorithms and their bounds on complexity.
As ...
- 13.2k
2
votes
0
answers
147
views
Graph Laplacians, Riemannian manifolds, and object collisions
To preface this question, I am a part-time game developer and full-time optimization fiend.
I am working on object collisions at the moment and many resources I have found online are more-or-less just ...
- 21
1
vote
0
answers
168
views
Optimal transport-like problem where the objective depends on conditional probability distribution
$\DeclareMathOperator\marg{marg}$I would like to know if the following problem can be studied as an optimal transport problem, possibly imposing additional assumptions on the data.
Consider two sets $\...
13
votes
2
answers
1k
views
Optimal search puzzle
Consider the following puzzle: On the integer line from 1 to $t$ (top, let's say 1000 for this example), you have two operators: uniform random on 1 to $t$, and subtract 1. What is the optimal ...
- 265
1
vote
1
answer
84
views
optimization over moving domains
Let $A, B$ be Banach spaces, and for any $a\in A$, $B_a\in B$ is a measurable subset. Consider the following optimization problem:
$$L(a)=\inf_{b\in B_a}\ell(b),$$
where $\ell(b)$ is a infinite-times ...
- 87
0
votes
1
answer
140
views
nonlinear equation problem
Can you please help me solve the following nonlinear equation to determine the value of the vector $z$ :
$$
\boldsymbol{a}=\boldsymbol{z}^{2} \odot \boldsymbol{K}*\boldsymbol{z}^{-1}$$
Where:
$\...
- 11
1
vote
0
answers
94
views
Linear Program Optimal Value
If $f(A,b,c)$ is the optimal value of a linear program
$\min c.x$
subject to $A.x \leq b ; x \geq 0.$
Does $f(A,b,c)$ have a piecewise polynomial/rational upper bound in $(A,b,c)$ on the domain of ...
1
vote
0
answers
70
views
LICQ vs MFCQ who is stronger [closed]
I want to ask you which constraint is stronger: MFCQ or LICQ.
- 11
0
votes
1
answer
114
views
Mixed integer program and continuous Diophantine approximation
Let $n\in\mathbb{N}$ such that $n\geq 2$ and let $0<r<1$ be a real number. We wish to solve the following problem.
$$\min_{(t,(z_j)_{j=2}^n) \in \mathbb{R}\times \mathbb{Z}^{n-1}} t$$
subject to ...
0
votes
0
answers
68
views
Optimal top-k column subset
Let $V$ be a set of vectors over $\mathbb{R}^l$, $l\ge 1$, $\pi_i(V)$ be the permutation of vectors in $V$ such that they are ordered by their $i$th component (descending) in order for $\pi_i(V)(\...
- 101
2
votes
1
answer
274
views
Can we say this nonlinear integer programming problem is NP-hard?
I was wondering if the following nonlinear integer programming problem is NP-hard or not.
$$\max_{x_i \in \{0,1\}} \frac{\sum_{i=1}^{n}a_i x_i}{\sqrt{\sum_{i=1}^{n}b_i x_i}}$$
such that $\sum_{i=1}^{n}...
- 21
0
votes
0
answers
201
views
How expensive is a proximal operation?
In optimization, a proximal step is usually considered as cheap as a gradient step. I'm quite confused by this. Why are people taking this convention at all?
A typical proximal step indeed incurs a ...
- 31
2
votes
1
answer
241
views
Is the problem of vertex enumeration from an H-representation of a polytope NP-hard?
According to the Wikipedia page on the issue, the vertex enumeration problem is NP-hard.
However, double description and reverse linear search are algorithms listed to solve the problem. Moreover, ...
- 123
5
votes
0
answers
202
views
Difficulty of solving $Ax=b$ in terms of limiting spectral density of $A$?
Suppose $A$ is a random real-valued $n\times n$ matrix and we want to know the difficulty of solving $Ax=b$ when entries of $b$ are sampled IID from Normal$(0,1)$.
Can we say anything about the ...
- 2,442
1
vote
1
answer
521
views
Optimal transport between two matrices
I'm investigating the use of optimal transport to define a distance between non-negative matrices that satisfy the condition $\mathbf e^\top\mathbf M\mathbf e = 1$ (i.e., the sum of all elements in ...
- 243
0
votes
0
answers
55
views
Relationship of optimal solutions between the total function and the sub function
This is an unconstrained convex optimization problem. Let $\mathcal{N}=\left\{1,\ldots,n\right\}$, $2\leq n<\infty$. Suppose there are many strongly convex functions $f_i(x)$, where $x\in\mathbb{R}^...
- 1
0
votes
0
answers
85
views
Show that $\max_{P_X : X\in (0,1) } \left| \frac{\mathbb{E} [ f'(X) ]}{ \mathbb{E} [ f(X) ] } \right|$ is maximized by at most two mass points
Let $f$ be some given well-behaved function. Consider the following optimization problem overall probability distribution on $[0,1]$
\begin{align}
\max_{P_X : X\in [0,1] } \left| \frac{\mathbb{E} [ ...
- 671
1
vote
1
answer
69
views
$A^*$ algorithm to find shortest path when weights in my graph are the inverse of distance
Given a graph G=(V,E) where the weights on my edges are inverse of Euclidian distance between nodes, I want to know if I can use A* algorithm to find the shortest path. How I need to modify the ...
- 111
1
vote
1
answer
119
views
Optimization on non-convex set
Let $\Omega$ be an open bounded subset of $\mathbb{R}^2$ and $f\in L^2(\Omega)$ be a given function. Consider the optimization problem
$$\mathrm{min} \int_\Omega u(x) f(x) \,dx\,,$$
where a minimum is ...
- 11
0
votes
0
answers
88
views
How to solve mckp (multiple-choice knapsack problem) problem with non-linear constraint
How to solve the below optimization problem? $P$ is a probability matrix, $0\le P_{ij}\le 1$. Are there any developed tools to solve this? Thanks a lot.
\begin{equation*}
\begin{aligned}
&\...
3
votes
1
answer
149
views
How to turn $\{-1, 0, 1\}$-valued optimization problem into integer program?
For an $n \times n$ matrix $M$, the $\infty\to 1$ and cut norms are given by
$$\|M\|_{\infty \to 1} := \max\limits_{x, y \in \{\pm 1\}^n} \sum\limits_{i, j} m_{i, j} x_i y_j, \qquad \|M\|_{\square} :=...
- 745
2
votes
1
answer
183
views
Exponential optimization problem
\begin{eqnarray}
\arg\max_{k}\sum_{i=1}^{p}\sum_{j=1}^{p}\exp\left(-{\frac{\left(X(i,j)-{U_k}(i,j)\right)^2}{2}}\right),\:\: k=0,\dots,p
\end{eqnarray}
where $X$ and $U_k$ are the $p\times p$ matrices,...
- 21
1
vote
0
answers
36
views
Minimizing a ratio related to scalar subset sums
Let $a = (a_1, a_2, \cdots, a_n)$ be non-zero real numbers. Let $[n] = \{1,2,\cdots,n\}$ be a set of indices. Define the maximum absolute subset sum of the array $a$ as:
$$\mathrm{MASS}(a) = \max_{T \...
- 11
2
votes
1
answer
263
views
The best probability distribution for the game of Number Master
In the game of Number Master, the player controls a number starting with $1$ and hits the other numbers one by one on the road.
If the player hits a number smaller or equal to the current controlling ...
- 53
3
votes
1
answer
249
views
Interesting question about the Thomson problem for arbitrary number of electrons
This question is crossposted from here I believe this is a pretty hard question and so I decided to repost the question in the Math Overflow forum. If there is something wrong with doing this, I am ...
- 51
5
votes
1
answer
265
views
Equivalence of bounded gradient flow solutions and uniformly bounded gradient descent trajectories for definable functions
I am reading paper [1] by C. Josz regarding the global convergence of the gradient method. The main result is the following:
$\textbf{Theorem}$: For a definable differentiable function $f : \mathbb{R}^...
- 171
3
votes
0
answers
182
views
Asymptotics for optimal survival time in a stochastic control problem
An individual, henceforth called the runner starts at the center of an open ball $\Omega_r \subset \mathbb R^2$ of radius $r > 1$.
At each turn, a vector $x \in S^1$ is chosen uniformly at random, ...
- 6,155
0
votes
2
answers
531
views
Any idea of solving an optimization problem with cubic constraints?
I have the following optimization problem with cubic constraints, which is hard to solve. Are there any ideas, or related references, of solving such a problem?
$$ \begin{array}{ll} \underset {y, z} {\...
- 21
3
votes
3
answers
279
views
How to convexify or reformulate this non-convex MIP?
I am interested in this non-convex mixed-integer program:
\begin{array}{cl}
\displaystyle\min_{(x_{i},y_{i})\in\mathbb{Z}^{+}\times\mathbb{Z}^{+}}&\displaystyle\sum_{i=1}^{K}y_{i}\left(\...
- 35
1
vote
0
answers
70
views
Expressing a double Riemann Sum as a definite integral
I am reading a paper where the authors rewrite the following expression (for a continious function $\alpha$) into an integral:
$$\lim_{n\to \infty} \left(\min_{1\leq j \leq n}\left(\sum_{k=1}^{j-1} \...
- 662
4
votes
0
answers
243
views
Schrödinger Bridge for other costs
Stochastic control formulations of the Schrödinger bridge problem between $\mu,\nu$ are well known (e.g Chen et al Eq. 4.23)
$$\inf \limits_{p_t, v_t} \int_0^T \int \frac{1}{2}\lvert v_t\rvert^2 p_t ...
- 101
0
votes
1
answer
199
views
Leech lattice shortest vector vs other 23 cases and E8 cases
In this paper by Viazovska, she said that:
"The E8-lattice sphere packing 𝒫E8 is the union of open Euclidean balls with centers at
the lattice points and radius $1/\sqrt{2}$." So I think ...
- 447
2
votes
0
answers
93
views
Curve fitting with "rough" loss functions
Many real-valued classification and regression problems can be framed as minimization in the following way.
Setup:
Let $\Theta \in \mathbb{R}^p$ be the parameter space that we are searching over.
For ...
- 200
5
votes
1
answer
212
views
Upper bound for an inverse Laplace transform
Can anyone see how to get a tight upper bound for the function defined in terms of the inverse Laplace transform below?
$$g_\text{sgd}(t)=\mathcal{L}^{-1}\left[\left(\frac{s}{2}+\frac{5 \sqrt{\frac{2}{...
- 2,442
1
vote
0
answers
52
views
On Designing Some Optimal Control Problems
In the context of a dynamical systems, some states may not be attainable with scalar controls from $L^1(0,T)$, but they may be reachable with feedback controls.
If we know that the system is null ...
- 55
1
vote
0
answers
43
views
The existence of an optimal distributed control problem
Consider $\Omega$ as a bounded interval of $\mathbb{R}$, and let $y\in L^{\infty}(\Omega \times (0,T))$ be a mild solution of the following parabolic partial differential equation:
\begin{equation}\...
- 55
1
vote
0
answers
113
views
Maximisation of a convex (quadratic) function
This post is a continuation of A variant of (discrete) optimal transport problem
For $\alpha=(\alpha_1,\ldots,\alpha_m)\subset\mathbb R^m_+$, $\beta=(\beta_1,\ldots,\beta_n)\subset\mathbb R^n_+$ and $...
- 1,389
3
votes
1
answer
168
views
Condition for 3×3 block matrix to be stable
Given a square symmetric matrix $H\in\mathbb{R}^{n\times n}$, design a symmetric positive definite matrix $M\in\mathbb{R}^{n\times n}$ and positive scalar $\alpha$ such that the following ${3n\times ...
- 33