Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options questions only not deleted user 78539

Optimization with convex constraints and convex objectives; notions related to convex optimization such as sub-gradients, normal cones, separating hyperplanes

13 votes
1 answer
2k views

Minimize sum of $\ell_2$ norm and linear combination, on simplex

Let $\Delta_n := \{x \in \mathbb{R}^n | x \ge 0, \sum_{1 \le i \le n}x_i = 1\}$ be the $n$-simplex. For $a, b \in \mathbb R^n$, with $\Delta_n \not \ni a$, consider the problem of computing the follo …
dohmatob's user avatar
  • 6,853
4 votes
0 answers
223 views

Fréchet subdifferentiation on riemannian manifolds

Context. I'm looking for a "natural" definition of subdifferentials on riemannian manifolds. Given a function $F:\mathbb R^m \to \mathbb R$, its Fréchet-subdifferential at a point $w \in \mathbb R^m$ …
dohmatob's user avatar
  • 6,853
4 votes
1 answer
389 views

Minimize the variance of a Boltzmann distribution

N.B.: Sorry for cross-posting from https://stats.stackexchange.com/posts/347804/edit (I realized it was the wrong venue for the question, but couldn't find an easy way to transfer the question here). …
dohmatob's user avatar
  • 6,853
4 votes
0 answers
301 views

Derivative of rank $r$ approximation of matrix

Let $Y \in \mathbb R^{n \times c}$ and $r$ be an integer with $1 \le r \le \operatorname{rank}(Y)$. Consider the problem $$\text{minimize} \|Y-X\|_{\text{Fro}}^2\text{ over }X \in \mathbb R^{n \times …
dohmatob's user avatar
  • 6,853
2 votes
1 answer
185 views

Analytic expression for the Moreau envelope of $x \mapsto \|Ax\|$

Given an $m \times n$ matrix $A$ and a vector $c \in \mathbb R^n$, define $\eta(A,c) \ge 0$, $$ \eta(A,c) := \sup_{u \in \mathbb R^n} u^\top c - \frac{1}{2}\|u\|^2 - \|Au\|. $$ Note that $\eta(A,c) = …
dohmatob's user avatar
  • 6,853
2 votes
1 answer
118 views

Analytic value of $\alpha := \sup_{(x,y) \in C} ax+by$, where $C := \{(x,y) \in \mathbb R^2 ...

Let $a,b \in \mathbb R$, $R \ge 0$, and $c > 0$. Define $C := \{(x,y) \in \mathbb R^2 \mid x^2 + y^2 \le 1,\,x^2 + c y^2 \le R^2\}$, and set $$ \alpha := \sup_{(x,y) \in C} ax + b y. $$ Question. In …
dohmatob's user avatar
  • 6,853
2 votes
0 answers
42 views

Dual representation of problems involving $f$-divergences

Studying some problems arising in decision-making under model uncertainty, I'm led to consider the following problems. Let $\mathbb E_P$ and $\mathbb V_P$ denote the expectation and variance operator …
dohmatob's user avatar
  • 6,853
2 votes
0 answers
77 views

Convex optimization over compact sets defined as Aumann set-valued integrals

Let $(X,P)$ be a probability measure space. Let $K$ be a convex compact subset of $\mathbb R^d$ and let $F:X \to 2^{K}$ be a set-valued map. Assume that $F$ is: closed (i.e $F(x)$ is closed for ever …
dohmatob's user avatar
  • 6,853
2 votes
0 answers
44 views

Convergent algorithm for minimizing nonconvex smooth function

Let $\Phi$ be the Gaussian CDF and for $\gamma\ge 0$ and $h>0$, define a loss function $\ell_h:\{\pm 1\} \times \mathbb R$ by $$ \ell_{\gamma,h}(y,y') := \phi_{\gamma,h}(yy') := \Phi((yy'-\gamma)/h). …
dohmatob's user avatar
  • 6,853
2 votes
0 answers
56 views

Whether $d_x(t) := \|P_t(x)-x\|_H$ is increasing in $t$ where $P_t:H \to H$ is the proximal ...

Let $H$ be a Hilbert space (e.g Euclidean $\mathbb R^n$), and fix a proper convex function $f:H \to (-\infty,+\infty]$. Given any $t \ge 0$, let $P_t:H \to H$ be the proximal operator of $f$ at level …
dohmatob's user avatar
  • 6,853
1 vote
0 answers
77 views

Projecting on a convex compact polytope with special form

Let $E$ be a large sparse $l$-by-$n$ matrix ($l$ and $n$ can be in the billions...) with coefficients in $\{-1, 0, 1\}$: the first row of $E$ is the vector $(1,0,0,\ldots,0) \in \mathbb R^n$, and ever …
dohmatob's user avatar
  • 6,853
1 vote
0 answers
70 views

Solve simple stochastic variational inequality

Let $Z$ be a random variable with finite mean $\mathbb E[Z]$ and let $\phi:(-\infty,\infty) \rightarrow (-\infty,\infty]$ be a convex l.s.c function which is differentiable at $z=1$ with gradient $\ph …
dohmatob's user avatar
  • 6,853
1 vote
0 answers
40 views

Minimax theorems in nonconvex setting

Let $X$ be a topological space, $Z$ be a compact convex subset of $\mathbb R^m$, and let $f:X \times Z \to \mathbb R$ be a continuous function (w.r.t the product topology on $X \times Z$). Question. …
dohmatob's user avatar
  • 6,853
1 vote
0 answers
45 views

Analytic lower-bound for minimal value of $\|x\|^2$ such that $\|Cx-b\|^2 \le c^2$ (a hypere...

Let $C$ be an $n \times p$ matrix and $b$ be a column vector of length $n$, and $c>0$. Let $E := \{x \in \mathbb R^p \mid \|Cx-b\| \le c\}$, a hyperellipsoid in nonstandard position. Question 1. Wha …
dohmatob's user avatar
  • 6,853
1 vote
1 answer
129 views

Analytic expression for the min value of $g(t):= \sqrt{(t-1)^2 + a^2}+ b|t|$ subject to $|t-...

Disclaimer. Not sure this is MO-level but would really appreciate some help with this. Thanks in advance. Moved from SE. Let $a,b,c \ge 0$, and define a function $g:\mathbb R \to \mathbb R$ by $g(t) : …
dohmatob's user avatar
  • 6,853

15 30 50 per page