Skip to main content

All Questions

Filter by
Sorted by
Tagged with
1 vote
2 answers
444 views

Levenberg-Marquadt near the minima for non-zero-residual problems

I'm using the LM algorithm to do gradient descent in a model fitting context. I'm minimizing: $$ c(x) = \sum ( f_i(x) - y_i )^2 $$ I'm noticing that after a few steps when I'm close to the minima, I ...
Alex Flint's user avatar
1 vote
2 answers
242 views

what method can I employ to solve this optimization problem which involves \min?

The optimization problem is: maximize $$\min(\sum\limits_{i=1}^N \log\left(a_{1,i}+\frac{b_{1,i}}{c_{1,i}+d_{1,i}x_i}\right),\sum\limits_{i=1}^N \log\left(a_{2,i}+\frac{b_{2,i}}{c_{2,i}+d_{2,i}x_i}\...
zzzhhh's user avatar
  • 764
1 vote
1 answer
82 views

Do we really need degree constraints for ILP formulations of TSP problems

The Dantzig-Fulkerson ILP-formulation of the symmetric TSP is $$\min\sum\limits_{i=1}^{n-1}\sum\limits_{j=i+1}^n c_{ij}x_{\lbrace i,j\rbrace}\quad\text{s.t.}\\ \sum\limits_{j\ne i,\,j=1}^n x_{\lbrace ...
Manfred Weis's user avatar
  • 13.2k
1 vote
1 answer
98 views

Optimality gap between a joint linear program and decoupled sub programs

Let $\mathbf{c}_i,\mathbf{s}_i$ be given entry-wise positive $n\times 1$ vectors for $i\in[1,\dots,d]$. Let $\tau, \alpha_1,\dots, \alpha_d$ be given positive constants. Consider the linear ...
dineshdileep's user avatar
  • 1,421
1 vote
1 answer
111 views

Optimal "Generalization" of Polylines

This question is inspired by a lossy compression technique for polylines, namely to identify a subset of the points of polyline $\mathcal{P}$, whose removal yields a polyline $\mathcal{Q}$ within a ...
Manfred Weis's user avatar
  • 13.2k
1 vote
2 answers
83 views

Algorithm for a linear optimization problem

For the vectors $X=(x_1,\cdots, x_n),~ Y=(y_1,\cdots, y_n)$ and $\alpha=(\alpha_1,\cdots,\alpha_n),~ \beta=(\beta_1,\cdots, \beta_n)\in\mathbb R^n_+$ s.t. $\sum_{k=1}^n\alpha_k~~=~~\sum_{k=1}^n\beta_k~...
Higgs88's user avatar
  • 131
1 vote
1 answer
1k views

convert absolute form into linear programming problem [closed]

I would like to convert this problem into a Linear Programming Problem : $\min |x|+|y|+|z|$ subject to $x+y \leq 1$ $2x+z=3$. The solution to this problem is given chapter and here. But I still ...
roni's user avatar
  • 113
1 vote
1 answer
2k views

Computation of extreme rays of rational polyhedral cones - Hemmecke's project and lift algorithm

I am working on an implementation of Raymond Hemmecke's algorithm for finding generating sets of cones: http://arxiv.org/abs/math/0203105 Unfortunately I am struggling to make the algorithm work on ...
swistak's user avatar
  • 11
1 vote
2 answers
1k views

Efficient algorithm finding 'a' solution of system of linear inequalities

I'm working on rational number field $\mathbb{Q}$. Is there an efficient algorithm finding a solution of system of linear inequalities? In many computer algebra systems like Sage or Maple, there ...
Moon's user avatar
  • 627
1 vote
2 answers
660 views

constructing a curve dividing two sets of points

Lets assume I have two sets of points, each characterized as being "A" or "B", respectively, that are in a Euclidean plane. Theoretically these two sets are samplings from a space that has ...
Carolyn's user avatar
  • 11
1 vote
1 answer
240 views

Conditions for differentiability of minima and minimizers of linear functionals?

Let $B$ be a (real) Banach space and $C$ be a compact convex subset of $B$. For every continuous linear functional $F$ on $B$, define $V(F)=min_{c\epsilon C} F(c)$ and $S(F)= { \lbrace c \epsilon C :...
wdiamond's user avatar
1 vote
1 answer
9k views

what is the difference between the revised simplex method andthe full tableu?

No to sound naive but they look like they include the same steps to me, one's just the algorithmical representation of the other. Thanks in advance.
Jorge Guzman's user avatar
1 vote
1 answer
106 views

Iterated optimal transport

Suppose we are interested in two consecutive transport plans (in the Kantorovich formulation). That is, we are given finite sets $X$, $Y$ and $Z$, endowed with probability measures $\mu_X$, $\mu_Y$ ...
tex.support's user avatar
1 vote
1 answer
69 views

$A^*$ algorithm to find shortest path when weights in my graph are the inverse of distance

Given a graph G=(V,E) where the weights on my edges are inverse of Euclidian distance between nodes, I want to know if I can use A* algorithm to find the shortest path. How I need to modify the ...
user2512443's user avatar
1 vote
1 answer
119 views

Optimization on non-convex set

Let $\Omega$ be an open bounded subset of $\mathbb{R}^2$ and $f\in L^2(\Omega)$ be a given function. Consider the optimization problem $$\mathrm{min} \int_\Omega u(x) f(x) \,dx\,,$$ where a minimum is ...
mlogm's user avatar
  • 11
1 vote
2 answers
121 views

How to solve the optimization problem $\max_{\mathbf{w}}\sum_i\text{sign}(\mathbf{w}^T \mathbf{x}_i)$?

I am looking for an algorithm to solve the following optimization problem $$\max_{\mathbf{w}}\sum_i\text{sign}(\mathbf{w}^T \mathbf{x}_i)$$ where $\mathbf{w}$ and each $\mathbf{x}_i\in\mathbb{R}^d$. ...
user3750444's user avatar
1 vote
1 answer
3k views

How to minimize l1-norm constrained by "infinity norm"

Let $A \in \mathbb{R}^{m \times n}$ and $b \in \mathbb{R}^m $. I have the following two problems: P.1. \begin{equation} \underset{x\in\mathbb{R}^n}{\text{minimize}} \| Ax-b \|_1 \\ \text{s.t. } \| x \...
Paul Goyes's user avatar
1 vote
1 answer
168 views

Perturbation of the value of a general-sum game at a equilibirium

Consider a general-sum game with $N$ players. Let $u_i(a_1, \ldots, a_N)\colon \prod_{i=1}^N A_i \rightarrow \mathbb{R} $ be the payoff of the player $i\in \{ 1, \ldots, N \}$ when each player takes ...
Steve's user avatar
  • 1,127
1 vote
1 answer
475 views

Sufficient conditions for a system of linear inequalities to admit a solution

I am looking for sufficient conditions such that a system of linear inequalities of the type $A x >0$ admits a non-negative solution $x \in \mathbb{R}^n_+$. I know a few properties of the $m \times ...
Peter's user avatar
  • 355
1 vote
1 answer
126 views

Quantifier elimination and where is this quantified convex program in the polynomial hierarchy?

I have a quantified convex program of the form that I need to solve $$\exists(x_{1,1},\dots,x_{1,n})\in\mathbb R^n\quad\forall(x_{2,1},\dots,x_{2,n})\in\mathbb R^n$$ $$\vdots$$ $$\exists(x_{2t-1,1},\...
VS.'s user avatar
  • 1,826
1 vote
1 answer
123 views

LASSO problem but with a maximization instead of minimization

I have the following optimization problem (like the LASSO problem but with maximization instead of minimization): $\mathbf{maximize}_{\boldsymbol{\alpha}} \|\mathbf{x} -\mathbf{A}\boldsymbol{\alpha}\|...
Christina's user avatar
  • 111
1 vote
1 answer
169 views

Optimization of a continuous function

This is more like an optimization problem but any solution is appreciated. I have a data set with input specifying power(demand) to be generated for a particular time period(TP). Input: Time --- ...
Karthaveeryarjun Vinjamoori's user avatar
1 vote
1 answer
185 views

Complexity Measures for Mathematical Programming

Question: Are there any complexity measures in use, that allow one to compare mathematical programming formulations of optimization problems on basis of the number of variables that must be subjected ...
Manfred Weis's user avatar
  • 13.2k
1 vote
1 answer
206 views

Show $0-1$ Knapsack is polynomially reducible to this problem

I have already posted this question here but have not received an answer so I am cross-posting with hope to reach a larger amount of mathematicians: Let $T=\{1,\cdots,n\}$ and consider the ...
Kuifje's user avatar
  • 225
1 vote
1 answer
113 views

Are convex combinations of 0-1 Pareto efficient vectors efficient?

Let $Y$ be any subset of $\{0,1\}^n$ for $n\geq3$. A vector $\alpha\in$ $Y$ is Pareto efficient if there is no $\beta\in$ $Y$ such that $\beta_i$ $\geq$ $\alpha_i$ for each $i\in\{1,...,n\}$ and $\...
econ-math's user avatar
1 vote
1 answer
390 views

Efficiently Generating the Convex Hulls of Two Polytopes and Counting Faces

Suppose you have two polytopes $P_1, P_2 \in \Bbb{R}^n$ given by $$ P_1 = \lbrace x: A_1 x \le b_1\rbrace$$ $$ P_2 = \lbrace x: A_2 x \le b_2\rbrace $$ I wish to find their convex hull, that is a ...
Sidharth Ghoshal's user avatar
1 vote
1 answer
175 views

accelerate convex optimization by proximal projection

I am using level method to solve non-smooth convex programming problem (where the objective function is given by an oracle from another program ): http://www2.isye.gatech.edu/~nemirovs/Lect_EMCO.pdf ...
user40780's user avatar
  • 867
1 vote
1 answer
624 views

a closed form lower bound solution for linear programming

Given a linear objective function and a system of linear constraints, is there any known closed form lower bounds for it? to clearly express the problem assume that $$ z(\mathbf{a,B,c})=\mathop {\inf} ...
user51780's user avatar
  • 275
1 vote
1 answer
296 views

Deducing Linear Inequalities

Let $X_1,X_2,\ldots,X_n $ be indeterminates. Denote by $S$ the set of all linear inequalities of the form $X_{i_1}+X_{i_2}+\ldots+X_{i_k} \geq k,$ with $k \in \{ 1,2,\ldots,n \}$ and $1 \leq i_1< ...
user21277's user avatar
  • 185
1 vote
1 answer
234 views

Model for shipping widgets in an optimal way

I am a programmer and have the following requirement. We are trying to figure out the optimal way to ship widgets. Below is the scenario: We need to ship 1,000,000 widgets We have two different size ...
TerryB's user avatar
  • 113
1 vote
1 answer
119 views

Adding linear constraint to the domain

I don't know if it is a well-known problem, but I have been struggling to come up with an algorithm. I have a set of linear constraints $Ax\le b$, $b\ge 0$ ($b$ and $A$ are given, $x$ is a variable). ...
Ryszard Eggink's user avatar
1 vote
1 answer
169 views

Best projection on non-convex discrete set with two constraints

I want to compute the projection of a vector $\left( x\right) _{1\leq i,j\leq n}\in \lbrack 0,1]^{n\times n}$ on the following discrete set $$ S=\left\{ x\in \{0,1\}^{n\times n}:x_{i,j}+x_{j,i}\leq 1;\...
Goga's user avatar
  • 47
1 vote
1 answer
181 views

Linear programming with "nice" matrices

Consider the following linear programming problem \begin{array}{ll} \text{minimize} & \mathrm 1^{\top} \mathrm x\\ \text{subject to} & v\le \mathrm A \mathrm x \le u\\ & \mathrm x \geq ...
user12345678's user avatar
1 vote
1 answer
1k views

Check if a point is in the interior of the convex hull of some other points in high dimensions, and lower-bounding the largest enclosed ball [closed]

Given $m$ points $P=\{p_0, p_1, ..., p_m\}$ in high dimensions (e.g. 100), it is known that computing (or even representing) their convex hull $\text{conv}(P)$ is generally intractable due to the ...
Dazheng's user avatar
  • 11
1 vote
1 answer
157 views

Constructing representations of probability revision functions

Let $P$ be a probability distribution over a finite Boolean algebra $\mathfrak{B}$, and fix a parameter $t_{P} \in (\frac{2}{3}, 1)$. Define the `revision function of $P$', $R_{P}: \mathfrak{B}\...
King Kong's user avatar
  • 631
1 vote
1 answer
628 views

Allowing an "OR" option between equations in a linear program

I am looking for a way to express an "or" option in a system of linear inequalities for a linear program I am working on. I will explain what I mean precisely: Lets say I have a set of ...
Eric_'s user avatar
  • 141
1 vote
2 answers
958 views

Integer linear programming (ILP) formulation of connectivity of induced subgraph

Can anyone assist me to find out what should be the ILP formulation of a case when I try to label vertices by say $0$, $1$ and $2$ and want the subgraph of graph $(V,E)$ made by same vertex set but ...
Himanshu Khandelwal's user avatar
1 vote
1 answer
130 views

find a PSD matrix that that verify matrices sum of equality

$A $, $ C$ $(n,n)$ are symmetric PSD matrices, $B$ is PD symmetric matrix, and $H_i$ $\; $ $(i=[1,m])$ represent $ m $ complex matrices. $H_i$ are all one rank matrix Our objectif is to find ...
hichem hb's user avatar
  • 377
1 vote
1 answer
330 views

How good is the LP relaxation?

Consider the optimization problem \begin{align} \max_{x\in\mathbb{R}^n}~c^Tx~, \text{ s.t. } Ax=b,~x_i\in\{0,1\}~\forall i \end{align}where $c,b\in\mathbb{R}_{+}^n$ and $A\in\mathbb{R}_{+}^{n\times n}$...
dineshdileep's user avatar
  • 1,421
1 vote
1 answer
184 views

Do doubly infeasible Linear Programming problems always have doubly infeasible bases?

Consider a Linear Programming problem in dictionary form, $$\max\Big\{f^\pi+\!\!\!\sum_{j\in D(\pi)}\!\! d^\pi_jx_j~\Big|~\forall~i\!\in\!B(\pi)~~~ b^\pi_i+\!\!\!\sum_{j\in D(\pi)}\!\! G^\pi_{ij}x_j\...
Goswin's user avatar
  • 21
1 vote
1 answer
207 views

Computing probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s

This question came up in my research: What is the probability that $Ax\geq0$ where $x$ is a vector of iid gaussians and $A$ is matrix of $1$s and $0$s? So far I only figured out that I can do Monte ...
nivwusquorum's user avatar
1 vote
1 answer
1k views

Linear programming with exponentially many constraints and variables [closed]

From class, I learnt that problems like traveller salesman have a Linear programming representation with exponentially many constraints. Using method of separation, this problem is solved rather ...
user40780's user avatar
  • 867
1 vote
1 answer
70 views

Heuristic for choosing n-vectors from n-sets

my given problem is: choose n-vectors from n-sets (one vector from each set) so that the biggest element in the sum of the chosen vectors is minimal. Unfortunately the problem is NP-hard. So I'm ...
Clemens's user avatar
  • 11
1 vote
1 answer
3k views

Minimizing sum of absolute deviations

Suppose we want to find coefficients $b$ in $\underset{b}{\operatorname{argmin}} \displaystyle\sum\limits_{i=1}^n | y_{i}-b_{1}x_{i}-b_{0}\mid$. If we rewrite this problem in terms of linear ...
Math_manul's user avatar
1 vote
1 answer
246 views

Eigenvalue problem with quadratic constraints

$\circ$ Consider the following eigenvalue problem : $$Ax=\lambda x \hspace{0.5cm} (1)$$ where matrice $A \in \mathbb{R}_{n \times n}$ is a positive semi-definite with eigenvectors $x = (x_{1},x_{2},.....
user41037's user avatar
1 vote
2 answers
306 views

Name of operations on two vectors

Suppose we have two vectors $x\in \mathbb{R}^n$ and $y\in \mathbb{R}^m$. I could define the mapping $$ T: \mathbb{R}^n\times \mathbb{R}^m \rightarrow \mathbb{R}^{n\times m} $$ as follows $$ T(x,y) = ( ...
Fedor Nikitin's user avatar
1 vote
1 answer
4k views

What does "Vertex Solution" mean?

Hello! I come across the word "vertex solution" in the context " We can also assume that x and y are vertex solutions,so that the sequence {x,y} remains in a finite set." Could anybody know any ...
tendow's user avatar
  • 13
1 vote
2 answers
1k views

Nonstandard Hessian approximations in Gauss-Newton

The Gauss-Newton algorithm optimizes functions $$ E(x) = \sum f(x)^2 $$ by approximating f as (locally) linear, in which case the Hessian of $E$ is approximated as $$ H = 2 \sum {J_f}^T J_f $$ Now ...
Alex Flint's user avatar
1 vote
1 answer
769 views

Results for minimizing the norm w.r.t a unitary matrix

Suppose $x \in \mathbb{R}^n$, $B,U \in \mathbb{R}^n\times\mathbb{R}^n$ and $U$ a unitary matrix. Define $g_{U}(x) = || BUx||$ where $||.||$ is some norm or norm-ish function on $\mathbb{R}^n$ (not ...
safetyduck's user avatar
1 vote
2 answers
134 views

LP/QP with not-so-constant linear constaints

I have an otherwise standard LP or PSD QP problem as below: $\min\limits_x {c}' x$ subject to $Ax\leq b$ or $\min\limits_x \frac{1}{2}{x}' Qx + {c}' x$ subject to $Ax\leq b$ the only exception ...
JJL's user avatar
  • 11

1
4 5
6
7 8
10