Skip to main content
Brian Borchers's user avatar
Brian Borchers's user avatar
Brian Borchers's user avatar
Brian Borchers
  • Member for 14 years, 3 months
  • Last seen more than a month ago
comment
Converting (or approximating) a non-differentiable function to a differentiable function
Your question is somewhat vague. Are you defining the function $f(x)$ to be $\min(0,x)$, or is $f(x)$ a function that is already defined and you want to impose the constraint that $f(x)=\min(0,x)$? If you're defining $f(x)$ to be $\min(0,x)$, then how else does $f(x)$ appear in your problem? Does it appear in other constraints? Does it appear in the objective function?
answered
Loading…
comment
How to approx. decompose a sym. p.d. matrix M into X'X?
Then you'll need to make your question more precise by deciding exactly what it is you want to optimize...
Loading…
answered
Loading…
comment
Cholesky Rank-1 downdate extension
My oops- I had thought there was an $O(n^2)$ way to get the inverse of a lower triangular matrix but my memory was faulty. Sorry about that. For the product form cholesky factorization, look at the 2005 paper by Goldfard and Scheinberg, "Product-form Cholesky factorization in interior point methods for second-order cone programming" and follow references back from there. See portal.acm.org/citation.cfm?id=1058105
answered
Loading…
comment
Decomposing a discrete signal into a sum of rectangle functions
It also occurs to me that since your signals are actually 2D, you need to be using 2D basis functions- this would greatly expand the dimensions of the problem. That being the case, I've got nothing better to offer than the iterative scheme mentioned in my previous comment.
comment
Decomposing a discrete signal into a sum of rectangle functions
Simple iterative schemes such as "orthogonal matching pursuit" are often used on very large problems in compressive sensing. Here, you would start by finding the one rectangle that does the most to reduce $\| w - w' \|_{1}$, then recursively repeat this process on what's left until you've got as many terms as you're willing to use. This won't give you a solution that is necessarily optimal, but it might work well in practice.
comment
Decomposing a discrete signal into a sum of rectangle functions
If your problems are that large, than the integer programming formulation is out of the question. However, in compressive sensing practice, solving problems with $~ 10^6$ variables is not at all uncommon. First note that you don't necessarily need to be able to store the $A$ matrix explicitly to solve this problem- there are iterative methods that only need the ability to do matrix-vector multiplies with $A$ and $A^{T}$. Even if you did have to store $A$ explicitly, general purpose LP solvers are often used to solve LP's with millions of variables. So, this may not be out of reach.
comment
Decomposing a discrete signal into a sum of rectangle functions
You've stated that your signal is discrete, which is hugely important. How long are your signals- hundreds of samples? thousands of samples? millions of samples?
revised
Loading…
comment
Decomposing a discrete signal into a sum of rectangle functions
Although I didn't include this in my answer, it's easy to translate the $\| w -w' \|_{1}$ objective and inequalities involving $| x_{i} |$ into linear programming constraints- this is standard textbook material.
Loading…
comment
Decomposing a discrete signal into a sum of rectangle functions
You haven't been specific about what you mean by $|w-w'|$. Is this $ | w - w' | = \sum_{i=1}^{n} | w_{i}-w'_{i} | $ or $ | w - w' | = \max_{i=1, 2, \ldots, n} | w_{i}-w'_{i} | $ or something else?
comment
Decomposing a discrete signal into a sum of rectangle functions
No, this doesn't really do it. The problem here is that your Haar wavelets $\Psi_{n,k}$ have fixed scaling and shifts. The original poster wants to use a limited number of functions but adjust the scaling factors and shifts.
answered
Loading…
comment
Split sum into equal terms
Is $t$ specified, or are you allowed to select $t$ as part of the optimization?
revised
Loading…
awarded
1
11 12
13
14 15
17