show/hide this revision's text 4 added 51 characters in body; deleted 2 characters in body

Suppose we want to find the root of the equation $f(x)=\phi(x) - d = 0$, where d is a real constant and $f$ is continuously differentiable function.

The problem is well posed if the inverse $\phi^{-1}$ exists, since in that case $\phi^{-1} (d) = x$.

Now most numerical analysis books I read on the topic of solving nonlinear equations (for example this grad level book) open the discussion by discussing introducing the condition number associated with the problem, in this case it happens to be.

$$ \kappa = \frac{1}{f^{\prime}(x)} = \frac{1}{\phi^{\prime}(x)}$$

From this equation we see that the condition number $\kappa$ is large when $\phi^{\prime}(x)$ is close to zero and we are told large $\kappa$ leads to ill conditioned problems.

But so what?? I can't think of an example for which say Newton Raphson or any other root finding shceme fails when the problem is ill conditioned.

I understand the condition number measures the sensitivity of finding roots of $f$ with respect to the input datum, $d$ in this case. But what practical implications does this have?

I can think of plenty of really bad severely ill conditioned problems. But Newton raphson has no problems with them (I know there are situations in which Newton Raphson fails, but these are due to problems intrinsic to the algorithm and are not dependent on the condition number). Does any one know of an example where the condition number for the above problem is large and a root finding scheme fails? If not then whats the point of examining the condition number.

I apologize in advance if this question is not of the level of the forum. I thought since the answer cannot be found in an elementary text, here was a good place to ask.

show/hide this revision's text 3 deleted 25 characters in body; deleted 97 characters in body

Suppose we want to solve find the root of the equation $f(x)=\phi(x) - d$d = 0$, where d is a real constant and $f$ is continuously differentiable function. Clearly a root finding scheme is applicable.

The problem is well posed if the inverse $\phi^{-1}$ exists, since in that case $\phi^{-1} (d) = x$. So the root finding scheme is equivalent to approximating the function $\phi^{-1}$ at $d$.

Now most books I read on the topic (for example this grad level book) open the discussion by discussing the condition number associated with the problem, in this case it happens to be.

$$ \kappa = \frac{1}{f^{\prime}(x)} = \frac{1}{\phi^{\prime}(x)}$$

From this equation we see that the condition number $\kappa$ is large when $\phi^{\prime}(x)$ is close to zero and we are told large $\kappa$ leads to ill conditioned problems.

But so what?? I can't think of an example for which say Newton Raphson or any other root finding shceme fails when the problem is ill conditioned.

I understand the condition number measures the sensitivity of finding roots of $f$ with respect to the input datum, $d$ in this case. But what practical implications does this have?

I can think of plenty of really bad ill conditioned problems. But Newton raphson has no problems with them (I know there are situations in which Newton Raphson fails, but these are due to problems intrinsic to the algorithm and are not dependent on the condition number). Does any one know of an example where the condition number for the above problem is large and a root finding scheme fails? If not then whats the point of examining the condition number.

I apologize in advance if this question is not of the level of the forum. I thought since the answer cannot be found in an elementary text, here was a good place to ask.

show/hide this revision's text 2 added 3 characters in body; added 21 characters in body; added 9 characters in body

Suppose we want to solve the equation $f(x)=\phi f(x)=\phi(x) - d$, where d is a real constant and assume $f$ is continuously differentiable function. Clearly a root finding scheme is applicable.

The problem is well posed if the inverse $\phi^{-1}$ exists, since in that case $\phi^{-1} (d) = x$. So the root finding scheme is equivalent to approximating the function $\phi^{-1}$ at $d$.

Now most books I read on the topic (for example this grad level book) open the discussion by discussing the condition number associated with the problem, in this case it happens to be.

$$ \kappa = \frac{1}{f^{\prime}(x)} = \frac{1}{\phi^{\prime}(x)}$$

From this equation we see that the condition number $\kappa$ is large when $\phi^{\prime}(x)$ is close to zero and we are told large $\kappa$ leads to ill conditioned problems.

But so what?? I can't think of an example for which say Newton Raphson or any other root finding shceme fails when the problem is ill conditioned.

I understand the condition number measures the sensitivity of finding roots of $f$ with respect to the input datum, $d$ in this case. But what practical implications does this have?

I can think of plenty of really bad ill conditioned problems. But Newton raphson has no problems with them (I know there are situations in which Newton Raphson fails, but these are due to problems intrinsic to the algorithm and are not dependent on the condition number). Does any one know of an example where the condition number for the above problem is large and a root finding scheme fails? If not then whats the point of examining the condition number.

I apologize in advance if this question is not of the level of the forum. I thought since the answer cannot be found in an elementary text, here was a good place to ask.

show/hide this revision's text 1