In Nocedal and Wright book "Numerical Optimization", they describe on page 123 (formula 5.49) an update strategy for the beta parameter in the nonlinear conjugate gradient optimization, which was proposed by Dai and Yuan (SIAM Journal on Optimization, 10 (1999), pp. 177182). Nocedal and Wright say that this strategy when used from 2nd iteration onwards guarantees global convergence. However, they don't mention what should be done during the first iterations. Is my guess, that it doesn't really matter which strategy used initially, correct?
Take the 2minute tour
×
MathOverflow is a question and answer site for professional mathematicians. It's 100% free, no registration required.
