Stack Exchange network consists of 183 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
Thanks! I guess the update $w_{t+1}=w_t[-\lambda_t\nabla f(w_t)]$ update, which is a "direct" multiplicative extension of additive gradient descent, is not meaningful anyway, it needs to be exponentiated first to make the variables remain positive. This falls into the MD framework.