Skip to main content
thinkbear's user avatar
thinkbear's user avatar
thinkbear's user avatar
thinkbear
  • Member for 10 years, 3 months
  • Last seen more than 8 years ago
awarded
awarded
awarded
accepted
awarded
awarded
reviewed
Approve
asked
Loading…
awarded
awarded
accepted
comment
Multiplicative gradient descent?
Thanks! I guess the update $w_{t+1}=w_t[-\lambda_t\nabla f(w_t)]$ update, which is a "direct" multiplicative extension of additive gradient descent, is not meaningful anyway, it needs to be exponentiated first to make the variables remain positive. This falls into the MD framework.
awarded
asked
Loading…