Which of the following gradient descent algorithm suffers from more oscillations?
A)Momentum based gradient descent
B)Nesterov accelerated gradient descent
C)Vanilla gradient descent
D)None of the above
Answer:A
Which of the following gradient descent algorithm suffers from more oscillations?
A)Momentum based gradient descent B)Nesterov accelerated gradient descent C)Vanilla gradient descent D)None of the above