Gradient Descent Algorithm

Mini-batch, Stochastic & Batch Gradient Descent

There are 3 gradient descent algorithms used for backpropagation in neural networks: stochastic, batch and mini-batch.

    1. L_i: loss function (calculate error)
    1. y_i: neural network output (predicted data)
    1. x_i: real output (train label)

Continue reading “Gradient Descent Algorithm”