There are 3 gradient descent algorithms used for backpropagation in neural networks: stochastic, batch and mini-batch.
- : loss function (calculate error)
- : neural network output (predicted data)
- : real output (train label)
C++, UE4, AI developer
Mini-batch, Stochastic & Batch Gradient Descent
There are 3 gradient descent algorithms used for backpropagation in neural networks: stochastic, batch and mini-batch.