Backpropagation

Backpropagation might be the most important equation in all of machine learning today. It forms the basis for all massive learning that computers are able to do.

Essentially, its a backward pass that updates the variables of the neural net after a forward pass has been completed and the loss has been calculated.