“…With backpropagation, the simple gradient descent can be used to identify the optimal weights as follows:
where η represents the learning rate. Furthermore, more complex and better performance methods also exist to optimise the weights, such as the Levenberg–Marquardt algorithm [
32].…”