Saturday, 26 November 2016

An overview of gradient descent optimization algorithms by Sebastian Ruder.

"Gradient descent is one of the most popular algorithms to perform optimisation and by far the most common way to optimise neural networks." Here's a look at different algorithms for optimising gradient descent.

This is really clear and useful - you can use it for learning or revision.

No comments:

Post a Comment

Note: only a member of this blog may post a comment.