An extension of the Adagrad machine learning optimization algorithm which improves upon the two main drawbacks of the method.