Lecture 8: Gradient Descent (and Beyond)

Optimization with ADAM and beyond

Analysis of stochastic gradient descent in continuous time

Descent carefully on a gradient!. In machine learning, gradient descent…, by Snehal Nair

Applied Sciences, Free Full-Text

The flaws of Gradient Descent. Why 'Gradient' and 'Descent' have…, by Sinan Özgün

An overview of gradient descent optimization algorithms

W&B Fastbook Reading Group — 5. SGD (Stochastic Gradient Descent)

Lecture 7: Gradient Descent (and Beyond)

Gradient Descent Algorithm and Its Variants, by Imad Dabbura

LipschitzLR: Using theoretically computed adaptive learning rates for fast convergence

Gradient Descent Algorithm and Its Variants, by Imad Dabbura

Descent carefully on a gradient!. In machine learning, gradient descent…, by Snehal Nair

Lecture 22: Gradient Descent: Downhill to a Minimum, Matrix Methods in Data Analysis, Signal Processing, and Machine Learning, Mathematics

4. Beyond Gradient Descent - Fundamentals of Deep Learning [Book]

Gradient Descent and Back-tracking Line Search, by Andreas Maier, CodeX