Optimization acceleration techniques such as momentum play a key role in state-of-the-art machine learning algorithms. Recently. generic vector sequence extrapolation techniques. such as regularized nonlinear acceleration (RNA) of Scieur et al. https://www.jmannino.com/best-catch-Hot-Shot-Adjustable-Sho-Stik-limited-super/