Crossmark

The Epochal Sawtooth Phenomenon: Unveiling Training Loss Oscillations in Adam and Other Optimizers

Published Online: 2025-06-01

Authors

Liu, Qi

Ma, Wanjing
Funding

Funding for this research was provided by:

Shanghai Baiyulan Talent Program Pujiang Project (24PJD115)
License Information

Text and Data Mining valid from 2025-06-01

Version of Record valid from 2025-06-01
More Information

Article History

Accepted: 20 May 2025

First Online: 1 June 2025

Document is current