Loss Landscape Degeneracy and Stagewise Development in Transformers

Jesse Hoogland, George Wang, Matthew Farrugia-Roberts, Liam Carroll, Susan Wei, Daniel Murfet
August 2025
PDF OpenReview arXiv Code
Type
Journal article
Publication
Transactions on Machine Learning Research (TMLR)