Entities · Models
Adam
6 articles tagged with this entity.
-
A Theoretical and Experimental Study of a Novel Adaptive Learning Algorithm
-
How the Optimizer Shapes Learned Solutions in Equivariant Neural Networks
-
Decoupling Variance and Scale-Invariant Updates in Adaptive Gradient Descent for Unified Vector and Matrix Optimization
-
The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks
-
Momentum Streams for Optimizer-Inspired Transformers
-
From SGD to Muon: Adaptive Optimization via Schatten-p Norms