Entities · Models
AdamW
10 articles tagged with this entity.
-
DMuon: Efficient Distributed Muon Training with Near-Adam Overhead
-
Gefen: Optimized Stochastic Optimizer
-
Softsign: Smooth Sign in Your Optimizer For Better Parameter Heterogeneity Handling
-
MONA: Muon Optimizer with Nesterov Acceleration for Scalable Language Model Training
-
When Muon Optimizer Meets Adversarial Training: A Theoretical and Empirical Study
-
Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra
-
Momentum Streams for Optimizer-Inspired Transformers
-
Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR
-
From SGD to Muon: Adaptive Optimization via Schatten-p Norms
-
Dimension-Free Saddle-Point Escape in Muon