Entities · Models
Muon
17 articles tagged with this entity.
-
Adaptive Batch Sizes Using Non-Euclidean Gradient Noise Scales for Stochastic Sign and Spectral Descent
-
DMuon: Efficient Distributed Muon Training with Near-Adam Overhead
-
Muon$^p$: Muon with Fractional Spectral Powers
-
How Much Orthogonalization Does Muon Need?
-
How the Optimizer Shapes Learned Solutions in Equivariant Neural Networks
-
Decoupling Variance and Scale-Invariant Updates in Adaptive Gradient Descent for Unified Vector and Matrix Optimization
-
Can Entry-Wise Clipping Give Spectral Control of Stochastic Gradients?
-
MONA: Muon Optimizer with Nesterov Acceleration for Scalable Language Model Training
-
Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training
-
The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks
-
Muon in Vision Transformers: Optimizer-Recipe Interactions and Gradient Spectra
-
Momentum Streams for Optimizer-Inspired Transformers
-
Muon in Associative Memory Learning: Training Dynamics and Scaling Laws
-
HTMuon: Improving Muon via Heavy-Tailed Spectral Correction
-
Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR
-
From SGD to Muon: Adaptive Optimization via Schatten-p Norms
-
Dimension-Free Saddle-Point Escape in Muon