Norm-constrained optimizer for neural network training with reference implementations of Scion and ScionLight supporting multiple norms (spectral, Frobenius, etc.). Includes hyperparameter guidance, nanoGPT/MLP/CNN example configurations, and notes on a recent momentum initialization change.
This page was last edited on 2026-03-03.
This page was last edited on 2026-03-03.