- Params
- 36.5M
- Context
- β
- Released
- Jan 2019
L2 regularization and weight decay regularization are equivalent for standard stochastic gradient descent (when rescaled by the learning rate), but as we demons.
Full Decoupled weight decay regularization specs β