- Params
- 85.5M
- Context
- β
- Released
- Jun 2020
We introduce ADAHESSIAN, a second order stochastic optimization algorithm which dynamically incorporates the curvature of the loss function via ADAptive estimat.
Full 6-Layer-Tensor-Transformer+AdaHessian specs β