- make-adam parameters #!key (learning-rate 0.001) (beta1 0.9) (beta2 0.999) (epsilon 1e-08) (weight-decay 0.0)procedure
Adam (Adaptive Moment Estimation) optimizer with bias correction.
- beta1
- exponential decay rate for first moment (default 0.9)
- beta2
- exponential decay rate for second moment (default 0.999)
- epsilon
- numerical stability constant (default 1e-8)