- make-adam parameters #!key (learning-rate 0.001) (beta1 0.9) (beta2 0.999) (epsilon 1e-08) (weight-decay 0.0)procedure
Adam (adaptive moment estimation) with bias correction.
- beta1
- decay rate of the first moment (default 0.9)
- beta2
- decay rate of the second moment (default 0.999)
- epsilon
- numerical stability constant (default 1e-8)
- weight-decay
- L2 regularization factor, added to the gradient (default 0.0)