Tag
optimizer
3 verified claims carrying this tag. Each has 2+ primary sources and an HMAC-SHA256 signature.
Adam optimizer introduced in paper: Adam: A Method for Stochastic Optimization (Kingma, Ba, 2014).
dffbe905003cc581 · 2 sources · 100% confidence
AdamW optimizer introduced in paper: Decoupled Weight Decay Regularization (Loshchilov & Hutter, 2017).
b6d51eba4fc7f918 · 2 sources · 100% confidence
Adadelta introduced in paper: ADADELTA: An Adaptive Learning Rate Method (Zeiler, 2012).
f777d78b0ddbdaec · 2 sources · 82% confidence