Implementation of the paper "Fixing Weight Decay Regularization in Adam" in fastai lib
- Discussion at fastai forum: http://forums.fast.ai/t/challenge-for-advanced-students-implement-adamw-and-sgdw/8004
- Discussion with authors: loshchil/AdamW-and-SGDW#1
- Github: fastai/fastai#46
- Paper: https://arxiv.org/abs/1711.05101