title: AdamW and Adam with weight decay
body: <p>Is there any difference between <code>torch.optim.Adam(weight_decay=0.01)</code> and <code>torch.optim.AdamW(weight_decay=0.01)</code>?</p>
  <p>Link to the docs: <a href="https://pytorch.org/docs/stable/optim.html" rel="noreferrer">torch.optim</a></p>