title: Pytorch-Forecasting N-Beats model with SELU() activation function?
body: <p>I am working at <strong>timeseries forecasting</strong>, and I've using the PyTorch lib <strong><a href="https://pytorch-forecasting.readthedocs.io/en/latest/" rel="nofollow noreferrer"><code>pytorch-forecasting</code></a></strong> lately. If you didn't know it, try it. It's great.</p>
  <p>I am interested in <code>SELU</code> activation function for Self-Normalizing-Networks (SNNs, <a href="https://pytorch.org/docs/master/generated/torch.nn.SELU.html#torch.nn.SELU" rel="nofollow noreferrer">see, e.g., the docs</a>). As <strong>I didn't find any N-Beats corrected to use SELU</strong> and its requirements (i.e. AlphaDropout, proper weights init), <strong>I made an implementation myself</strong>.</p>
  <p>It would be great if <strong>any of you with experience</strong> with these concepts -NBeats architecture, <code>pytorch-forecasting</code>, or SELU()- <strong>could review whether everything is right in my implementation</strong>.</p>
  <p><strong>My implementation here</strong>: <a href="https://gist.github.com/pnmartinez/fef1f488497fa85a2cc1626af2a5b4bd" rel="nofollow noreferrer">https://gist.github.com/pnmartinez/fef1f488497fa85a2cc1626af2a5b4bd</a></p>