<p>Sequence-to-Sequence Learning as Beam-Search Optimization is a paper that describes the steps neccesary to use beam search in the training process.
<a href="https://arxiv.org/abs/1606.02960" rel="nofollow noreferrer">https://arxiv.org/abs/1606.02960</a></p>

<p>The following issue contains a script that can perform the beam search however it does not contain any of the training logic
<a href="https://github.com/tensorflow/tensorflow/issues/654" rel="nofollow noreferrer">https://github.com/tensorflow/tensorflow/issues/654</a></p>
Do we need to use beam search in training process?
<p>If we use beam search in seq2seq model it will give more proper results. There are several tensorflow implementations. 
But with the softmax function in each cell you can't use beam search in the training process. So is there any other modified optimization function when using beam search?  </p>