<p>This termin, according to <a href="https://arxiv.org/abs/1904.09751" rel="nofollow noreferrer">this article</a>, means the situations in text generation process when eigther generator model find the state <strong>x</strong> such that <strong>G(x) = x</strong> which means that generated text is repeated infinitely, or, according to error state in the middle of generation process, the model starts to reproduce incoherent text patterns. </p>
What does "text degeneration" mean?
<p>In machine learning, especially NLP, <strong>what does it mean to degenerate a text?</strong></p>
<p>I heard this phrase some days ago in my office and after googling it I saw there are some papers for it, so I thought it might be important and I'm here to aks about the terminology.</p>