<p>As the text from the <code>lr_find</code> method says, you can visually inspect the plot and choose a learning rate in a range where the loss is falling prior to divergence.  A higher learning rate in this range will converge faster.  This is an idea called an &quot;LR range test&quot; from <a href="https://arxiv.org/pdf/1506.01186.pdf" rel="nofollow noreferrer">Leslie Smith's paper</a> that became popular through the <a href="https://github.com/fastai/fastai" rel="nofollow noreferrer">fastai</a> library and was later adopted by other libraries like <a href="https://github.com/amaiya/ktrain" rel="nofollow noreferrer">ktrain</a> and Amazon's <a href="https://mxnet.apache.org/versions/1.6/api/python/docs/api/gluon/index.html" rel="nofollow noreferrer">Gluon</a> library.   The red dot in this plot is just a numerical approximation of where the loss is dramatically falling that may be useful for automated scenarios, but not necessarily the best.   In this plot, the red dot represents the steepest part of the curve, which is one strategy to automatically select a learning rate from the plot (without visual inspection).  Other automated strategies include taking the learning rate associated with the minimum loss and dividing by 10, and finding the learning rate associated with the <a href="https://github.com/fastai/fastai/pull/3377" rel="nofollow noreferrer">longest valley</a>.</p>
How to understand loss-learning rate (log scale) plot using learner.lr_plot in ktrain package?
<p>I am using ktrain package to classify text. My experiment is shown as:</p>
<p><a href="https://i.stack.imgur.com/7rBep.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/7rBep.png" alt="enter image description here" /></a></p>
<p>lr_find and lr_plot are functions in ktrain. They can be used to highlight the best learning rate, which is shown as the red dot in the plot.</p>
<p>I do not understand how to understand this plot:</p>
<ol>
<li>How to transfer log scale to the normal linear one?</li>
<li>Why the best scale is the red dot?</li>
</ol>