<p>First of all this is a hyperparameter of your training. Choosing the right batch size is non-trivial and depends on several factors.</p>
<p>Thus if you could afford it, you could try using an hyperparameter optimization approach (e.g. grid search, random search, evolutionary strategies, Bayesian opt. methods such as TPE) to find the &quot;optimal&quot; batch size.</p>
<p>If you cannot afford it, I would suggest considering the insights from this <a href="https://arxiv.org/abs/1609.04836" rel="nofollow noreferrer">paper</a>. Thus, find a good trade-off between your computational constraints and smallest possible batch size.</p>
batch size for neural net large data set?
<p>I have 1000000 points of training data. What would be a good batch size to use?
I was thinking 32 but think that would take ages. Its on cpu you as well so dont want to use
to high batch size.</p>