title: Tensorflow Serving Batching parameters
body: <p>How to do performance tuning of batching using <code>max_batch_size</code>, <code>batch_timeout_micros</code>, <code>num_batch_threads</code> and other parameters? Tried using these parameters with the Query client, it doesn't work.</p>
  <p>In the below example I have 100 images and I want to batch in size of 10. The query runs for all images instead of 10.</p>
  <pre class="lang-sh prettyprint-override"><code>bazel-bin/tensorflow_serving/example/demo_batch --server=localhost:9000 --max_batch_size=10
  </code></pre>
  <p>Also, for batch scheduling how to make it run every 10 secs after the first batch is done? Thanks.</p>