title: Tensorflow runs "Running per image evaluation" indefinitly
body: <p>I am running my first tensorflow job (object detection training) right now, using the tensorflow API. I am using the ssd mobilenet network from the modelzoo. I used the >>ssd_mobilenet_v1_0.75_depth_quantized_300x300_coco14_sync.config&lt;&lt; as a config-file and as a fine tune checkpoint the >>ssd_mobilenet_v1_0.75_depth_300x300_coco14_sync_2018_07_03&lt;&lt; checkpoint.</p>
  
  <p>I started my training with the following command:</p>
  
  <pre><code>PIPELINE_CONFIG_PATH='/my_path_to_tensorflow/tensorflow/models/research/object_detection/models/model/ssd_mobilenet_v1_0.75_depth_quantized_300x300_coco14_sync.config'
  MODEL_DIR='/my_path_to_tensorflow/tensorflow/models/research/object_detection/models/model/train'
  NUM_TRAIN_STEPS=200000
  SAMPLE_1_OF_N_EVAL_EXAMPLES=1
  python object_detection/model_main.py \
  --pipeline_config_path=${PIPELINE_CONFIG_PATH} \
  --model_dir=${MODEL_DIR} \
  --num_train_steps=${NUM_TRAIN_STEPS} \
  --sample_1_of_n_eval_examples=$SAMPLE_1_OF_N_EVAL_EXAMPLES \
  --alsologtostderr
  </code></pre>
  
  <p>No coming to my problem, I hope the community can help me with. I trained the network over night and it trained for 1400 steps and then started evaluating per image, which was running the entire night. Next morning I saw, that network only evaluated and the training was still at 1400 steps. You can see part of the console output in the image below.</p>
  
  <p><a href="https://i.stack.imgur.com/8bGwl.png" rel="nofollow noreferrer">Console output from evaluation</a></p>
  
  <p>I tried to take control by using the eval config parameter in the config file.</p>
  
  <pre><code>eval_config: {
    metrics_set: "coco_detection_metrics"
    use_moving_averages: false
    num_examples: 5000
  }
  </code></pre>
  
  <p>I added max_evals = 1, because the documentation says that I can limit the evaluation like this. I also changend eval_interval_secs = 3600 because I only wanted one eval every hour. Both options had no effect.</p>
  
  <p>I also tried other config-files from the modelzoo, with no luck. I searched google for hours, only to find answers which told me to change the parameters I already changed. So I am coming to stackoverflow to find help in this Matter. </p>
  
  <p>Can anybody help me, maybe hat the same experience? Thanks in advance for all your help!</p>
  
  <h3>Environment information</h3>
  
  <pre><code>$ pip freeze | grep tensor
  tensorboard==1.11.0
  tensorflow==1.11.0
  tensorflow-gpu==1.11.0
  
  $ python -V
  Python 2.7.12
  </code></pre>