title: Expected validation accuracy for Keras Mobile Net V1 for CIFAR-10 (training from scratch)
body: <p>Has anybody trained Mobile Net V1 from scratch using CIFAR-10? What was the maximum accuracy you got? I am getting stuck at 70% after 110 epochs. Here is how I am creating the model. However, my training accuracy is above 99%.</p>
  
  <pre><code>#create mobilenet layer
  
  MobileNet_model = tf.keras.applications.MobileNet(include_top=False, weights=None)
  
  # Must define the input shape in the first layer of the neural network
  
  x = Input(shape=(32,32,3),name='input')
  
  #Create custom model
  
  model = MobileNet_model(x)
  
  model = Flatten(name='flatten')(model)
  
  model = Dense(1024, activation='relu',name='dense_1')(model)
  
  output = Dense(10, activation=tf.nn.softmax,name='output')(model)
  
  model_regular = Model(x, output,name='model_regular')
  </code></pre>
  
  <p>I used Adam optimizer with a LR= 0.001, amsgrad = True and batch size = 64. Also normalized pixel data by dividing by 255.0. I am not using any Data Augmentation.</p>
  
  <pre><code>optimizer1 = tf.keras.optimizers.Adam(lr=0.001, amsgrad=True)
  
  model_regular.compile(optimizer=optimizer1, loss='categorical_crossentropy', metrics=['accuracy'])
  
  history = model_regular.fit(x_train, y_train_one_hot,validation_data=(x_test,y_test_one_hot),batch_size=64, epochs=100)  # train the model
  </code></pre>
  
  <p>I think I am supposed to get at least 75% according to <a href="https://arxiv.org/abs/1712.04698" rel="nofollow noreferrer">https://arxiv.org/abs/1712.04698</a>
  Am I am doing anything wrong or is this the expected accuracy after 100 epochs. Here is a plot of my validation accuracy.</p>
  
  <p><a href="https://i.stack.imgur.com/IOMyN.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/IOMyN.png" alt="enter image description here"></a></p>