TensorFlow network not training? <p>I had a really weird time with TensorFlow the last days and can not think of what's going wrong atm.</p> <p>I have built this network: <a href="http://pastebin.com/GZaX4aYN" rel="nofollow">link</a>. It is a copy of TensorFlow's MNIST example.</p> <p>Basically, what I did, is altering the network from taking 28x28x1 images (MNIST greyscale) to 600x800x1 images (some images I took on my own, webcam with a relatively clean background and one object at different locations).</p> <p>What I wanted to do is playing around with such a CNN and have it output the x-location of the object in the image. So one single output neuron.</p> <p>However, no matter what I tried, the network is always outputting 1.0. Even (when you look at my testing section at the end of the code) when I feed all ones, all zeros or all random numbers into the network.</p> <p>Of course, since I have only 21 labeled training and 7 labeled test pictures I expected the performance to be really bad (since 800x600 pixel images are huge for neural networks and locating an object isn't easy).</p> <p>...but I have no idea at all why the network always outputs 1.0 even if it is fed with nonsense. Any ideas?</p>