<blockquote>
  <p>Do we consider this scenario to be supervised learning?</p>
</blockquote>

<p>It is supervised learning when you have labels to optimize your model. So for most neural networks, it is supervised.</p>

<p>However, you might also look at the complete task. I guess you don't have any ground truth for image pairs and the "desired" similarity value your model should output?</p>

<p>One way to solve this problem which sounds inherently unsupervised is to take a CNN (convolutional neural network) trained (in a supervised way) on the 1000 classes of image net. To get the similarity of two images, you could then simply take the euclidean distance of the output probability distribution. This will not lead to excellent results, but is probably a good starter.</p>

<blockquote>
  <ol start="2">
  <li>What algorithms i should use to train etc..</li>
  </ol>
</blockquote>

<p>First, you should define what "similar" means for you. Are two images similar when they contain the same object (classes)? Are they similar if the general color of the image is the same?</p>

<p>For example, how similar are the following 3 pairs of images?</p>

<p><a href="https://i.stack.imgur.com/LBa8D.jpg" rel="noreferrer"><img src="https://i.stack.imgur.com/LBa8D.jpg" alt="enter image description here"></a></p>

<p><a href="https://i.stack.imgur.com/U1icu.jpg" rel="noreferrer"><img src="https://i.stack.imgur.com/U1icu.jpg" alt="enter image description here"></a></p>

<p><a href="https://i.stack.imgur.com/ozgEl.png" rel="noreferrer"><img src="https://i.stack.imgur.com/ozgEl.png" alt="enter image description here"></a></p>

<p>Have a look at <a href="https://arxiv.org/abs/1503.03832" rel="noreferrer">FaceNet</a> and search for "Content based image retrieval" (CBIR):</p>

<ul>
<li><a href="https://en.wikipedia.org/wiki/Content-based_image_retrieval" rel="noreferrer">Wikipedia</a></li>
<li><a href="https://scholar.google.de/scholar?hl=en&amp;q=content+based+image+retrival&amp;btnG=&amp;as_sdt=1%2C5&amp;as_sdtp=" rel="noreferrer">Google Scholar</a></li>
</ul>
Image similarity detection with TensorFlow
<p>Recently I started to play with tensorflow, while trying to learn the popular algorithms i am in a situation where i need to find similarity between images.</p>

<p>Image A is supplied to the system by me, and userx supplies an image B and the system should retrieve image A to the userx if image B is similar(color and class).</p>

<p>Now i have got few questions:</p>

<ol>
<li>Do we consider this scenario to be supervised learning? I am asking
because i don't see it as a classification problem(confused!!)</li>
<li>What algorithms i should use to train etc..</li>
<li>Re-training should be done quite often, how should i tackle this
problem so i don't train everytime from scratch( fine-tuning??)</li>
</ol>