<p>I think the best solution is deep learning because detective always has <em>different backgrounds</em>. You can use Faster rcnn, or if you want speed, you can make nice detectives with a good training using Yolo algorithm. You can find Github repo easily. The mathematics of work is described in these links.</p>

<ul>
<li>Faster RCNN <a href="https://arxiv.org/abs/1506.01497" rel="nofollow noreferrer">https://arxiv.org/abs/1506.01497</a></li>
<li>Yolo <a href="https://pjreddie.com/darknet/yolo/" rel="nofollow noreferrer">https://pjreddie.com/darknet/yolo/</a></li>
</ul>
Extracting same point from images
<p>Hope you guys are doing well.</p>

<p>I have a question about opencv and extracting the same point from number of images.</p>

<p>Say, we have a dataset of around 100 images. (maybe more but for this purpose it will suffice).</p>

<p>Image will look something like:</p>

<p><a href="https://i.stack.imgur.com/6Dr6D.jpg" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/6Dr6D.jpg" alt="enter image description here"></a></p>

<p>As you can see in the image, there is an area marked in RED. I have marked that using Paint for this purpose. It indicates the highest point of the heap of soil. All the 100 images we have look more or less the same (without that crane in the background. But it can be removed using some opencv techniques, so that is not an issue). But this heap of soil can be either on the left hand side or the right hand side. According to its position, the coordinate of the highest point in the heap will change. </p>

<p>So, my question is, how to find this position given that the heap can be either on left or right side? 
Note that this position can be relative to some object (for example in this image, midpoint of the crane) or if the images are of different size than we can resize the images to have same dimensions and take the coordinates of the point w.r.t the image itself. </p>

<p>How do we find out the highest point of the heap though? Should we manually go through each image, label that point and make a dataset with the images and bounding boxes? Or is there another decent soulution to this?</p>

<p>Also, if the soil heap is labelled manually (Like shading the required area i.e. heap of an image) using Paint or some other software, would that help too? But I cannot think of anything to do after this. </p>

<p>Thank You.</p>