<p><strong>Question 1</strong></p>
<p>Yolov5 performs object detection. The generated bounding boxes are passed to Deep Sort which tracks the objects. Tracking is done by an association based on two things:</p>
<ol>
<li>Mahalanobis distance between predicted Kalman states and newly arrived measurements</li>
<li>Appearance descriptor</li>
</ol>
<p>In combination, both metrics complement each other by serving different aspects of the assignment problem. The Mahalonobis distance is suitable when the motion uncertainty is low, but when there is occlusion and/or unaccounted frame skipping the Mahalanobis distance is rather useless. Therefore, the idea is to use a visual metric to complement the motion metric. In order to do this an appearance descriptor is calculated for each bounding box detection and are compared to a &quot;gallery&quot; of appearance descriptors, this is particularly useful to recover identities after long-term occlusions or rapid displacements.</p>
<p>So, yes. Both Yolo and DeepSort are used to generate the txt file.</p>
<p><strong>Question 2.</strong></p>
<p>In the original <a href="https://arxiv.org/pdf/1703.07402.pdf" rel="nofollow noreferrer">Deep Sort paper</a> it is stated that the appearance descriptors are generated by a CNN trained on MARS as stated. <a href="https://github.com/ZQPei/deep_sort_pytorch#training-the-re-id-model" rel="nofollow noreferrer">Some implementations</a> of Deep Sort also uses the Market1501 dataset for this purpose. Both of them only contains persons. They choose these datasets because they focus on the MOT challenge dataset which only contains persons.</p>
<p>So, ideally you would train your own appearance descriptor on the class you want to track.</p>
Data generation method of DeepSort + Volov5 algorithm
<p>First of all, I am practicing based on
'https://github.com/mikel-brostrom/Yolov5_DeepSort_Pytorch'.</p>
<p>Question 1</p>
<p>Is the created txt file a file to which both yolo algorithm and deepsort algorithm are applied?</p>
<p>Question 2</p>
<p>I trained the detector yolo to apply it on custom data.
Does deepsort also need to train custom data afterwards?</p>