<p>You can refer to the metrics used in the <strong>MOT Challenge.</strong></p>
<p>Here's the results for the MOT 2020 Challenge and they have included the metrics used here:
<a href="https://motchallenge.net/results/MOT20/" rel="nofollow noreferrer">https://motchallenge.net/results/MOT20/</a></p>
<p>Based on the <a href="https://arxiv.org/pdf/2003.09003.pdf" rel="nofollow noreferrer">MOT 20 paper</a>, they said at section 4.1.7 (page 7):</p>
<blockquote>
<p>As we have seen in this section, there are a number of reasonable performance measures to assess the quality of a tracking system, which makes it rather difficult to reduce the evaluation to one single number. To nevertheless give an intuition on how each tracker performs compared to its competitors, we compute and show the average rank for each one by ranking all trackers according to each metric and then averaging across all performance measures.</p>
</blockquote>
What are the best metrics for Multi-Object Tracking (MOT) evaluation and why?
<p>I want to compare multiple computer vision <strong>Multi-Object Tracking (MOT)</strong> methods on my own dataset, so first I want to choose the best metrics for this task. I have carried out some research in scientific literature and I come to the conclusion that there are three main metrics sets:</p>
<ol>
<li>Metrics from <a href="https://www.researchgate.net/publication/4246190_Tracking_of_Multiple_Partially_Occluded_Humans_based_on_Static_Body_Part_Detection" rel="nofollow noreferrer">&quot;Tracking of Multiple, Partially Occluded Humans based on Static Body Part
Detection&quot;</a></li>
<li><a href="https://www.researchgate.net/publication/26523191_Evaluating_multiple_object_tracking_performance_The_CLEAR_MOT_metrics" rel="nofollow noreferrer">CLEAR MOT metrics</a></li>
<li><a href="https://arxiv.org/abs/1609.01775" rel="nofollow noreferrer">ID scores</a></li>
</ol>
<p>Therefore, I wonder to which of the above metrics should I attach the greatest importance?</p>
<p>And I would like to ask if anyone has encountered a similar issue and has any thoughts on this topic that could justify and help me to choose the best metrics for the above task.</p>