<p>Try <a href="https://cv-tricks.com/object-tracking/quick-guide-mdnet-goturn-rolo/" rel="nofollow noreferrer">object tracking</a>. It ensures stability along with more efficient use of computational resources also. </p>

<p>If you are into research, <a href="https://arxiv.org/pdf/1611.06467.pdf" rel="nofollow noreferrer">this paper</a> might give you a better idea.</p>
How do I reduce bounding box shake/jitter in YOLO?
<p>Is there any way to get less jitter on bounding boxes? I sort of understand <a href="http://cs230.stanford.edu/projects_winter_2019/reports/15812427.pdf" rel="nofollow noreferrer">why they happen</a>.</p>

<p>And I am not the only one seeing this. See the video <a href="https://www.youtube.com/watch?v=vGiHciI-NC0" rel="nofollow noreferrer">here</a>.</p>

<p>But I don't see any patches or fixes for this behavior. It also seems to happen within SSDs. From that paper, it seems like the solution is to pass information from one frame to the next... but I haven't been able to find any implementations of this yet.</p>