<p dir="auto">In cases where one wants to run multiple iterations of density back to back, we really need to make sure a pervious iteration's load doesn't leak into this one. 2 main culprits are:</p>
<ol dir="auto">
<li>Deleting the namespace will return in a moment, when really it takes like ~15m to delete all events (~20,000 events for 3000 pods). These deletes actually have a bad effect on the next run.</li>
<li>We should make sure the pods are actually gone on the kubelet before staring a new run by using the proxy to poll /pods or something. Otherwise we're effectively putting &gt; 30 pods on a node and the kubelet is known to be slow during pod deletes.</li>
</ol>
<p dir="auto">This is obviously not a problem if we tear down the entire cluser between iterations.<br>
<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/gmarek/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/gmarek">@gmarek</a></p>
<p dir="auto"><a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="90399147" data-permission-text="Title is private" data-url="https://github.com/kubernetes/kubernetes/issues/10225" data-hovercard-type="pull_request" data-hovercard-url="/kubernetes/kubernetes/pull/10225/hovercard" href="https://github.com/kubernetes/kubernetes/pull/10225">#10225</a> refers</p>
<p dir="auto">Copy of my notes from there:</p>
<p dir="auto">This just all looks terribly wrong (not this particular PR, but the code around it).  Note to myself to understand it properly and fix it up soon.  Specifically:</p>
<ol dir="auto">
<li>The function deleteTestingNS() does nothing of the sort.  It just polls until all namespaces with some magic prefix are not in deleting state.  It would seem that that simply doesn't work if there are parallel test runs in flight.</li>
<li>If the comments in this PR are true, then we're deleting the contents of namespaces in a rather bizirre way.  I'd like to understand that.</li>
<li>Having namespace deletion take up to 60 minutes to complete is simply untenable in automated tests. Isn't this called for every test invocation?  Or perhaps it's once per test run.  Either way, it's way too long.</li>
</ol>
<p dir="auto">Q</p>