As long as I might be thought to be pursuing him, the criminal would be off his guard. 
The criminal was off his guard so long as he possibly imagined I was pursuing him.
The criminal felt safe no matter what I did.