Once they took the wrong turning and went nearly half a mile out of their direction.
They went a half mile out of their way when they took a wrong turn.  
They were travelling in the right direction for sure.  