because if you took them into your home to to work in your yard or whatever they'd know where your house is and how to break in then
Taking them to your home will let them know where you live.
By taking them home they will never find out where you live.