too far away to care for them or your daily job or whatever prevented it
The daily job and the distance got in the way of caring for them.
We were always very close to them, and the job was flexible enough to allow it.