he had never thought , so engaged had he been with other matters , that the servants were cognizant of the whole affair , and that from them he had no expectation of being able to keep the whole story in all its details .