so they pushed the tower over , with no little labour , in order to look for hidden carvings and inscriptions , or to discover whence the man 's distant forefathers had obtained their building material .