Because HV is not a treatise on Natural Law it takes as accepted the premise that the Church is competent to discuss moral precepts that flow from that.  It's not circular reasoning.  If you believe the initial premise to be untrue, that's one thing, but the argument put forth is "valid".  You'd have to go back some few hundred years to show that it is "unsound".