Guardianship is an obligatory duty for males not a right that they have. See it as if someone was appointed as the minister at the Ministry of Education. It is not a position that gives them higher status, but it is an obligatory position to attend the needs of the education system and help with them.
Nevertheless, while being obligated, as a guardian. Some of these guardians do not practice their duty the right way, which is to attend the female. Hence, they practice their patriarchal authority through the obligation that they have.