Seems Irenaeus c.130 – c.202)g  along with other Church fathers, taught perpetual virginity. They was a bit closer to the facts then we are.

Besides, if Mary had other children, why did Jesus give St. John the job of taking care of Mary. That obligation would normally fall to Mary's children, if she had any.