He would stay with her longer than was generally considered "proper" and with the court's concern for propriety it was quite scandalous. The other ladies began to harass her and she began to waste away.
It was considered improper for him to stay with her for an extended period, which caused significant scandal. As a result, the other ladies began to harass her, leading to her weakening health.