Later in his reign, Ernest's actions managed to continually anger his sister-in-law. Though Victoria loved Ernest because he was Albert's brother, she was displeased that Ernest was writing his memoirs, worrying about their contents mainly in regard to her dead husband. Despite their disputes, Ernest still met with Victoria and her family occasionally. In 1891, they met in France; Victoria's lady-in-waiting commented "the old Duke of Saxe-Coburg-Gotha has been here today with his wife. He is the Prince Consort's only brother and an awful looking man, the Queen dislikes him particularly. He is always writing anonymous pamphlets against the Queen and the Empress Frederick, which naturally creates a great deal of annoyance in the family".