John's brother Charles then assumed the title of Count of Albany and was active in Catholic circles in London but died from the same address (by then called 52 Alderney Street) on a trip to France on the Steamer "Rainbow" near Bordeaux, 24 December 1880, and was buried at Eskadale. His son Charles Edward Stuart Allen, the last self-styled Count of Albany, died in Jersey in 1882. He had married Lady Alice Hay (1835-1881), a daughter of the 18th Earl of Erroll, but they had no issue.