In 1804, Hummel became "Konzertmeister" to Nikolaus II, Prince Esterházy's estate at Eisenstadt. Although he had taken over many of the duties of "Kapellmeister" because Haydn's health did not permit him to perform them himself, he continued to be known simply as the "Konzertmeister" out of respect to Haydn, receiving the title of "Kapellmeister", or music director, to the Eisenstadt court only after the older composer died in May 1809. He remained in the service of Prince Esterházy for seven years altogether before being dismissed in May 1811 for neglecting his duties. He then returned to Vienna where, after spending two years composing, he married the opera singer Elisabeth Röckel in 1813. The following year, at her request, was spent touring Russia and the rest of Europe. The couple had two sons. The younger, Carl (1821–1907), became a well-known landscape painter. The older, , worked as pianist, conductor and composer; he moved to the U.S. and died in Troy, New York. He was at Beethoven's funeral as a pallbearer.