In late December 1900, Karl Alexander reportedly fell ill with influenza. His condition soon worsened, becoming complicated with inflammation of the lungs and a slowing heart rate before the end of the month.
He died at Weimar on 5 January 1901. Following his death, he was succeeded as Grand Duke by his grandson Wilhelm Ernst, his only son Carl August having predeceased him.