Sultan Abdul Mecit moved into the newly built Dol-mabahce Palace in 1853 , and by 1909 Topkape was completely abandoned.
Everyone had left Topkape by the year 1909.  
Topkape was never inhabited by Sultans.  