He was succeeded by his younger brother, Charles Smith, the third Viscount. On his death in 1706 the titles became extinct.
Upon his passing in 1706, Charles Smith, the third Viscount, took over the titles.  The titles were then extinguished upon his death.