As his son died on 8 October 1849, Brown's grandson, Lieutenant-colonel William Richmond Brown, succeeded to the baronetcy in 1864.
In 1864, Lieutenant-colonel William Richmond Brown succeeded to the baronetcy after his father passed away on 8 October 1849.