In 1822, Ripley was a town of frequent street fights and shootouts, where the most common type of business was a saloon. During the Rankins' first few months there, hecklers and protesters often followed the new preacher through town and gathered outside his cabin while their first permanent home was being built, just yards from the river at 220 Front Street. When the local newspaper began publishing his letters to his brother on the topic of slavery (see next section), Rankin's reputation grew among both supporters and opponents of the anti-slavery movement. Slave owners and hunters often viewed him as their prime suspect and appeared at his door at all hours demanding information about fugitives. Soon, Rankin realized that the home was too accessible a place for him to properly raise his family.