their march had begun in the rickety clapboard homes on the outskirts of town , where the ex-farmers and ex-miners moved when they grew tired of toiling in the rocky hills and decided to try their hands at urban poverty for a change .